00010000:00010000:2.0:1782759384.474397:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.474437:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232763392:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.474443:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1782759384.475906:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218424064 00000100:00100000:2.0:1782759384.475913:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218424064 00000100:00100000:2.0:1782759384.475949:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 291 00000100:00100000:2.0:1782759384.475958:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102677:x1869355218424064:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1782759384.476148:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102677:x1869355218424064:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 190us (300us total) trans 4294967618 rc 0/0 00000100:00100000:2.0:1782759384.476156:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 291 00000100:00100000:2.0:1782759384.482259:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218424448 00000100:00100000:2.0:1782759384.482267:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218424448 00000100:00100000:2.0:1782759384.482323:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2529 00000100:00100000:2.0:1782759384.482334:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:102677:x1869355218424448:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759384.482422:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482436:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482446:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482458:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60b232 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482467:0:8593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60b224 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26f94 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482493:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60b232 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482524:0:8593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60b224 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26f94 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.482538:0:8593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60b224 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26f94 expref: 9 pid: 6531 timeout: 3524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.482551:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232763520:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759384.482667:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf715240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.487457:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232763520:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759384.487485:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60b232 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489566:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60b232 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489606:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60b232 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489664:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b239 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489674:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b239 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489683:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b239 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x4:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489720:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60b240 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489728:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60b240 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.489739:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60b240 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.489758:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232763648:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1782759384.489916:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.489941:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf715240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.490218:0:8593:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967903 gen 2 00000004:00080000:2.0:1782759384.490224:0:8593:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967892 committed transno 4294967903 00000004:00080000:2.0:1782759384.490243:0:8593:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967899 committed transno 4294967903 00000020:00080000:2.0:1782759384.490248:0:8593:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc48ce780 refcount 2 committed 0 result 0 batchid 18 00000020:00080000:2.0:1782759384.490252:0:8593:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc22f8300 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4c4a480 00000020:00080000:2.0:1782759384.490256:0:8593:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].18 00000020:00080000:2.0:1782759384.490258:0:8593:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc22f8200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4875800 00000020:00080000:2.0:1782759384.490261:0:8593:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].18 00000004:00080000:2.0:1782759384.490284:0:8593:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967900 committed transno 4294967903 00000020:00080000:2.0:1782759384.490288:0:8593:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cdecd85d540 refcount 2 committed 0 result 0 batchid 19 00000020:00080000:2.0:1782759384.490291:0:8593:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63f00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc5787480 00000020:00080000:2.0:1782759384.490296:0:8593:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].19 00000020:00080000:2.0:1782759384.490298:0:8593:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cded8612800 00000020:00080000:2.0:1782759384.490301:0:8593:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].19 00000004:00080000:2.0:1782759384.490317:0:8593:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967903 committed transno 4294967903 00000020:00080000:2.0:1782759384.490320:0:8593:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc68bfa80 refcount 2 committed 0 result 0 batchid 20 00000020:00080000:2.0:1782759384.490323:0:8593:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc68bf3c0 00000020:00080000:2.0:1782759384.490326:0:8593:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].20 00000020:00080000:2.0:1782759384.490329:0:8593:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63000 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cded8613000 00000020:00080000:2.0:1782759384.490331:0:8593:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].20 00000100:00100000:2.0:1782759384.490351:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232763648:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759384.490367:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60b240 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b247 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.490377:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60b240 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b247 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.491056:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232763776:0@lo:403:mdt00_003.0 00000100:00100000:2.0:1782759384.491094:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.491119:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf715240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.494457:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232764032 00000100:00100000:2.0:1782759384.494463:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232764032 00000100:00100000:2.0:1782759384.494517:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1782759384.494527:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232764032:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759384.494742:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232764032:12345-0@lo:1000:osp_up0-1.0 Request processed in 217us (349us total) trans 4294967906 rc 0/0 00000100:00100000:2.0:1782759384.494748:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1782759384.504069:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218424832 00000100:00100000:2.0:1782759384.504077:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218424832 00000100:00100000:2.0:1782759384.504138:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2531 00000100:00100000:2.0:1782759384.504153:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:102678:x1869355218424832:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759384.504187:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.504208:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b26a lrc: 2/0,0 mode: --/CR res: [0x200000421:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb26fa2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.504258:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b271 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.504270:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b271 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.504282:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b271 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.504328:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1782759384.504331:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759384.504365:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b26a lrc: 0/0,0 mode: --/CR res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fa2 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.504379:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b271 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fa2 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.504386:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759384.504388:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1782759384.504391:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648200, rc 0) 00000100:00100000:2.0:1782759384.504446:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:102678:x1869355218424832:12345-192.168.202.31@tcp:101:touch.0 Request processed in 300us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.504453:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2531 00000100:00100000:2.0:1782759384.514350:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.531352:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.538337:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218426240 00000100:00100000:2.0:1782759384.538346:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218426240 00000100:00100000:2.0:1782759384.538404:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2537 00000100:00100000:2.0:1782759384.538415:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:102679:x1869355218426240:12345-192.168.202.31@tcp:101:mv.0 00010000:00010000:2.0:1782759384.538435:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.538450:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b2ef lrc: 2/0,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb26fc5 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538499:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538508:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538515:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538525:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538529:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538533:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538566:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538569:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538623:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538629:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538644:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.538650:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538658:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538670:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:2.0:1782759384.538674:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.538678:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538685:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b2f6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538698:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538704:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538710:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538715:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.538725:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538731:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538740:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x121d9c5e (ffff8cddc3500b00) 00010000:00010000:2.0:1782759384.538742:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.538746:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538752:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b2fd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538780:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b2ef lrc: 1/0,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fc5 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538796:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:2.0:1782759384.538797:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.538800:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b2ef lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fc5 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.538806:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759384.538859:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:102679:x1869355218426240:12345-192.168.202.31@tcp:101:mv.0 Request processed in 447us (593us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759384.538864:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2537 00000100:00100000:2.0:1782759384.543032:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.543104:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.544766:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232764800 00000100:00100000:2.0:1782759384.544772:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232764800 00000100:00100000:2.0:1782759384.544810:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1782759384.544817:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232764800:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1782759384.544828:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.544841:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b30b lrc: 2/0,0 mode: --/CW res: [0x200000421:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b304 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.544862:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b30b lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b304 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.544875:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b30b lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b304 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.544883:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759384.544886:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.544888:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759384.544923:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232764800:12345-0@lo:101:mdt_io00_000.0 Request processed in 107us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.544928:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00010000:00010000:2.0:1782759384.546919:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428a00/0xd5b45c7f5c60b1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b1f3 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759384.546935:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428a00/0xd5b45c7f5c60b1ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b1f3 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.546965:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428a00/0xd5b45c7f5c60b1ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b1f3 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.546977:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759384.547000:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428a00/0xd5b45c7f5c60b1ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b1f3 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759384.547032:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967909 is committed 00000001:00080000:2.0:1782759384.547048:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967906 is committed 00000100:00100000:2.0:1782759384.547074:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759384.547089:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232765056:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1782759384.547142:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.547184:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232765056 00000100:00100000:2.0:1782759384.547190:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232765056 00000100:00100000:2.0:1782759384.547240:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1782759384.547251:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3665:x1869355232765056:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1782759384.547266:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.547285:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60b1f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b1ec expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.547302:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x1c8b5715 (ffff8cddc3502c00) 00010000:00010000:2.0:1782759384.547315:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.547352:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355232765056:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 102us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.547361:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1782759384.547394:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232765056:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1782759384.548169:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232765312 00000100:00100000:2.0:1782759384.548173:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232765312 00000100:00100000:2.0:1782759384.548209:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1782759384.548213:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232765312:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759384.548284:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232765312:12345-0@lo:1000:mdt_io00_000.0 Request processed in 70us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.548311:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000004:00080000:2.0:1782759384.551264:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 42 rpc_version 42 00000020:00100000:2.0:1782759384.551285:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759384.551294:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4a90700 x1869355232766464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1696/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759384.551308:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232766464:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759384.551339:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.551362:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.551925:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232766464:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1782759384.552211:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759384.552219:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429600/0xd5b45c7f5c60b304 lrc: 2/0,0 mode: CW/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b30b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.552233:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429600 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759384.552241:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429600/0xd5b45c7f5c60b304 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b30b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759384.552259:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429600/0xd5b45c7f5c60b304 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b30b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.552287:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429600/0xd5b45c7f5c60b304 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b30b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.552295:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759384.552320:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429600/0xd5b45c7f5c60b304 lrc: 1/0,0 mode: --/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b30b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.552337:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429600/0xd5b45c7f5c60b304 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b30b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.552354:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.552358:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.552361:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759384.552442:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232766592 00000100:00100000:2.0:1782759384.552446:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232766592 00000100:00100000:2.0:1782759384.552481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1782759384.552489:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3665:x1869355232766592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759384.552501:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.552517:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b30b lrc: 0/0,0 mode: --/CW res: [0x200000421:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b304 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.552528:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759384.552532:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.552566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3665:x1869355232766592:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.552574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1782759384.552759:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232766720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759384.555451:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.558827:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218426880 00000100:00100000:2.0:1782759384.558836:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218426880 00000100:00100000:2.0:1782759384.558887:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 293 00000100:00100000:2.0:1782759384.558904:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9345c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:102159:x1869355218426880:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:2.0:1782759384.561774:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9345c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:102159:x1869355218426880:12345-192.168.202.31@tcp:37:bash.0 Request processed in 2871us (3002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.561798:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 293 00000100:00100000:2.0:1782759384.572845:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218427136 00000100:00100000:2.0:1782759384.572854:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218427136 00000100:00100000:2.0:1782759384.572891:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2540 00000100:00100000:2.0:1782759384.572898:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:102680:x1869355218427136:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759384.572911:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.572922:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b374 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb26fda expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.572953:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b37b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.572961:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b37b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.572968:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b37b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.572996:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1782759384.573000:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759384.573020:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b374 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fda expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.573031:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b37b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fda expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.573037:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759384.573038:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759384.573049:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759384.573127:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:102680:x1869355218427136:12345-192.168.202.31@tcp:101:rm.0 Request processed in 190us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.573132:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2540 00000100:00100000:2.0:1782759384.586969:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:2.0:1782759384.590722:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759384.590731:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.590745:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759384.590759:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b3c8 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.590769:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b3c8 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.590784:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x7:0x0].0x0 (ffff8cddc34fea00) 00010000:00010000:2.0:1782759384.590787:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759384.590790:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b3c8 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.590797:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b3c8 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.590806:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.590807:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.590809:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759384.593066:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218428288 00000100:00100000:2.0:1782759384.593075:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218428288 00000100:00100000:2.0:1782759384.593123:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 295 00000100:00100000:2.0:1782759384.593132:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:102680:x1869355218428288:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:2.0:1782759384.593312:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:102680:x1869355218428288:12345-192.168.202.31@tcp:35:rm.0 Request processed in 180us (286us total) trans 4294967623 rc 0/0 00000100:00100000:2.0:1782759384.593320:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 295 00000100:00100000:2.0:1782759384.596502:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.599059:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218428672 00000100:00100000:2.0:1782759384.599067:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218428672 00000100:00100000:2.0:1782759384.599119:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2546 00000100:00100000:2.0:1782759384.599128:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102680:x1869355218428672:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759384.599144:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.599159:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b3eb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb26fef expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.599213:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b3f2 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.599225:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.599235:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.599271:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1782759384.599275:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759384.599295:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.599318:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b3eb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fef expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.599347:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26fef expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.599356:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759384.599359:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759384.599362:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759384.599417:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:102680:x1869355218428672:12345-192.168.202.31@tcp:101:rm.0 Request processed in 289us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.599425:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2546 00000100:00100000:2.0:1782759384.601060:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218428928 00000100:00100000:2.0:1782759384.601066:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218428928 00000100:00100000:2.0:1782759384.601099:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2547 00000100:00100000:2.0:1782759384.601107:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:102680:x1869355218428928:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759384.601118:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.601130:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b3f9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb26ff6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.601197:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1782759384.601268:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b3f9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26ff6 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.601278:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc3502a00) 00010000:00010000:2.0:1782759384.601280:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759384.601282:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b3f9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26ff6 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.601300:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759384.601331:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:102680:x1869355218428928:12345-192.168.202.31@tcp:101:rm.0 Request processed in 226us (494us total) trans 4294967911 rc 301/301 00000100:00100000:2.0:1782759384.601336:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2547 00000100:00100000:2.0:1782759384.612776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218429440 00000100:00100000:2.0:1782759384.612783:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218429440 00000100:00100000:2.0:1782759384.612871:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 336 00000100:00100000:2.0:1782759384.612881:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:2404:x1869355218429440:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:2.0:1782759384.612895:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.612919:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60b263 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26f9b expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.612936:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x0 (ffff8cddc3502100) 00010000:00010000:2.0:1782759384.612946:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.612986:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2404:x1869355218429440:12345-192.168.202.31@tcp:103:rm.0 Request processed in 106us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.612993:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 336 00010000:00010000:2.0:1782759384.618151:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618165:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618173:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618179:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.618218:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618236:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b22b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618264:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:2.0:1782759384.618271:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.618288:0:3649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60b40e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b407 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618309:0:3649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60b40e lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60b407 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618331:0:3649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60b40e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60b407 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618367:0:3649:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60b40e lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b407 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.618382:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3649:1869355232766976:0@lo:105: 00000100:00100000:2.0:1782759384.618447:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.618496:0:3649:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.618773:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232767104 00000100:00100000:2.0:1782759384.618779:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232767104 00000100:00100000:2.0:1782759384.618818:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232767232 00000100:00100000:2.0:1782759384.618823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232767232 00000100:00100000:2.0:1782759384.618854:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232767360 00000100:00100000:2.0:1782759384.618859:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232767360 00000100:00100000:2.0:1782759384.618883:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782759384.618894:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3663:x1869355232767104:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782759384.618914:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.618935:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60b319 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b312 expref: 12 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.618951:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x121d9c5e (ffff8cddc3502f00) 00010000:00010000:2.0:1782759384.618963:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.619008:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3663:x1869355232767104:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 114us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.619034:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1782759384.619060:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1782759384.619088:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3664:x1869355232767232:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782759384.619105:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.619121:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b335 lrc: 0/0,0 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b32e expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.619145:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xb:0x0].0x0 (ffff8cddc34fe600) 00010000:00010000:2.0:1782759384.619157:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.619190:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3664:x1869355232767232:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 118us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.619200:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1782759384.619215:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1782759384.619223:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded1881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3664:x1869355232767360:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782759384.619232:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.619242:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b247 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b240 expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.619266:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x6:0x0].0x0 (ffff8cdee7e02000) 00010000:00010000:2.0:1782759384.619275:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.619313:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded1881c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3664:x1869355232767360:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.619331:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1782759384.619544:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232767744 00000100:00100000:2.0:1782759384.619551:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232767744 00000100:00100000:2.0:1782759384.619629:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1782759384.619658:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232767744:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759384.619854:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232767744:12345-0@lo:1000:osp_up0-1.0 Request processed in 199us (354us total) trans 4294967913 rc 0/0 00000100:00100000:2.0:1782759384.619865:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1782759384.620254:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232768256 00000100:00100000:2.0:1782759384.620259:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232768256 00000100:00100000:2.0:1782759384.620291:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:2.0:1782759384.620302:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6532:x1869355232768256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.620382:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6532:x1869355232768256:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.620398:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:2.0:1782759384.620843:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3edf100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232768512:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759384.620907:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232768768 00000100:00100000:2.0:1782759384.620912:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232768768 00000100:00100000:2.0:1782759384.620949:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1782759384.620956:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6532:x1869355232768768:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759384.620964:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.620982:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b431 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b42a expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.620997:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b431 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b42a expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.621008:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b431 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b42a expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.621015:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x8:0x0].0x0 (ffff8cddc34fdf00) 00010000:00010000:2.0:1782759384.621018:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759384.621020:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759384.621054:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6532:x1869355232768768:12345-0@lo:101:mdt00_001.0 Request processed in 98us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.621061:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000004:00080000:2.0:1782759384.621627:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 15 rpc_version 15 00000020:00100000:2.0:1782759384.621659:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759384.621666:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc479f100 x1869355232769024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759384.621680:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232769024:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759384.621708:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.621728:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.622201:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232769024:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1782759384.622351:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759384.622360:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b42a lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b431 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.622373:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759384.622386:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b42a lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b431 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759384.622410:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b42a lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b431 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.622440:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b42a lrc: 2/0,0 mode: --/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b431 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.622453:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759384.622474:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b42a lrc: 1/0,0 mode: --/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b431 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.622494:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b42a lrc: 0/0,0 mode: --/EX res: [0x200000421:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b431 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.622514:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.622516:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.622519:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759384.624147:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218429824 00000100:00100000:2.0:1782759384.624152:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218429824 00000100:00100000:2.0:1782759384.624235:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2549 00000100:00100000:2.0:1782759384.624244:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102680:x1869355218429824:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759384.624260:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.624273:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b43f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb26ffd expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624320:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624343:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624353:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624366:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624374:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624381:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624438:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b454 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624446:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b454 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624454:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b454 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.624486:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1782759384.624489:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759384.624506:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b454 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624516:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624532:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624538:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624545:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624550:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.624554:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624561:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624570:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:2.0:1782759384.624573:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.624605:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624613:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60b446 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624625:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624630:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624650:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624661:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.624665:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624671:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624680:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x75afac74 (ffff8cddc34fdd00) 00010000:00010000:2.0:1782759384.624682:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.624685:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624692:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b44d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624716:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b43f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26ffd expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624729:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b454 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26ffd expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.624736:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759384.624738:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759384.624741:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759384.624782:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102680:x1869355218429824:12345-192.168.202.31@tcp:101:rm.0 Request processed in 539us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.624789:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2549 00000100:00100000:2.0:1782759384.626097:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.630959:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.636914:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.641450:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.641614:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232769536:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759384.641630:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 4/0,1 mode: --/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.641656:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 4/0,1 mode: --/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.641951:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.641962:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759384.641990:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x2:0x0] 00010000:00010000:2.0:1782759384.642014:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.642021:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.642037:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.642052:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232769920:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1782759384.642080:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.642108:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.642305:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232769920:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759384.642314:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.642320:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759384.642329:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x2:0x0] 00000100:00100000:2.0:1782759384.642362:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770048:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.642388:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.642409:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.642767:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770048:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.642808:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770176:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.642830:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.642847:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.643001:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770176:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.643031:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770304:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.643050:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.643067:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.643228:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770304:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1782759384.643264:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.643273:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.643281:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.643299:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770432:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1782759384.643323:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.643341:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.643488:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232770432:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759384.643501:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b4cb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.643512:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4cb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.643531:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.643539:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.643547:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759384.643861:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10488 00000004:00080000:2.0:1782759384.643871:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3424920293337ns, next at 3425920291692ns, rc = 0 00000040:00080000:2.0:1782759384.643895:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].8, 376 off40896 00000040:00080000:2.0:1782759384.643937:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].8, 456 off41856 00000004:00080000:2.0:1782759384.643942:0:6532:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc4c4a000 with version 16 00000100:00100000:2.0:1782759384.644077:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232770688 00000100:00100000:2.0:1782759384.644083:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232770688 00000100:00100000:2.0:1782759384.644112:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:2.0:1782759384.644119:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7666:x1869355232770688:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759384.644331:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7666:x1869355232770688:12345-0@lo:1000:osp_up1-0.0 Request processed in 211us (282us total) trans 4294967629 rc 0/0 00000100:00100000:2.0:1782759384.644339:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00010000:00010000:2.0:1782759384.644394:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b4d9 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644405:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644413:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b4d9 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644420:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b4d9 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644427:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b4d9 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644433:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b4d9 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644455:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759384.644477:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644483:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644488:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644494:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.644505:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644512:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 4/0,0 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644523:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xb:0x0].0x0 (ffff8cddc34fd500) 00010000:00010000:2.0:1782759384.644525:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.644529:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 2/0,0 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644536:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4d2 lrc: 0/0,0 mode: --/EX res: [0x200000421:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644547:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4cb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644569:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60b4cb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644606:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60b4c4 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60b4cb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644633:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782759384.644655:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x2:0x0] 00010000:00010000:2.0:1782759384.644667:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644678:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644708:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc200/0xd5b45c7f5c60b4a8 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60b4af expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644730:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782759384.644738:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x2:0x0] 00010000:00010000:2.0:1782759384.644744:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.644752:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.644817:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:102680:x1869355218431360:12345-192.168.202.31@tcp:36:rm.0 Request processed in 5997us (6078us total) trans 4294967917 rc 0/0 00000100:00100000:2.0:1782759384.644835:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2554 00000100:00100000:2.0:1782759384.644887:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232770944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759384.644924:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.645005:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1782759384.645017:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+12:3662:x1869355232770944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759384.645028:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.645046:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b4af lrc: 0/0,0 mode: --/CW res: [0x240000405:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b4a8 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.645063:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759384.645067:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.645118:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3662:x1869355232770944:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.645132:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1782759384.646668:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.649841:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218432128 00000100:00100000:2.0:1782759384.649846:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218432128 00000100:00100000:2.0:1782759384.649881:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2556 00000100:00100000:2.0:1782759384.649890:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:102680:x1869355218432128:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1782759384.649932:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1782759384.649952:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b4f5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27020 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.649971:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b470 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2700b expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.649981:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759384.649988:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759384.650004:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650014:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650021:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650033:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b503 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x75afac74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650040:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650058:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650118:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650126:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650133:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.650317:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1782759384.650329:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650336:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650343:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650349:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.650353:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650360:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650369:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x0 (ffff8cddc34fdc00) 00010000:00010000:2.0:1782759384.650372:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759384.650382:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650388:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b50a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650404:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650410:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650416:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650421:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650427:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759384.650430:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650436:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650444:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:2.0:1782759384.650446:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759384.650449:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650455:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b4fc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759384.650463:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023c5c3a0 reply state 0000000098e744cb transno 4294967631 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b503 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650480:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b503 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.650486:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x75afac74 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759384.650488:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759384.650489:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759384.650533:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:102680:x1869355218432128:12345-192.168.202.31@tcp:36:rm.0 Request processed in 644us (766us total) trans 4294967631 rc 0/0 00000100:00100000:2.0:1782759384.650540:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2556 00000100:00100000:2.0:1782759384.657792:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.662764:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.663302:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232771200 00000100:00100000:2.0:1782759384.663308:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232771200 00000100:00100000:2.0:1782759384.663343:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1782759384.663352:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6532:x1869355232771200:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759384.663423:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6532:x1869355232771200:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (167us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759384.663430:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:2.0:1782759384.664811:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.665246:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6516:1869355232771584:0@lo:105: 00010000:00010000:2.0:1782759384.665261:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.665297:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded1882450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:2403:x1869355218432896:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 411us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.665310:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 683 00000100:00100000:2.0:1782759384.668417:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232772864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759384.668453:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759384.668782:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232772864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759384.674874:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759384.677043:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759384.677058:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232773120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759384.677103:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759384.679406:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b55e lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b557 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.679429:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34fe000) 00010000:00010000:2.0:1782759384.679435:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60b57a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.679451:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60b57a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.679471:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60b57a lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.679509:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.679566:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3665:x1869355232773120:12345-0@lo:103:ldlm_bl.0 Request processed in 2191us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.679600:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1782759384.679844:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232773248 00000100:00100000:2.0:1782759384.679850:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232773248 00000100:00100000:2.0:1782759384.679894:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1782759384.679903:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232773248:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759384.680034:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232773248:12345-0@lo:1000:mdt00_002.0 Request processed in 130us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.680042:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1782759384.682904:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218433152 00000100:00100000:2.0:1782759384.682910:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218433152 00000100:00100000:2.0:1782759384.682944:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2562 00000100:00100000:2.0:1782759384.682950:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:102682:x1869355218433152:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759384.682963:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.682975:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b588 lrc: 2/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27043 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.683014:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b58f lrc: 3/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.683022:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b58f lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.683030:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b58f lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.683062:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1782759384.683065:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759384.683086:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b588 lrc: 0/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27043 expref: 15 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.683100:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b58f lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27043 expref: 14 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.683108:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc3502800) 00010000:00010000:2.0:1782759384.683111:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1782759384.683114:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648200, rc 0) 00000100:00100000:2.0:1782759384.683156:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:102682:x1869355218433152:12345-192.168.202.31@tcp:101:touch.0 Request processed in 206us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.683176:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2562 00000100:00100000:2.0:1782759384.690960:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218433920 00000100:00100000:2.0:1782759384.690968:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218433920 00000100:00100000:2.0:1782759384.691021:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1024 00000100:00100000:2.0:1782759384.691030:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218433920:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:2.0:1782759384.691221:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218433920:12345-192.168.202.31@tcp:2:touch.0 Request processed in 192us (312us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782759384.691226:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1024 00010000:00010000:2.0:1782759384.700719:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759384.700729:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60b41c lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b423 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.700739:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759384.700744:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60b41c lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60b423 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759384.700754:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60b41c lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60b423 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.700780:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60b41c lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b423 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.700786:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759384.700817:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60b41c lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b423 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.700826:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60b41c lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b423 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.700852:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.700855:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759384.700857:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759384.701055:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232773760 00000100:00100000:2.0:1782759384.701058:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232773760 00010000:00010000:2.0:1782759384.701073:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60b423 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b41c expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759384.701100:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1782759384.701107:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232773760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759384.701117:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759384.702432:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60b423 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b41c expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.702443:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xb128bd74 (ffff8cddc3502c00) 00010000:00010000:2.0:1782759384.702447:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60b5d5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.702453:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60b5d5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.702457:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60b5d5 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.702476:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759384.702563:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232773760:12345-0@lo:103:ldlm_bl.0 Request processed in 1454us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.702595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00010000:00010000:1.0:1782759384.705114:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759384.705122:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b5ea lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.705128:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b5ea lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.705148:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b5dc lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2705f expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.705155:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:1.0:1782759384.705156:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759384.705159:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b5dc lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2705f expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.705164:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759384.705204:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102683:x1869355218434432:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 327us (447us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759384.705209:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2567 00000100:00100000:2.0:1782759384.706630:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218434560 00000100:00100000:2.0:1782759384.706648:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218434560 00000100:00100000:2.0:1782759384.706699:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2568 00000100:00100000:2.0:1782759384.706709:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102683:x1869355218434560:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759384.706722:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759384.706737:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b5f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27066 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.706779:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.706790:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.706798:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759384.706836:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759384.706840:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759384.706858:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.706877:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b5f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27066 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.706895:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27066 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759384.706903:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:2.0:1782759384.706906:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759384.706918:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649000, rc 0) 00000100:00100000:2.0:1782759384.707002:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:102683:x1869355218434560:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 294us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.707009:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2568 00000100:00100000:1.0:1782759384.711335:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218434816 00000100:00100000:1.0:1782759384.711348:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218434816 00000100:00100000:1.0:1782759384.711405:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2569 00000100:00100000:1.0:1782759384.711416:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:102683:x1869355218434816:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:1.0:1782759384.711540:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232773888:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759384.711627:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759384.711665:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec795de40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.713213:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232773888 00000100:00100000:2.0:1782759384.713219:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232773888 00000100:00100000:2.0:1782759384.713271:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:2.0:1782759384.713277:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12673:x1869355232773888:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782759384.713361:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12673:x1869355232773888:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.713366:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:1.0:1782759384.714423:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232774144 00000100:00100000:1.0:1782759384.714428:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232774144 00000100:00100000:1.0:1782759384.714463:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1782759384.714471:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12673:x1869355232774144:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759384.714492:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759384.714503:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b606 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b5ff expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.714521:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27066 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.714527:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b606 lrc: 4/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b5ff expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.714545:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27066 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.714557:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b5f8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27066 expref: 8 pid: 8593 timeout: 3524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759384.714568:0:6536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6536:1869355232774272:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759384.714699:0:6536:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d08480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759384.716340:0:6536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6536:1869355232774272:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759384.716369:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b606 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b5ff expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.716380:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:1.0:1782759384.716383:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759384.716387:0:6536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b606 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b5ff expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.716411:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759384.716469:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:12673:x1869355232774144:12345-0@lo:101:mdt00_004.0 Request processed in 1998us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759384.716476:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:1.0:1782759384.716704:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759384.717167:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759384.717179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232774400 00000100:00100000:1.0:1782759384.717183:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232774400 00000100:00100000:1.0:1782759384.717220:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1782759384.717227:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee7776050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9534:x1869355232774400:12345-0@lo:105: 00010000:00010000:1.0:1782759384.717237:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 5/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717248:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 5/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717259:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 5/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717267:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 5/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717274:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 6/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717282:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 6/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717310:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc3de4200) 00000100:00100000:1.0:1782759384.717352:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee7776050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:9534:x1869355232774400:12345-0@lo:105: Request processed in 123us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759384.717368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1782759384.717521:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232774528 00000100:00100000:1.0:1782759384.717526:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232774528 00000100:00100000:1.0:1782759384.717574:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1782759384.717608:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12673:x1869355232774528:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759384.717622:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759384.717651:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b614 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b60d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717669:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b614 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b60d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717679:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b614 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b60d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.717684:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xb128bd74 (ffff8cddc34fe000) 00010000:00010000:1.0:1782759384.717686:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759384.717687:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428600, rc 0) 00000100:00100000:1.0:1782759384.717712:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774528:12345-0@lo:101:mdt00_004.0 Request processed in 108us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759384.717716:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1782759384.717929:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232774656 00000100:00100000:1.0:1782759384.717934:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232774656 00000100:00100000:1.0:1782759384.717966:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:1.0:1782759384.717970:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774656:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759384.718034:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774656:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759384.718041:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:1.0:1782759384.718164:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232774784 00000100:00100000:1.0:1782759384.718168:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232774784 00000100:00100000:1.0:1782759384.718199:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1782759384.718205:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774784:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759384.718267:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774784:12345-0@lo:1000:mdt00_004.0 Request processed in 61us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759384.718274:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1782759384.718440:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232774912 00000100:00100000:1.0:1782759384.718445:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232774912 00000100:00100000:1.0:1782759384.718477:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:1.0:1782759384.718483:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774912:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759384.718553:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232774912:12345-0@lo:1000:mdt00_004.0 Request processed in 71us (150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759384.718559:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1782759384.718751:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232775040 00000100:00100000:2.0:1782759384.718756:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232775040 00000100:00100000:2.0:1782759384.718798:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:2.0:1782759384.718806:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232775040:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782759384.718859:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232775040:12345-0@lo:1000:mdt00_004.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.718867:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:2.0:1782759384.718984:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232775168 00000100:00100000:2.0:1782759384.718988:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232775168 00000100:00100000:2.0:1782759384.719018:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:2.0:1782759384.719024:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232775168:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782759384.719081:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232775168:12345-0@lo:1000:mdt00_004.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759384.719089:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000004:00080000:1.0:1782759384.719980:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 18 rpc_version 18 00000020:00100000:1.0:1782759384.720008:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759384.720015:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4f6c380 x1869355232775552/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2288/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759384.720028:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232775552:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759384.720056:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759384.720074:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb6696c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759384.720106:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232775552 00000100:00100000:2.0:1782759384.720116:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232775552 00000100:00100000:2.0:1782759384.720156:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:2.0:1782759384.720162:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7666:x1869355232775552:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759384.720399:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7666:x1869355232775552:12345-0@lo:1000:osp_up1-0.0 Request processed in 236us (341us total) trans 4294967633 rc 0/0 00000100:00100000:2.0:1782759384.720406:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:1.0:1782759384.720446:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232775552:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1782759384.720840:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759384.720849:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.720859:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759384.720865:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759384.720874:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.720898:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.720905:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759384.721047:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232775680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759384.721076:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759384.721342:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.721352:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4200/0xd5b45c7f5c60b5ff lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b606 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759384.721373:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759384.721376:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759384.721377:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759384.721860:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232775680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759384.731152:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759384.737869:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000020:00000080:1.0:1782759385.128263:0:137623:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce261b560 20000000:00000080:1.0:1782759385.128278:0:137623:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e55000 uarg=0000000000000000 00010000:00010000:1.0:1782759385.128446:0:137623:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1782759385.128481:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc3502a00) 00010000:00010000:1.0:1782759385.128485:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759385.128496:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ad23 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26e8a expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128517:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x7:0x0].0x0 (ffff8cdee7e02f00) 00010000:00010000:1.0:1782759385.128519:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759385.128521:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60adf5 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26ec9 expref: 20 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128531:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc3502800) 00010000:00010000:1.0:1782759385.128532:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1782759385.128535:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60b58f lrc: 0/0,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27043 expref: 19 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128542:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xd:0x0].0x0 (ffff8cdecda0a300) 00010000:00010000:1.0:1782759385.128544:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759385.128546:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60b5c0 lrc: 0/0,0 mode: --/CR res: [0x200000421:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27051 expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128553:0:137623:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1782759385.128570:0:137623:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1782759385.128615:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:1.0:1782759385.128618:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759385.128622:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b581 lrc: 0/0,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2703c expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128655:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:1.0:1782759385.128663:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782759385.128668:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ae3b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26ee5 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128683:0:137623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdee7e02800) 00010000:00010000:1.0:1782759385.128685:0:137623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1782759385.128688:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ad31 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26e91 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128700:0:137623:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 3 locks, left on hash table 0. 10000000:01000000:1.0:1782759385.128718:0:137623:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759385.128731:0:137623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128744:0:137623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128753:0:137623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128785:0:137623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.128794:0:137623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 23 pid: 6526 timeout: 3575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759385.128805:0:137623:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137623:1869355232775808:0@lo:104: 00000100:00100000:1.0:1782759385.128852:0:137623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759385.128888:0:137623:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759385.129097:0:137623:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137623:1869355232775808:0@lo:104: 00010000:00010000:1.0:1782759385.129119:0:137623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759385.129238:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232775936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759385.129284:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759385.129319:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232775936 00000100:00100000:2.0:1782759385.129325:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232775936 00010000:00010000:2.0:1782759385.129347:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 24 pid: 6526 timeout: 3575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759385.129376:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1782759385.129383:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232775936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759385.129394:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759385.129399:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 24 pid: 6526 timeout: 3575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129409:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 24 pid: 6526 timeout: 3575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129419:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b2b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b2a9 expref: 24 pid: 6526 timeout: 3575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129430:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129448:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129468:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129476:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129483:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129489:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129495:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759385.129499:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129505:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129525:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759385.129543:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759385.129554:0:137623:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.129565:0:137623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759385.129572:0:137623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60b66f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759385.129615:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232775936:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759385.129623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00010000:00010000:2.0:1782759385.418796:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759385.994828:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759385.994852:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232776064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759385.994928:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759385.995691:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232776064:0@lo:41:osp-pre-0-1.0 10000000:01000000:1.0:1782759386.251332:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759386.251341:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759386.251345:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759386.251395:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.251408:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.251419:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759386.251446:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232776192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759386.251516:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.251603:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.252344:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232776192 00000100:00100000:2.0:1782759386.252354:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232776192 00000100:00100000:2.0:1782759386.252414:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:2.0:1782759386.252424:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232776192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759386.252437:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.252450:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b676 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.252470:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.252477:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.252484:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759386.252525:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232776192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.252531:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1782759386.252571:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232776192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759386.252618:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b67d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.252642:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b67d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759386.252661:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759386.252667:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b67d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.252675:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60b676 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b67d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759386.393714:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00080000:1.0:1782759386.393936:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759386.396553:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218435840 00000100:00100000:1.0:1782759386.396562:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218435840 00000100:00100000:1.0:1782759386.396617:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2575 00000100:00100000:1.0:1782759386.396639:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102757:x1869355218435840:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759386.396655:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.396670:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b699 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27089 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396712:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396722:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396728:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396742:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396747:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396752:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396785:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396792:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396799:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396805:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396812:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.396816:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396821:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396830:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe100) 00010000:00010000:1.0:1782759386.396832:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.396834:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396844:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b6a0 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396853:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396857:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396861:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396863:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.396865:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396869:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396873:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34feb00) 00010000:00010000:1.0:1782759386.396875:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.396876:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396880:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b6a7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396901:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b699 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27089 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396915:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe100) 00010000:00010000:1.0:1782759386.396917:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.396919:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b699 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27089 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.396928:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759386.396983:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102757:x1869355218435840:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 345us (484us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759386.396991:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2575 00000100:00100000:2.0:1782759386.402912:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759386.402953:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218435968 00000100:00100000:2.0:1782759386.402963:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218435968 00000100:00100000:2.0:1782759386.403091:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2576 00000100:00100000:2.0:1782759386.403102:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102757:x1869355218435968:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759386.403128:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.403150:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b6ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27090 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.403214:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60b6b5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.403228:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60b6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.403239:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60b6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759386.403281:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759386.403285:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759386.403305:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60b6b5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.403329:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60b6ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27090 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.403349:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60b6b5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27090 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.403358:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fd200) 00010000:00010000:2.0:1782759386.403362:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759386.403365:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759386.403434:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102757:x1869355218435968:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 334us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.403442:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2576 00000100:00100000:2.0:1782759386.419210:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759386.420838:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759386.433826:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759386.433872:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218436864 00000100:00100000:1.0:1782759386.433883:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218436864 00000100:00100000:1.0:1782759386.433940:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2581 00000100:00100000:1.0:1782759386.433951:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102758:x1869355218436864:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759386.434006:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759386.434032:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60b6ed lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270a5 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.434050:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2d00) 00010000:00010000:1.0:1782759386.434065:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.434129:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102758:x1869355218436864:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 179us (311us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759386.434137:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2581 00000100:00100000:2.0:1782759386.441901:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759386.442310:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232776320 00000100:00100000:2.0:1782759386.442316:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232776320 00000100:00080000:1.0:1782759386.442351:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759386.442367:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:2.0:1782759386.442375:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6533:x1869355232776320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759386.442452:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6533:x1869355232776320:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.442460:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:2.0:1782759386.443104:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1782759386.443114:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6533:x1869355232776448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759386.443243:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6533:x1869355232776448:12345-0@lo:1000:mdt00_002.0 Request processed in 131us (328us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759386.443250:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:2.0:1782759386.443461:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232776576 00000100:00100000:2.0:1782759386.443472:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232776576 00000100:00100000:2.0:1782759386.443498:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:2.0:1782759386.443504:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6533:x1869355232776576:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1782759386.443513:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.443526:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b6fb lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b6f4 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.443547:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b6fb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b6f4 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.443570:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b6fb lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b6f4 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.443700:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759386.446951:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759386.446955:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.446959:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759386.447047:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6533:x1869355232776576:12345-0@lo:101:mdt00_002.0 Request processed in 3539us (3657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.447058:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:1.0:1782759386.447092:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232776576:0@lo:101:mdt00_002.0 00010000:00010000:1.0:1782759386.447132:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b6f4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b6fb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.447147:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b6f4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b6fb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759386.447184:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759386.447231:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429c00/0xd5b45c7f5c60b702 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.447239:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429c00/0xd5b45c7f5c60b702 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.447248:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429c00/0xd5b45c7f5c60b702 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759386.447266:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232776704:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1782759386.447304:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.447340:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.447355:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232776704 00000100:00100000:2.0:1782759386.447362:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232776704 00000100:00100000:2.0:1782759386.447420:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759386.447429:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6533:x1869355232776704:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1782759386.447443:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.447457:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b709 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b702 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.447478:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b709 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b702 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.447489:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b709 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b702 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.447498:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fd900) 00010000:00010000:2.0:1782759386.447500:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.447503:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759386.447549:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232776704:12345-0@lo:101:mdt00_002.0 Request processed in 121us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.447556:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759386.448026:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232776832 00000100:00100000:2.0:1782759386.448030:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232776832 00000100:00100000:2.0:1782759386.448094:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:2.0:1782759386.448101:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232776832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759386.448164:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232776832:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.448170:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:1.0:1782759386.448200:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232776832:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.448243:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232776960:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.448268:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.448349:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759386.448808:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232776960:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.448870:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777088:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.448900:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.448925:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.448996:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232777088 00000100:00100000:2.0:1782759386.449002:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232777088 00000100:00100000:2.0:1782759386.449038:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:2.0:1782759386.449045:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232777088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759386.449101:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232777088:12345-0@lo:1000:mdt00_002.0 Request processed in 56us (200us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759386.449109:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:1.0:1782759386.449130:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777088:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.449169:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777216:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.449186:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.449199:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759386.449361:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777216:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.449400:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.449422:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.449439:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759386.449601:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.449651:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777472:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759386.449677:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.449759:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.449838:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232777472 00000100:00100000:2.0:1782759386.449843:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232777472 00000100:00100000:2.0:1782759386.449872:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:2.0:1782759386.449879:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232777472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759386.449968:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:6533:x1869355232777472:12345-0@lo:1000:mdt00_002.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.449975:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00100000:1.0:1782759386.450023:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232777472:0@lo:1000:mdt00_002.0 00000040:00080000:1.0:1782759386.450453:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].11, 1000 off44136 00000040:00080000:1.0:1782759386.450515:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].11, 1152 off45536 00000004:00080000:1.0:1782759386.450522:0:6533:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc3d1e6c0 with version 19 00000004:00080000:2.0:1782759386.450563:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 19 rpc_version 19 00000020:00100000:2.0:1782759386.450679:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759386.450688:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc479f100 x1869355232777728/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759386.450708:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232777728:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759386.450753:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759386.450777:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ba03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.451213:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232777728:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1782759386.451283:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b710 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451301:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b710 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451313:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b710 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759386.451327:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b14d4f12 reply state 000000006e0a8ed7 transno 4294967924 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b710 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451345:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b710 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451350:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xf:0x0].0x0 (ffff8cddc34feb00) 00010000:00010000:1.0:1782759386.451352:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759386.451355:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759386.451360:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xf:0x0]: returning size 4096 00000004:00080000:1.0:1782759386.451366:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759386.451376:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b6f4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b6fb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451382:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b6f4 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60b6fb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451386:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b6f4 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60b6fb expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451410:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782759386.451416:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759386.451421:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429c00/0xd5b45c7f5c60b702 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b709 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.451429:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429c00/0xd5b45c7f5c60b702 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b709 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759386.451499:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:102759:x1869355218437120:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 9432us (9609us total) trans 4294967924 rc 0/0 00000100:00100000:1.0:1782759386.451506:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2582 00000100:00100000:2.0:1782759386.451723:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232777856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759386.451764:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759386.452015:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232777856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759386.460975:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218437248 00000100:00100000:2.0:1782759386.460984:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218437248 00000100:00100000:2.0:1782759386.461041:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2583 00000100:00100000:2.0:1782759386.461051:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102760:x1869355218437248:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759386.461080:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.461107:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b717 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270ac expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461164:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461192:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461204:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461215:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461244:0:42628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b709 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b702 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461252:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.461283:0:42628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60b709 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60b702 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759386.461298:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:42628:1869355232777984:0@lo:104: 00000100:00100000:2.0:1782759386.461340:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759386.461387:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc68bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759386.461405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232777984 00000100:00100000:1.0:1782759386.461411:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232777984 00000100:00100000:1.0:1782759386.461449:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 575 00000100:00100000:1.0:1782759386.461458:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:42628:x1869355232777984:12345-0@lo:104: 00010000:00010000:1.0:1782759386.461475:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429c00/0xd5b45c7f5c60b702 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b709 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.461541:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759386.461548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:42628:x1869355232777984:12345-0@lo:104: Request processed in 92us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.461554:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:42628:1869355232777984:0@lo:104: 00000100:00100000:1.0:1782759386.461559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 575 00010000:00010000:2.0:1782759386.461610:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759386.461744:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232778112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759386.461796:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1782759386.464680:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967635 is committed 00000001:00080000:2.0:1782759386.464710:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967634 is committed 00000100:00100000:1.0:1782759386.465134:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232778112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759386.465201:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465210:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759386.465312:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:42628:1869355232778240:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782759386.465361:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759386.465393:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc47346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.465561:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:42628:1869355232778240:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1782759386.465651:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b72c lrc: 3/1,0 mode: --/PR res: [0x200000421:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465662:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b72c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465670:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b72c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759386.465692:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b72c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465704:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465710:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465715:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465720:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465725:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759386.465728:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465733:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465747:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fda00) 00010000:00010000:2.0:1782759386.465750:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.465753:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465759:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b71e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465768:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465774:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465779:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465783:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759386.465786:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465791:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465797:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fd900) 00010000:00010000:2.0:1782759386.465799:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.465801:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465806:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b725 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465844:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b717 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270ac expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465859:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b72c lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270ac expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.465871:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xf:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:2.0:1782759386.465874:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759386.465876:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649000, rc 0) 00000100:00100000:2.0:1782759386.465923:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:102760:x1869355218437248:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 4874us (5116us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.465932:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2583 00000100:00100000:2.0:1782759386.467230:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759386.471158:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759386.471246:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218437632 00000100:00100000:2.0:1782759386.471255:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218437632 00000100:00100000:2.0:1782759386.471333:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2585 00000100:00100000:2.0:1782759386.471342:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:102760:x1869355218437632:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:2.0:1782759386.471450:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:102760:x1869355218437632:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 108us (299us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759386.471457:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2585 00000100:00100000:2.0:1782759386.479045:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218437760 00000100:00100000:2.0:1782759386.479055:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218437760 00000100:00100000:2.0:1782759386.479125:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 348 00000100:00100000:2.0:1782759386.479138:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218437760:12345-192.168.202.31@tcp:103:rmdir.0 00010000:00010000:2.0:1782759386.479154:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759386.479194:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60b72c lrc: 0/0,0 mode: --/PR res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270ac expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.479214:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xf:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:2.0:1782759386.479230:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759386.479294:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218437760:12345-192.168.202.31@tcp:103:rmdir.0 Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.479307:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 348 00000100:00100000:1.0:1782759386.479658:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232778368 00000100:00100000:1.0:1782759386.479663:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232778368 00000100:00100000:1.0:1782759386.479711:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:1.0:1782759386.479720:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232778368:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1782759386.479737:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.479751:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b748 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b741 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.479772:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b748 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b741 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.479784:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b748 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b741 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.479792:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759386.479800:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.479803:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759386.479843:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:8593:x1869355232778368:12345-0@lo:101:mdt00_003.0 Request processed in 125us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.479850:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:2.0:1782759386.480068:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232778496 00000100:00100000:2.0:1782759386.480073:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232778496 00000100:00100000:2.0:1782759386.480108:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1782759386.480117:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8593:x1869355232778496:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759386.480126:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.480137:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b756 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b74f expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.480150:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b756 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b74f expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.480158:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60b756 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b74f expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.480165:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc3500c00) 00010000:00010000:2.0:1782759386.480168:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.480170:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759386.480206:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232778496:12345-0@lo:101:mdt00_003.0 Request processed in 91us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.480213:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:1.0:1782759386.480365:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232778624 00000100:00100000:1.0:1782759386.480370:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232778624 00000100:00100000:1.0:1782759386.480398:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:1.0:1782759386.480405:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232778624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759386.480462:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232778624:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.480469:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:2.0:1782759386.480566:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232778752 00000100:00100000:2.0:1782759386.480572:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232778752 00000100:00100000:2.0:1782759386.480633:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:2.0:1782759386.480639:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232778752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759386.480714:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232778752:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (178us total) trans 0 rc 1/1 00000100:00100000:2.0:1782759386.480721:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:1.0:1782759386.480908:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232778880 00000100:00100000:1.0:1782759386.480914:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232778880 00000100:00100000:1.0:1782759386.480944:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1782759386.480952:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232778880:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1782759386.480961:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.480972:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b764 lrc: 2/0,0 mode: --/EX res: [0x200000421:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b75d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.480989:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b764 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b75d expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.481008:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60b764 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b75d expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.481016:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xf:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:1.0:1782759386.481019:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759386.481026:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759386.481056:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:8593:x1869355232778880:12345-0@lo:101:mdt00_003.0 Request processed in 105us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.481061:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000004:00080000:2.0:1782759386.481473:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 20 rpc_version 20 00000020:00100000:2.0:1782759386.481488:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759386.481495:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc479f100 x1869355232779136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759386.481509:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232779136:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759386.481539:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759386.481632:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ba03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.482051:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232779136:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1782759386.482267:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759386.482277:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b75d lrc: 2/0,0 mode: EX/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b764 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482287:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759386.482292:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b75d lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b764 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759386.482305:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b75d lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b764 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482340:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b75d lrc: 2/0,0 mode: --/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b764 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482348:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759386.482376:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b75d lrc: 1/0,0 mode: --/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b764 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482393:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dc400/0xd5b45c7f5c60b75d lrc: 0/0,0 mode: --/EX res: [0x200000421:0xf:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b764 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482419:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759386.482424:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b741 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b748 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482432:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759386.482444:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b741 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b748 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759386.482449:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b741 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b748 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482466:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b741 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b748 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482474:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759386.482497:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b741 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b748 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482510:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dce00/0xd5b45c7f5c60b741 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b748 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482531:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759386.482533:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759386.482536:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759386.482787:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1782759386.482802:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+12:3664:x1869355232779392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759386.482814:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759386.482831:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b748 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b741 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.482851:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759386.482869:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.482911:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+9:3664:x1869355232779392:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.482928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:2.0:1782759386.483830:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759386.491662:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218438272 00000100:00100000:1.0:1782759386.491672:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218438272 00000100:00100000:1.0:1782759386.491718:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2587 00000100:00100000:1.0:1782759386.491726:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+21:102762:x1869355218438272:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759386.491757:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.491778:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b772 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270ba expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759386.491867:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1782759386.491971:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b772 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270ba expref: 23 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.491982:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759386.491984:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759386.491988:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b772 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270ba expref: 23 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.492000:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759386.492100:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+22:102762:x1869355218438272:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 373us (542us total) trans 4294967926 rc 301/301 00000100:00100000:1.0:1782759386.492107:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2587 00000100:00100000:2.0:1782759386.501144:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759386.501195:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759386.501254:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218438912 00000100:00100000:1.0:1782759386.501263:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218438912 00000100:00100000:1.0:1782759386.501322:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:1.0:1782759386.501333:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:102762:x1869355218438912:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759386.501390:0:6546:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759386.501395:0:6546:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60b581) 00010000:00010000:1.0:1782759386.501397:0:6546:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.501454:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:102762:x1869355218438912:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 123us (318us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759386.501461:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3 00000100:00100000:2.0:1782759386.505280:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759386.505426:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218439168 00000100:00100000:1.0:1782759386.505436:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218439168 00000100:00100000:1.0:1782759386.505487:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2588 00000100:00100000:1.0:1782759386.505496:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:102762:x1869355218439168:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759386.505513:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.505534:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b780 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270c1 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505640:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505653:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505663:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505674:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505680:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505686:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505763:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60b795 lrc: 3/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505772:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60b795 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505778:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60b795 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505791:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505798:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505804:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505810:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505816:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.505821:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505828:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505839:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759386.505842:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.505846:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505858:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b787 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505872:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505878:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505883:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505888:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.505891:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505897:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505903:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34fef00) 00010000:00010000:1.0:1782759386.505905:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.505906:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505910:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b78e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505932:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b780 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270c1 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505940:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60b795 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270c1 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.505950:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:1.0:1782759386.505952:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759386.505953:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759386.505999:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:102762:x1869355218439168:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 504us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.506011:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2588 00000100:00100000:2.0:1782759386.509002:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218439424 00000100:00100000:2.0:1782759386.509011:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218439424 00000100:00100000:2.0:1782759386.509069:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2589 00000100:00100000:2.0:1782759386.509080:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+23:102762:x1869355218439424:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759386.509100:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.509117:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b79c lrc: 2/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270c8 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759386.509345:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1782759386.509427:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b79c lrc: 1/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270c8 expref: 25 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.509440:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc3502800) 00010000:00010000:2.0:1782759386.509443:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759386.509448:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b79c lrc: 0/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270c8 expref: 25 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.509462:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759386.509519:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+24:102762:x1869355218439424:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 441us (578us total) trans 4294967928 rc 301/301 00000100:00100000:2.0:1782759386.509526:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2589 00000100:00100000:1.0:1782759386.519358:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1782759386.520039:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759386.520045:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b60d lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b614 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.520053:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759386.520058:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b60d lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60b614 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759386.520067:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b60d lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60b614 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.520090:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b60d lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b614 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.520097:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759386.520122:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b60d lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b614 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.520129:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b60d lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b614 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.520154:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759386.520163:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759386.520165:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759386.520387:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232779648 00000100:00100000:1.0:1782759386.520391:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232779648 00010000:00010000:1.0:1782759386.520407:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b614 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b60d expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759386.520432:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1782759386.520438:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3664:x1869355232779648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759386.520446:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1782759386.524043:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967636 is committed 00010000:00010000:1.0:1782759386.524129:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b614 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b60d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.524143:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xb128bd74 (ffff8cddc34fe000) 00010000:00010000:1.0:1782759386.524147:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b7b8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.524313:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b7b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.524323:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b7b8 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xb128bd74 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.524354:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.524429:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232779648:12345-0@lo:103:ldlm_bl.0 Request processed in 3989us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.524439:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:1.0:1782759386.524818:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232779776 00000100:00100000:1.0:1782759386.524875:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232779776 00000100:00100000:1.0:1782759386.524925:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1782759386.524933:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6532:x1869355232779776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782759386.525001:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6532:x1869355232779776:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.525008:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:1.0:1782759386.528805:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218439936 00000100:00100000:1.0:1782759386.528814:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218439936 00000100:00100000:1.0:1782759386.528913:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2591 00000100:00100000:1.0:1782759386.528923:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+25:102763:x1869355218439936:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759386.528944:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.528962:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7c6 lrc: 2/0,0 mode: --/CR res: [0x200000421:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270d6 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.529009:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b7cd lrc: 3/1,0 mode: --/PR res: [0x200000421:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.529022:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b7cd lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.529032:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b7cd lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xe:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759386.529068:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xe:0x0]: returning size 4096 00000004:00200000:1.0:1782759386.529072:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759386.529102:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7c6 lrc: 0/0,0 mode: --/CR res: [0x200000421:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270d6 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.529118:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b7cd lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xe:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270d6 expref: 26 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.529138:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xe:0x0].0x0 (ffff8cdecda0a000) 00010000:00010000:1.0:1782759386.529141:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1782759386.529144:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428a00, rc 0) 00000100:00100000:1.0:1782759386.529194:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+26:102763:x1869355218439936:12345-192.168.202.31@tcp:101:touch.0 Request processed in 273us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.529202:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2591 00000100:00100000:1.0:1782759386.536958:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218440448 00000100:00100000:1.0:1782759386.536969:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218440448 00000100:00100000:1.0:1782759386.537025:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2593 00000100:00100000:1.0:1782759386.537035:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+29:102763:x1869355218440448:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:1.0:1782759386.537085:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759386.537109:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60b7e9 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270dd expref: 29 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.537124:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x10:0x0].0x0 (ffff8cddc24d2c00) 00010000:00010000:1.0:1782759386.537134:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759386.537188:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7f7 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.537201:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.537210:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759386.537312:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5afca1c reply state 0000000046fd12bf transno 4294967931 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7f7 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.537341:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b7f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.537348:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x10:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759386.537350:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759386.537353:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759386.537431:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+30:102763:x1869355218440448:12345-192.168.202.31@tcp:36:touch.0 Request processed in 398us (525us total) trans 4294967931 rc 0/0 00000100:00100000:1.0:1782759386.537438:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2593 00000100:00100000:2.0:1782759386.538973:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218440576 00000100:00100000:2.0:1782759386.538979:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218440576 00000100:00100000:2.0:1782759386.539061:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2594 00000100:00100000:2.0:1782759386.539069:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+30:102763:x1869355218440576:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759386.539084:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.539094:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b7fe lrc: 2/0,0 mode: --/CR res: [0x200000421:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270e4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.539125:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b7fe lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270e4 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.539133:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60b7fe lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270e4 expref: 31 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.539155:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x10:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:2.0:1782759386.539158:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759386.539161:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759386.539207:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+31:102763:x1869355218440576:12345-192.168.202.31@tcp:101:touch.0 Request processed in 137us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.539214:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2594 00000100:00100000:1.0:1782759386.542666:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218440704 00000100:00100000:1.0:1782759386.542676:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218440704 00000100:00100000:1.0:1782759386.542920:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1025 00000100:00100000:1.0:1782759386.542932:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218440704:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:1.0:1782759386.543132:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218440704:12345-192.168.202.31@tcp:2:touch.0 Request processed in 202us (778us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1782759386.543140:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1025 00000100:00100000:1.0:1782759386.560179:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218441216 00000100:00100000:1.0:1782759386.560186:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218441216 00000100:00100000:1.0:1782759386.560238:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2596 00000100:00100000:1.0:1782759386.560248:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:102764:x1869355218441216:12345-192.168.202.31@tcp:101:mv.0 00010000:00010000:1.0:1782759386.560263:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.560282:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b821 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270f2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560349:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560370:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560380:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560392:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560398:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560404:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560464:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b836 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560470:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b836 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560477:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b836 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759386.560508:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1782759386.560511:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759386.560531:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b836 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560541:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560569:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560574:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560611:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560625:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.560630:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560638:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560648:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:1.0:1782759386.560651:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.560654:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560660:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60b828 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560672:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560678:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560683:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560694:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.560697:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560702:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560721:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x75afac74 (ffff8cddc34fe100) 00010000:00010000:1.0:1782759386.560723:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.560726:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560732:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60b82f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x75afac74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560767:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b821 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270f2 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560783:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b836 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270f2 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.560789:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x8:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:1.0:1782759386.560791:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759386.560793:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759386.560844:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102764:x1869355218441216:12345-192.168.202.31@tcp:101:mv.0 Request processed in 598us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.560851:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2596 00000100:00100000:1.0:1782759386.568736:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218441344 00000100:00100000:1.0:1782759386.568759:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218441344 00000100:00100000:1.0:1782759386.568817:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2597 00000100:00100000:1.0:1782759386.568829:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102764:x1869355218441344:12345-192.168.202.31@tcp:101:mv.0 00010000:00010000:1.0:1782759386.568851:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.568871:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b83d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb270f9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.568942:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.568957:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.568979:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.568992:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.568999:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569005:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569048:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569056:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569062:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569073:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569077:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.569080:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569085:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569093:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x8:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:1.0:1782759386.569095:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.569097:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569102:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60b844 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569110:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569113:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569116:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569120:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759386.569122:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569130:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569135:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x8:0x0].0x121d9c5e (ffff8cddc34fee00) 00010000:00010000:1.0:1782759386.569136:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.569138:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569141:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60b84b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569162:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b83d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270f9 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569168:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x8:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:1.0:1782759386.569169:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.569171:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60b83d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270f9 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.569176:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429200, rc 0) 00000100:00100000:1.0:1782759386.569222:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102764:x1869355218441344:12345-192.168.202.31@tcp:101:mv.0 Request processed in 396us (546us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759386.569229:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2597 00000100:00100000:1.0:1782759386.572202:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218441728 00000100:00100000:1.0:1782759386.572216:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218441728 00000100:00100000:1.0:1782759386.572291:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4 00000100:00100000:1.0:1782759386.572301:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:102764:x1869355218441728:12345-192.168.202.31@tcp:36:mv.0 00010000:00010000:1.0:1782759386.572358:0:6544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759386.572376:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60b836 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270f2 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.572391:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x8:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:1.0:1782759386.572399:0:6544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.572462:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232779904:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759386.572502:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.572546:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.572605:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232779904 00000100:00100000:2.0:1782759386.572611:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232779904 00000100:00100000:2.0:1782759386.572673:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:2.0:1782759386.572681:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232779904:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759386.572769:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232779904:12345-0@lo:1000:mdt_io00_000.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.572775:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:1.0:1782759386.572885:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232779904:0@lo:1000:mdt_io00_000.0 00000004:00080000:1.0:1782759386.572969:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0xe:0x0] 00000100:00100000:1.0:1782759386.573011:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232780032:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759386.573034:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.573059:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.573303:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780032 00000100:00100000:2.0:1782759386.573308:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780032 00000100:00100000:2.0:1782759386.573344:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:2.0:1782759386.573351:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232780032:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759386.573406:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232780032:12345-0@lo:1000:mdt_io00_000.0 Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.573412:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:1.0:1782759386.573865:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780160 00000100:00100000:1.0:1782759386.573869:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780160 00000100:00100000:1.0:1782759386.573898:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1782759386.573905:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232780160:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759386.573957:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232780160:12345-0@lo:1000:mdt_io00_000.0 Request processed in 54us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.573962:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:1.0:1782759386.574367:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780288 00000100:00100000:1.0:1782759386.574370:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780288 00000100:00100000:1.0:1782759386.574396:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:1.0:1782759386.574400:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232780288:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759386.574407:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759386.574425:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b859 lrc: 2/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b852 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.574440:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60b61b lrc: 2/0,1 mode: TXN/TXN res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.574447:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b859 lrc: 4/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b852 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.574457:0:6537:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60b61b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1782759386.574479:0:6537:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1782759386.574510:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b859 lrc: 3/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b852 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.574516:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xe:0x0].0x0 (ffff8cdecda0a000) 00010000:00010000:1.0:1782759386.574518:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759386.574520:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60b859 lrc: 3/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b852 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.574525:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428600, rc 0) 00000100:00100000:1.0:1782759386.574548:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6544:x1869355232780288:12345-0@lo:101:mdt_io00_000.0 Request processed in 148us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.574552:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00010000:00010000:2.0:1782759386.576288:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd200/0xd5b45c7f5c60b74f lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b756 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759386.576305:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd200/0xd5b45c7f5c60b74f lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b756 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.576350:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd200/0xd5b45c7f5c60b74f lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b756 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.576357:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759386.576389:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd200/0xd5b45c7f5c60b74f lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b756 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759386.576405:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232780416:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1782759386.576413:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759386.576422:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.576442:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.576449:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759386.576456:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759386.576472:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60b4b6 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b4bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759386.576488:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967932 is committed 00000100:00100000:1.0:1782759386.576519:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780416 00000020:00080000:2.0:1782759386.576524:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc3d1e3c0 refcount 2 committed 0 result 0 batchid 11 00000100:00100000:1.0:1782759386.576526:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780416 00000020:00080000:2.0:1782759386.576528:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f07000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc3d1e6c0 00000020:00080000:2.0:1782759386.576531:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].11 00000020:00080000:2.0:1782759386.576534:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f07c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc2043400 00000020:00080000:2.0:1782759386.576537:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].11 00000020:00080000:2.0:1782759386.576547:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc4734240 refcount 2 committed 0 result 0 batchid 10 00000020:00080000:2.0:1782759386.576555:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc47343c0 00000020:00080000:2.0:1782759386.576557:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].10 00000020:00080000:2.0:1782759386.576559:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc3ce9600 00000020:00080000:2.0:1782759386.576561:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].10 00000001:00080000:2.0:1782759386.576571:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967919 is committed 00000100:00100000:1.0:1782759386.576575:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780544 00000020:00080000:2.0:1782759386.576595:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc45c3cc0 refcount 2 committed 0 result 0 batchid 9 00000020:00080000:2.0:1782759386.576597:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63c00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3900 00000020:00080000:2.0:1782759386.576599:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].9 00000020:00080000:2.0:1782759386.576601:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc3372600 00000020:00080000:2.0:1782759386.576603:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].9 00000004:00080000:2.0:1782759386.576613:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000020:00080000:2.0:1782759386.576634:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc4c4a480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1782759386.576641:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc22f8200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4c4a000 00000020:00080000:2.0:1782759386.576646:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].8 00000020:00080000:2.0:1782759386.576648:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc22f8100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4874600 00000020:00080000:2.0:1782759386.576651:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].8 00000020:00080000:2.0:1782759386.576657:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc45c3d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1782759386.576662:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63100 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3540 00000020:00080000:2.0:1782759386.576665:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].7 00000020:00080000:2.0:1782759386.576667:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4f24600 00000020:00080000:2.0:1782759386.576670:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].7 00000020:00080000:2.0:1782759386.576682:0:6509:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000100:00100000:1.0:1782759386.576760:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780544 00000100:00100000:2.0:1782759386.576778:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759386.576789:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232780672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782759386.576797:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1782759386.576806:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232780544:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1782759386.576817:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759386.576826:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759386.576831:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60b4bd lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b4b6 expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.576847:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2:0x0].0x121d9c5e (ffff8cddc34fea00) 00010000:00010000:1.0:1782759386.576858:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.576914:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232780544:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.576923:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1782759386.576948:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780672 00000100:00100000:1.0:1782759386.576953:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780672 00000100:00100000:1.0:1782759386.576990:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1782759386.577001:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232780672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782759386.577028:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:31 count 1 00002000:00010000:1.0:1782759386.577056:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x6a42bfd9, atime: 0x6a42bfd9, ctime: 0x6a42bfd9, blocks: 0x0 00010000:00010000:1.0:1782759386.577063:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b716780/0xd5b45c7f5c60b860 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577083:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=3426s v=(0 0) 00010000:00010000:1.0:1782759386.577089:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759386.577100:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b716780/0xd5b45c7f5c60b860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577124:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b716780/0xd5b45c7f5c60b860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577141:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b716780/0xd5b45c7f5c60b860 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577160:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b716780/0xd5b45c7f5c60b860 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577196:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782759386.577317:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355232780672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 318us (489us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1782759386.577328:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000004:00080000:1.0:1782759386.577360:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc36fdf80/2, rc 0, transno 4294967409 00000100:00100000:1.0:1782759386.577369:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232780672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782759386.577509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232781056 00000100:00100000:1.0:1782759386.577514:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232781056 00000100:00100000:1.0:1782759386.577550:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:1.0:1782759386.577558:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3648:x1869355232781056:12345-0@lo:105: 00010000:00010000:1.0:1782759386.577568:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 5/0,1 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577595:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 5/0,1 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577605:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 5/0,1 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577634:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 5/0,1 mode: CW/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577642:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 6/0,1 mode: CW/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.577651:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 6/0,1 mode: CW/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759386.577670:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232780544:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1782759386.577679:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc3de5400) 00000100:00100000:2.0:1782759386.577692:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232780928 00000100:00100000:2.0:1782759386.577696:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232780928 00000100:00100000:1.0:1782759386.577726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3648:x1869355232781056:12345-0@lo:105: Request processed in 167us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.577739:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:1.0:1782759386.577742:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:2.0:1782759386.577756:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7666:x1869355232780928:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759386.577874:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7666:x1869355232780928:12345-0@lo:1000:osp_up1-0.0 Request processed in 120us (834us total) trans 4294967637 rc 0/0 00000100:00100000:2.0:1782759386.577893:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00100000:1.0:1782759386.577958:0:7666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967636 gen 2 00000004:00080000:1.0:1782759386.577965:0:7666:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967636 committed transno 4294967636 00000020:00080000:1.0:1782759386.577971:0:7666:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc2700840 refcount 2 committed 0 result 0 batchid 12 00000020:00080000:1.0:1782759386.577975:0:7666:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc2700c00 00000020:00080000:1.0:1782759386.577979:0:7666:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].12 00000020:00080000:1.0:1782759386.577982:0:7666:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc2374a00 00000100:00100000:2.0:1782759386.577985:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232781184 00000020:00080000:1.0:1782759386.577985:0:7666:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].12 00000100:00100000:2.0:1782759386.577991:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232781184 00000100:00100000:1.0:1782759386.578011:0:7666:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8cddc4482300 x1869355232780928/t4294967637(4294967637) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1782759402 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782759386.578033:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:1.0:1782759386.578033:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232780928:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759386.578047:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6544:x1869355232781184:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1782759386.578057:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.578068:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b86e lrc: 2/0,0 mode: --/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b867 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.578084:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b86e lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b867 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.578096:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b86e lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b867 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.578104:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xe:0x0].0x121d9c5e (ffff8cddc34ff600) 00010000:00010000:2.0:1782759386.578106:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.578109:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648a00, rc 0) 00000100:00100000:2.0:1782759386.578143:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232781184:12345-0@lo:101:mdt_io00_000.0 Request processed in 99us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.578162:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000020:00080000:1.0:1782759386.578226:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 22 committed batchid 21 00000020:00080000:1.0:1782759386.578267:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 21 00000100:00100000:2.0:1782759386.578672:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232781440 00000100:00100000:2.0:1782759386.578677:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232781440 00000100:00100000:2.0:1782759386.578699:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:2.0:1782759386.578704:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232781440:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759386.578762:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232781440:12345-0@lo:1000:mdt_io00_000.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.578769:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:2.0:1782759386.579172:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232781696 00000100:00100000:2.0:1782759386.579178:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232781696 00000100:00100000:2.0:1782759386.579210:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1782759386.579219:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232781696:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759386.579269:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232781696:12345-0@lo:1000:mdt_io00_000.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.579275:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:2.0:1782759386.579827:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232781952 00000100:00100000:2.0:1782759386.579831:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232781952 00000100:00100000:2.0:1782759386.579891:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:2.0:1782759386.579898:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232781952:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1782759386.579907:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759386.579919:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b898 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b891 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.579934:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b898 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b891 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.579942:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b898 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b891 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.579955:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cddc34ff900) 00010000:00010000:2.0:1782759386.579957:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759386.579959:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759386.579995:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6544:x1869355232781952:12345-0@lo:101:mdt_io00_000.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.580001:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1782759386.580028:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232781952:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759386.580040:0:6544:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 4/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.580051:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759386.580060:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759386.580107:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232782080:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759386.580133:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.580158:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759386.580355:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232782080:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759386.580421:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232782208:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759386.580445:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.580463:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759386.580480:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232782208 00000100:00100000:2.0:1782759386.580486:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232782208 00000100:00100000:2.0:1782759386.580548:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:2.0:1782759386.580555:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6544:x1869355232782208:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759386.580643:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6544:x1869355232782208:12345-0@lo:1000:mdt_io00_000.0 Request processed in 89us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759386.580648:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:1.0:1782759386.580661:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232782208:0@lo:1000:mdt_io00_000.0 00000040:00080000:1.0:1782759386.580942:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].23, 544 off54912 00000040:00080000:1.0:1782759386.581000:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].23, 624 off57544 00000004:00080000:1.0:1782759386.581006:0:6544:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc3d1e900 with version 47 00000100:00100000:2.0:1782759386.581303:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232782464 00000100:00100000:2.0:1782759386.581307:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232782464 00000100:00100000:2.0:1782759386.581358:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759386.581363:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232782464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759386.581644:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7476:x1869355232782464:12345-0@lo:1000:osp_up0-1.0 Request processed in 281us (372us total) trans 4294967933 rc 0/0 00000100:00100000:2.0:1782759386.581651:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00010000:00010000:2.0:1782759386.582104:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759386.582111:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 2/0,0 mode: CW/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582129:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759386.582133:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759386.582160:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582208:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 2/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582216:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759386.582244:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 1/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582262:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5400/0xd5b45c7f5c60b852 lrc: 0/0,0 mode: --/CW res: [0x200000421:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b859 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582284:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759386.582289:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582301:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759386.582306:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759386.582313:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582335:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582342:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759386.582371:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582382:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60b891 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b898 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759386.582398:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759386.582400:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759386.582402:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759386.582422:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759386.582433:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232782720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759386.582436:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759386.582470:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759386.582508:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232782720 00000100:00100000:1.0:1782759386.582514:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232782720 00000100:00100000:1.0:1782759386.582555:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1782759386.582565:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3663:x1869355232782720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759386.582638:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759386.582653:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60b898 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b891 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759386.582654:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232782592:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759386.582672:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cddc34ff900) 00010000:00010000:1.0:1782759386.582679:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759386.582712:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3663:x1869355232782720:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759386.582720:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782759386.582727:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232782720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759387.018811:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232782848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759387.018896:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782759387.019438:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759387.019736:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232783360:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.019777:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.019825:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232782848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759387.019846:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232783872:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.019876:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.019899:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232784384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.019922:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.019945:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782759387.019953:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232783232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.019989:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.020011:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232783744:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.020040:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.020060:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232784256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.020097:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.020137:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232783360 00000100:00100000:2.0:1782759387.020141:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232783360 00000100:00100000:1.0:1782759387.020261:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232783872 00000100:00100000:1.0:1782759387.020266:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232783872 00000100:00100000:1.0:1782759387.020299:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784384 00000100:00100000:1.0:1782759387.020302:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784384 00000100:00100000:1.0:1782759387.020321:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784000 00000100:00100000:1.0:1782759387.020324:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784000 00000100:00100000:1.0:1782759387.020337:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:1.0:1782759387.020343:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232783872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.020386:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232783872:12345-0@lo:400:kworker.0 Request processed in 43us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759387.020391:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:1.0:1782759387.020402:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:1.0:1782759387.020406:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232784384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.020427:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232784384:12345-0@lo:400:kworker.0 Request processed in 21us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759387.020430:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00100000:1.0:1782759387.020437:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:1.0:1782759387.020440:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232784000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.020467:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232784000:12345-0@lo:400:kworker.0 Request processed in 26us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759387.020471:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00100000:2.0:1782759387.020786:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232783744 00000100:00100000:2.0:1782759387.020791:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232783744 00000100:00100000:2.0:1782759387.020816:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784256 00000100:00100000:2.0:1782759387.020820:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784256 00000100:00100000:2.0:1782759387.020838:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232783104 00000100:00100000:2.0:1782759387.020842:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232783104 00000100:00100000:2.0:1782759387.020858:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232783616 00000100:00100000:2.0:1782759387.020864:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232783616 00000100:00100000:2.0:1782759387.020884:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784128 00000100:00100000:2.0:1782759387.020888:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784128 00000100:00100000:2.0:1782759387.020908:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4854 00000100:00100000:2.0:1782759387.020916:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232783360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.020953:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232783360:12345-0@lo:400:kworker.0 Request processed in 37us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.020960:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4854 00000100:00100000:2.0:1782759387.020980:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4855 00000100:00100000:2.0:1782759387.020990:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232783744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021016:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232783744:12345-0@lo:400:kworker.0 Request processed in 30us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.021022:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4855 00000100:00100000:2.0:1782759387.021034:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4856 00000100:00100000:2.0:1782759387.021046:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232784256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021081:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232784256:12345-0@lo:400:kworker.0 Request processed in 35us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.021087:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4856 00000100:00100000:2.0:1782759387.021104:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4857 00000100:00100000:2.0:1782759387.021115:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232783104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021150:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232783104:12345-0@lo:400:kworker.0 Request processed in 37us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.021157:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4857 00000100:00100000:2.0:1782759387.021174:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4858 00000100:00100000:2.0:1782759387.021182:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232783616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021212:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232783616:12345-0@lo:400:kworker.0 Request processed in 31us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.021220:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4858 00000100:00100000:2.0:1782759387.021238:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4859 00000100:00100000:2.0:1782759387.021249:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232784128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021293:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232784128:12345-0@lo:400:kworker.0 Request processed in 45us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759387.021301:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4859 00000100:00100000:2.0:1782759387.021383:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232783104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021394:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232783616:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021402:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232784128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021409:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232782976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759387.021427:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232783488:0@lo:400:kworker.0 00000100:00080000:1.0:1782759387.021504:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759387.021508:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759387.021510:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759387.021512:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759387.021542:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232783232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.021552:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232783744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.021560:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232784256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.021569:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232784384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.021593:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232783872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759387.021602:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232783360:0@lo:400:kworker.0 00000020:00000080:2.0:1782759387.419946:0:137867:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc2a3f9200 20000000:00000080:2.0:1782759387.419964:0:137867:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3f3d400 uarg=0000000000000000 00010000:00010000:2.0:1782759387.423258:0:137867:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782759387.423299:0:137867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xe:0x0].0x0 (ffff8cdecda0a000) 00010000:00010000:2.0:1782759387.423302:0:137867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1782759387.423314:0:137867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60b7cd lrc: 0/0,0 mode: --/PR res: [0x200000421:0xe:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270d6 expref: 5 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423334:0:137867:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782759387.423363:0:137867:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759387.423377:0:137867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:2.0:1782759387.423379:0:137867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759387.423382:0:137867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60b795 lrc: 0/0,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270c1 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423394:0:137867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xe:0x0].0x0 (ffff8cddc24d2e00) 00010000:00010000:2.0:1782759387.423395:0:137867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759387.423398:0:137867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60b7bf lrc: 0/0,0 mode: --/PR res: [0x200000421:0xe:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb270cf expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423409:0:137867:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 2 locks, left on hash table 0. 10000000:01000000:2.0:1782759387.423450:0:137867:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759387.423465:0:137867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423477:0:137867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423504:0:137867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423541:0:137867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.423556:0:137867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 23 pid: 6525 timeout: 3577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759387.423571:0:137867:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137867:1869355232784512:0@lo:104: 00000100:00100000:2.0:1782759387.423662:0:137867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759387.423715:0:137867:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759387.423940:0:137867:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:137867:1869355232784512:0@lo:104: 00010000:00010000:2.0:1782759387.423970:0:137867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759387.424231:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232784640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759387.424261:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759387.424296:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784640 00000100:00100000:1.0:1782759387.424300:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784640 00010000:00010000:1.0:1782759387.424318:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 24 pid: 6525 timeout: 3577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759387.424341:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1782759387.424346:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232784640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759387.424354:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759387.424357:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 24 pid: 6525 timeout: 3577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424364:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 24 pid: 6525 timeout: 3577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424379:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60b67d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b676 expref: 24 pid: 6525 timeout: 3577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424387:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424392:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424400:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424404:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424409:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424412:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424415:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759387.424418:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424422:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424435:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759387.424448:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759387.424463:0:137867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759387.424472:0:137867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759387.424477:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232784640:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (215us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759387.424490:0:137867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60b89f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759387.424490:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1782759387.532059:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784768 00000100:00100000:1.0:1782759387.532066:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784768 00000100:00100000:1.0:1782759387.532113:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:1.0:1782759387.532119:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232784768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759387.532138:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759387.532181:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232784768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759387.532188:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:1.0:1782759388.042931:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232784896 00000100:00100000:1.0:1782759388.042940:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232784896 00000100:00100000:1.0:1782759388.043009:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1782759388.043020:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232784896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759388.043054:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446203392 avail 1299963904 00000100:00100000:1.0:1782759388.043117:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232784896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759388.043126:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000020:00000080:1.0:1782759388.184541:0:137963:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca79018b0 20000000:00000080:1.0:1782759388.184560:0:137963:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd8aa400 uarg=0000000000000000 00010000:00010000:1.0:1782759388.184829:0:137963:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759388.184841:0:137963:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759388.184853:0:137963:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759388.184860:0:137963:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759388.184881:0:137963:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759388.184895:0:137963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184907:0:137963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184915:0:137963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184920:0:137963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184924:0:137963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184928:0:137963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184932:0:137963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759388.184935:0:137963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184940:0:137963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184948:0:137963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184952:0:137963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.184961:0:137963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60b8ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 137963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.383439:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218441984 00000100:00100000:1.0:1782759388.383454:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218441984 00000100:00100000:1.0:1782759388.383536:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218442112 00000100:00100000:1.0:1782759388.383539:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218442112 00000100:00100000:1.0:1782759388.383560:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4860 00000100:00100000:1.0:1782759388.383568:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218441984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759388.383652:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218441856 00000100:00100000:2.0:1782759388.383675:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218441856 00000100:00100000:2.0:1782759388.383720:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2961 00000100:00100000:1.0:1782759388.383720:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218441984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 151us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.383727:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218441856:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759388.383728:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4860 00000100:00100000:1.0:1782759388.383747:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4861 00000100:00100000:1.0:1782759388.383753:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218442112:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759388.383755:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218441856:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.383762:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2961 00000100:00100000:1.0:1782759388.383793:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218442112:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.383800:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218442368 00000100:00100000:1.0:1782759388.383800:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4861 00000100:00100000:2.0:1782759388.383804:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218442368 00000100:00080000:1.0:1782759388.383828:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759388.383833:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759388.383835:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2777 00000100:00080000:1.0:1782759388.383836:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759388.383839:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759388.383842:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218442240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759388.383872:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218442240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.384282:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2777 00010000:00010000:1.0:1782759388.491720:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759388.555280:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759388.555306:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232785024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759388.555548:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759388.556038:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232785024 00000100:00100000:2.0:1782759388.556048:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232785024 00000100:00100000:2.0:1782759388.556119:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:2.0:1782759388.556129:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232785024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759388.556164:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759388.556218:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232785024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.556226:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00080000:1.0:1782759388.556293:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759388.556355:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232785024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759388.558033:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232785280 00000100:00100000:2.0:1782759388.558045:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232785280 00000100:00100000:2.0:1782759388.558090:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1782759388.558099:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232785280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759388.558121:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759388.558229:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232785280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 129us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.558237:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1782759388.558480:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232785152 00000100:00100000:2.0:1782759388.558484:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232785152 00000100:00100000:2.0:1782759388.558512:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759388.558519:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232785152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759388.558529:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759388.558551:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60b8bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b8b4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.558597:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60b8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b8b4 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.558620:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60b8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b8b4 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.558631:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649a00, rc 0) 00000100:00100000:2.0:1782759388.558663:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232785152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759388.558669:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759388.558714:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232785152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759388.558745:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60b8b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b8bb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.558755:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60b8b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b8bb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759388.558778:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759388.558792:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60b8b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b8bb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759388.558800:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60b8b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b8bb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.559045:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232785280:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1782759388.651846:0:138011:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff58aaf0b0 20000000:00000080:1.0:1782759388.651868:0:138011:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd8ab400 uarg=0000000000000000 00010000:00010000:1.0:1782759388.652127:0:138011:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759388.652145:0:138011:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759388.652169:0:138011:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759388.652181:0:138011:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759388.652202:0:138011:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759388.652226:0:138011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60b8c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.652246:0:138011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60b8bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b8b4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.652255:0:138011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60b8c2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.652302:0:138011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60b8bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60b8b4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759388.652318:0:138011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60b8bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b8b4 expref: 23 pid: 6524 timeout: 3578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759388.652335:0:138011:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138011:1869355232785408:0@lo:104: 00000100:00100000:1.0:1782759388.652418:0:138011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759388.652530:0:138011:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759388.652886:0:138011:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138011:1869355232785408:0@lo:104: 00010000:00010000:1.0:1782759388.652909:0:138011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60b8c2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759389.898702:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759389.898709:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759389.898714:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759389.898759:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60b8c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759389.898780:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60b8c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759389.898790:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60b8c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759389.898816:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232785664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759389.898881:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759389.898942:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58d80 going to sleep for 11 seconds 00010000:00010000:1.0:1782759390.540497:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759390.684945:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759390.685015:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232785792 00000100:00100000:2.0:1782759390.685022:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232785792 00000100:00100000:2.0:1782759390.685067:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1782759390.685077:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee7776c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:138207:x1869355232785792:12345-0@lo:104: 00010000:00010000:2.0:1782759390.685089:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60b8c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b8d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.685148:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759390.685162:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee7776c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:138207:x1869355232785792:12345-0@lo:104: Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759390.685170:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1782759390.685319:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759390.685332:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232785920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759390.685366:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759390.685622:0:138207:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60b8d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.685633:0:138207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60b8d7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759390.685640:0:138207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60b8d7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759391.115218:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232786048 00000100:00100000:1.0:1782759391.115226:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232786048 00000100:00100000:1.0:1782759391.115316:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:1.0:1782759391.115326:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3663:x1869355232786048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759391.115360:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445965824 avail 1299726336 00000100:00100000:1.0:1782759391.115414:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:3663:x1869355232786048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759391.115421:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000020:00000080:2.0:1782759391.552815:0:138303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc23e49200 20000000:00000080:2.0:1782759391.552829:0:138303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecdb10c00 uarg=0000000000000000 00010000:00010000:2.0:1782759391.552979:0:138303:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759391.552990:0:138303:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759391.553003:0:138303:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759391.553010:0:138303:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759391.553023:0:138303:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759391.553038:0:138303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553050:0:138303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553058:0:138303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553069:0:138303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553074:0:138303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553078:0:138303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553081:0:138303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759391.553084:0:138303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553089:0:138303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553097:0:138303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553101:0:138303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759391.553105:0:138303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60b8e5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759392.140058:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232786176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.143731:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232786560 00000100:00100000:2.0:1782759392.143740:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232786560 00000100:00100000:1.0:1782759392.143771:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759392.143799:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1782759392.143811:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232786560:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759392.143827:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232786688:0@lo:400:kworker.0 00002000:00000024:2.0:1782759392.143843:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759392.143888:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232786560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.143895:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:2.0:1782759392.143982:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787072 00000100:00100000:2.0:1782759392.143988:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787072 00000100:00100000:1.0:1782759392.143988:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759392.144021:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787584 00000100:00100000:2.0:1782759392.144024:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787584 00000100:00100000:1.0:1782759392.144028:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232787200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.144037:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232786944 00000100:00100000:2.0:1782759392.144041:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232786944 00000100:00100000:2.0:1782759392.144056:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232786688 00000100:00100000:2.0:1782759392.144058:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232786688 00000100:00100000:1.0:1782759392.144069:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759392.144072:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787456 00000100:00100000:2.0:1782759392.144075:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787456 00000100:00100000:2.0:1782759392.144092:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4862 00000100:00100000:1.0:1782759392.144098:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232787712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.144100:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232787072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.144138:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759392.144153:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232787072:12345-0@lo:400:kworker.0 Request processed in 53us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.144160:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4862 00000100:00100000:2.0:1782759392.144175:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863 00000100:00100000:2.0:1782759392.144183:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232787584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.144183:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787200 00000100:00100000:1.0:1782759392.144190:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787200 00000100:00100000:2.0:1782759392.144219:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232787584:12345-0@lo:400:kworker.0 Request processed in 35us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.144226:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863 00000100:00100000:1.0:1782759392.144231:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787712 00000100:00100000:1.0:1782759392.144236:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787712 00000100:00100000:2.0:1782759392.144244:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4864 00000100:00100000:2.0:1782759392.144253:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232786944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.144268:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:1.0:1782759392.144279:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232787200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.144322:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232787200:12345-0@lo:400:kworker.0 Request processed in 45us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.144353:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232786944:12345-0@lo:400:kworker.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.144359:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4864 00000100:00100000:1.0:1782759392.144415:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00100000:1.0:1782759392.144436:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:1.0:1782759392.144446:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232787712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.144490:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232787712:12345-0@lo:400:kworker.0 Request processed in 46us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759392.144499:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00000100:00100000:2.0:1782759392.144640:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232786688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.144649:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232787200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.144657:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967400 gen 2 00000004:00080000:2.0:1782759392.144660:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc26c5c00, transno 4294967400 00000100:00100000:2.0:1782759392.144668:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232787712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.144677:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232786176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.146139:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232786304 00000100:00100000:1.0:1782759392.146145:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232786304 00000100:00100000:1.0:1782759392.146182:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4867 00000100:00100000:1.0:1782759392.146191:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232786304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.146240:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232786304:12345-0@lo:400:kworker.0 Request processed in 49us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759392.146247:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4867 00010000:00010000:2.0:1782759392.146734:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60b867 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b86e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759392.146749:0:7461:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60b867 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b86e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.146781:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60b867 lrc: 2/0,0 mode: --/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b86e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.146788:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759392.146804:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60b867 lrc: 0/0,0 mode: --/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b86e expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759392.146813:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787328 00000100:00100000:1.0:1782759392.146819:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787328 00010000:00010000:2.0:1782759392.146823:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5e00/0xd5b45c7f5c60b883 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b88a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759392.146832:0:7461:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5e00/0xd5b45c7f5c60b883 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b88a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.146849:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5e00/0xd5b45c7f5c60b883 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b88a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.146866:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759392.146873:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5e00/0xd5b45c7f5c60b883 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x10:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b88a expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759392.146883:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967638 is committed 00000020:00080000:2.0:1782759392.146893:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 22 batchid updated 00000001:00080000:2.0:1782759392.146920:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967637 is committed 00000100:00100000:1.0:1782759392.146922:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787840 00000100:00100000:1.0:1782759392.146927:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787840 00000100:00100000:1.0:1782759392.146959:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1782759392.146967:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:1.0:1782759392.146972:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232787328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759392.146980:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232787840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759392.147033:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232787328:12345-0@lo:400:kworker.0 Request processed in 63us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.147034:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232787840:12345-0@lo:400:kworker.0 Request processed in 58us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759392.147049:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:2.0:1782759392.147062:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000020:00080000:1.0:1782759392.147080:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 22 00000004:00080000:1.0:1782759392.147133:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4b589c0 with version 48 00000020:00080000:1.0:1782759392.147153:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 22 cancel update log [0x200000401:0x2:0x0].22: rc = 0 00000004:00080000:2.0:1782759392.147170:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 48 rpc_version 48 00000020:00100000:2.0:1782759392.147187:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759392.147196:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf92d500 x1869355232788352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759392.147211:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232788352:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759392.147235:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1782759392.147236:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 22 cancel update log [0x240000400:0x2:0x0].22: rc = 0 00000100:00100000:2.0:1782759392.147253:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37d80 going to sleep for 11 seconds 00000020:00080000:1.0:1782759392.147255:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 22 00000100:00100000:1.0:1782759392.147272:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232787968 00000100:00100000:1.0:1782759392.147277:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232787968 00000100:00100000:1.0:1782759392.147993:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232788096 00000100:00100000:1.0:1782759392.147997:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232788096 00000100:00100000:2.0:1782759392.148017:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1782759392.148028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1782759392.148029:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3662:x1869355232787968:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1782759392.148042:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3662:x1869355232788096:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782759392.148044:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759392.148055:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759392.148066:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60b86e lrc: 0/0,0 mode: --/PW res: [0x200000421:0xe:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b867 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759392.148072:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60b88a lrc: 0/0,0 mode: --/EX res: [0x200000421:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60b883 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.148082:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xe:0x0].0x121d9c5e (ffff8cddc34ff600) 00010000:00010000:1.0:1782759392.148089:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x10:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:2.0:1782759392.148099:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759392.148105:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759392.148132:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3662:x1869355232787968:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 107us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759392.148139:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1782759392.148144:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3662:x1869355232788096:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 104us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759392.148152:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000004:00080000:1.0:1782759392.152869:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 22 rpc_version 22 00000020:00100000:1.0:1782759392.152909:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759392.152920:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf875500 x1869355232788608/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759392.152946:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232788608:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759392.153025:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759392.153084:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b586c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759392.157469:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232789120 00000100:00100000:1.0:1782759392.157474:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232789120 00000100:00100000:1.0:1782759392.157508:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1782759392.157515:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7666:x1869355232789120:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759392.157645:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:7666:x1869355232789120:12345-0@lo:1000:osp_up1-0.0 Request processed in 131us (272us total) trans 4294967641 rc 0/0 00000100:00100000:1.0:1782759392.157657:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 10000000:01000000:2.0:1782759392.459956:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759392.459964:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759392.459969:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759392.460176:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.460190:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759392.460202:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759392.460229:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232790016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759392.460303:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759392.460410:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f376c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759392.650917:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759392.650939:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232790144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759392.651005:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759393.162842:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759393.163945:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232790272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759393.164012:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759393.164449:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232790272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759393.502502:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218442496 00000100:00100000:2.0:1782759393.502515:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218442496 00000100:00100000:2.0:1782759393.502628:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2966 00000100:00100000:2.0:1782759393.502643:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218442496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759393.502739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218442496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759393.502756:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2966 00000100:00100000:2.0:1782759393.502833:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2784 00000100:00100000:2.0:1782759393.502841:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218442880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759393.502875:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218442880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759393.502881:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2784 00000100:00080000:2.0:1782759393.502897:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759393.502902:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759393.502905:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759393.502907:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759393.502918:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4869 00000100:00100000:2.0:1782759393.502984:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218442624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759393.503067:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218442624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 83us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759393.503077:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4869 00000100:00100000:1.0:1782759393.675078:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759393.675087:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232790528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759393.675117:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759393.675150:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232790400 00000100:00100000:1.0:1782759393.675159:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232790400 00000100:00100000:1.0:1782759393.675208:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232790528 00000100:00100000:1.0:1782759393.675211:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232790528 00000100:00100000:1.0:1782759393.675229:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1782759393.675239:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232790400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759393.675279:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759393.675332:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232790400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759393.675339:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1782759393.675357:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:1.0:1782759393.675363:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232790528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759393.675373:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759393.675395:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232790528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759393.675402:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:1.0:1782759393.675451:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232790528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759393.675465:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232790400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759393.718413:0:138498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138498:1869355232790656:0@lo:104: 00010000:00010000:1.0:1782759393.718435:0:138498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718494:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759393.718502:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718510:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759393.718514:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718523:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759393.718542:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759393.718548:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759393.718623:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718630:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759393.718655:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718662:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b8ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b8f3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718680:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759393.718682:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759393.718684:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759393.718696:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232790784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759393.718730:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759393.718796:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232790784 00000100:00100000:2.0:1782759393.718801:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232790784 00010000:00010000:2.0:1782759393.718825:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60b8f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b8ec expref: 24 pid: 6526 timeout: 3583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759393.718846:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1782759393.718852:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232790784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759393.718864:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759393.718869:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60b8f3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b8ec expref: 24 pid: 6526 timeout: 3583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718886:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60b8f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b8ec expref: 24 pid: 6526 timeout: 3583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718902:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60b8f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b8ec expref: 24 pid: 6526 timeout: 3583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718915:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718924:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718938:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718946:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718952:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718960:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718965:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759393.718969:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718977:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.718999:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759393.719009:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759393.719038:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232790784:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759393.719044:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1782759393.719073:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232790784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759393.719208:0:138498:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759393.719228:0:138498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759393.719235:0:138498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60b8fa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.552417:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218443136 00000100:00100000:2.0:1782759395.552430:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218443136 00000100:00100000:2.0:1782759395.552632:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2598 00000100:00100000:2.0:1782759395.552646:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103037:x1869355218443136:12345-192.168.202.31@tcp:101:lfs.0 00000100:00100000:2.0:1782759395.562837:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.566794:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 10000000:01000000:2.0:1782759395.594706:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759395.594717:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759395.594725:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759395.594783:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.594797:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.594810:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.594839:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232790912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759395.594919:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.594971:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.595294:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232790912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759395.595310:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.595319:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759395.595341:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759395.595346:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.595355:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.605903:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218444160 00000100:00100000:1.0:1782759395.605916:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218444160 00000100:00100000:1.0:1782759395.605993:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2604 00000100:00100000:1.0:1782759395.606004:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103039:x1869355218444160:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759395.606041:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.606070:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b98d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2711c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606142:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606157:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606169:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606204:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606212:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606218:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606270:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606277:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606283:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606289:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606294:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.606299:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606305:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606317:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe800) 00010000:00010000:1.0:1782759395.606320:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.606324:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606335:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60b994 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606348:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606353:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606358:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606363:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.606365:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606370:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606375:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:1.0:1782759395.606377:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.606380:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606385:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60b99b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606408:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b98d lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2711c expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606426:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe800) 00010000:00010000:1.0:1782759395.606428:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.606432:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60b98d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2711c expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.606445:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759395.606513:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103039:x1869355218444160:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 510us (704us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759395.606521:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2604 00000100:00100000:1.0:1782759395.619370:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00080000:2.0:1782759395.621741:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759395.625019:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.625122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218444800 00000100:00100000:2.0:1782759395.625132:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218444800 00010000:00010000:2.0:1782759395.625173:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b9be lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2712a expref: 10 pid: 6531 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.625212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 694 00000100:00100000:2.0:1782759395.625223:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218444800:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.625242:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759395.625249:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b9be lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2712a expref: 10 pid: 6531 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625286:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b9be lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2712a expref: 10 pid: 6531 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625312:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60b9be lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2712a expref: 10 pid: 6531 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625326:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:2.0:1782759395.625332:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60b9cc lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b9c5 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625342:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60b9cc lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60b9c5 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625352:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60b9cc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60b9c5 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625389:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60b9cc lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b9c5 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.625407:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6516:1869355232791552:0@lo:105: 00000100:00100000:2.0:1782759395.625451:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.625493:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.625819:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6516:1869355232791552:0@lo:105: 00010000:00010000:1.0:1782759395.625834:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759395.625874:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.625877:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218444800:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 656us (867us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759395.625891:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.625891:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 694 00000004:00080000:2.0:1782759395.625924:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759395.625956:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60b9d3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625961:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60b9d3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.625968:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60b9d3 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.625979:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232791680:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1782759395.626002:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.626181:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.627054:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232791680:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759395.627069:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60b9d3 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60b9da expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.627079:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60b9d3 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60b9da expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759395.629008:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967646 is committed 00000001:00080000:2.0:1782759395.629030:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967644 is committed 00000100:00100000:1.0:1782759395.630373:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232791936 00000100:00100000:1.0:1782759395.630378:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232791936 00000100:00100000:1.0:1782759395.630427:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:1.0:1782759395.630434:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232791936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759395.630506:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232791936:12345-0@lo:1000:mdt00_003.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.630511:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:1.0:1782759395.630787:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792064 00000100:00100000:1.0:1782759395.630792:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792064 00000100:00100000:1.0:1782759395.630870:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:1.0:1782759395.630877:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759395.630960:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792064:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (208us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759395.630967:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00000100:00100000:2.0:1782759395.631168:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792192 00000100:00100000:2.0:1782759395.631173:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792192 00000100:00100000:1.0:1782759395.631217:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:1.0:1782759395.631320:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759395.631415:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792192:12345-0@lo:1000:mdt00_003.0 Request processed in 189us (301us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759395.631421:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000100:00100000:1.0:1782759395.631723:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792320 00000100:00100000:1.0:1782759395.631727:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792320 00000100:00100000:1.0:1782759395.631780:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1782759395.631787:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759395.631841:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792320:12345-0@lo:1000:mdt00_003.0 Request processed in 55us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.631848:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:2.0:1782759395.631879:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232792320:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759395.631927:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232792448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759395.631960:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.631989:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded855c840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.631992:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792448 00000100:00100000:1.0:1782759395.631998:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792448 00000100:00100000:1.0:1782759395.632055:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1782759395.632062:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792448:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759395.632130:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792448:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.632136:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:2.0:1782759395.632188:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232792448:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759395.632238:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232792576:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759395.632261:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.632281:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded855ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.632315:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792576 00000100:00100000:1.0:1782759395.632320:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792576 00000100:00100000:1.0:1782759395.632379:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:1.0:1782759395.632385:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792576:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759395.632444:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232792576:12345-0@lo:1000:mdt00_003.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.632450:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1782759395.632480:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232792576:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1782759395.633483:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].13, 2168 off46736 00000040:00080000:2.0:1782759395.633623:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].13, 2368 off48416 00000004:00080000:2.0:1782759395.633632:0:8593:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc5787480 with version 28 00000100:00100000:1.0:1782759395.634079:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792832 00000100:00100000:1.0:1782759395.634087:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792832 00000100:00100000:1.0:1782759395.634171:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:1.0:1782759395.634180:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7666:x1869355232792832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759395.634888:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7666:x1869355232792832:12345-0@lo:1000:osp_up1-0.0 Request processed in 708us (865us total) trans 4294967647 rc 0/0 00000100:00100000:1.0:1782759395.634909:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1782759395.634960:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232792832:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759395.635363:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232792960 00000100:00100000:2.0:1782759395.635367:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232792960 00000100:00100000:2.0:1782759395.635433:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1782759395.635440:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:8593:x1869355232792960:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759395.635452:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.635468:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b9f6 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60b9ef expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.635483:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b9f6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b9ef expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.635494:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b9f6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b9ef expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.635504:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:2.0:1782759395.635507:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.635519:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759395.635572:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232792960:12345-0@lo:101:mdt00_003.0 Request processed in 132us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.635595:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00010000:00010000:2.0:1782759395.636433:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759395.636441:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.636451:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759395.636457:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759395.636466:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.636498:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.636505:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759395.637105:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.637115:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de4000/0xd5b45c7f5c60b9c5 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60b9cc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.637130:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759395.637132:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759395.637134:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759395.647867:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.652457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232793216 00000100:00100000:1.0:1782759395.652472:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232793216 00000100:00100000:1.0:1782759395.652538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1782759395.652560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:42628:x1869355232793216:12345-0@lo:104: 00010000:00010000:1.0:1782759395.652608:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60b9d3 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b9da expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.652742:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759395.652750:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:42628:x1869355232793216:12345-0@lo:104: Request processed in 192us (4299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.652760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00010000:00010000:3.0:1782759395.652858:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba0b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.653192:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232793344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759395.653246:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.653308:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232793344 00000100:00100000:3.0:1782759395.653314:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232793344 00010000:00010000:3.0:1782759395.653347:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60b9da lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b9d3 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.653374:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:3.0:1782759395.653382:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+8:3662:x1869355232793344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.653395:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1782759395.656148:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967647 is committed 00010000:00010000:3.0:1782759395.656262:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60b9da lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b9d3 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.656282:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:3.0:1782759395.656287:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba0b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.656297:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba0b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.656305:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba0b lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.656340:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.656428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232793344:12345-0@lo:103:ldlm_bl.0 Request processed in 3041us (3177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.656442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1782759395.656472:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232793344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759395.657252:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232793472 00000100:00100000:2.0:1782759395.657261:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232793472 00000100:00100000:2.0:1782759395.657348:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:2.0:1782759395.657360:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:42628:x1869355232793472:12345-0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782759395.657508:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:42628:x1869355232793472:12345-0@lo:1000:mdt00_005.0 Request processed in 151us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.657517:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00010000:00010000:3.0:1782759395.658896:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1782759395.659170:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 23 committed batchid 22 00000020:00080000:1.0:1782759395.659282:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 22 00000100:00100000:2.0:1782759395.665758:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218445056 00000100:00100000:2.0:1782759395.665775:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218445056 00000100:00100000:2.0:1782759395.665866:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2609 00000100:00100000:2.0:1782759395.665878:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103040:x1869355218445056:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:2.0:1782759395.665911:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.665937:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60ba19 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27138 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.666013:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba20 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.666030:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba20 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.666043:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba20 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759395.666181:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x11:0x0]: returning size 4096 00000004:00200000:2.0:1782759395.666199:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1782759395.666255:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60ba19 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27138 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.666276:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba20 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x11:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27138 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.666308:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x11:0x0].0x0 (ffff8cded3a3bc00) 00010000:00010000:2.0:1782759395.666311:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759395.666314:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759395.666390:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103040:x1869355218445056:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 514us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.666399:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2609 00000100:00100000:3.0:1782759395.669249:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.669329:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218445184 00000100:00100000:1.0:1782759395.669340:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218445184 00000100:00100000:1.0:1782759395.669409:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2610 00000100:00100000:1.0:1782759395.669420:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103040:x1869355218445184:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:1.0:1782759395.669444:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.669464:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60ba27 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2713f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.669522:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.669537:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.669563:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759395.669831:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1782759395.669838:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1782759395.669877:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60ba27 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.669897:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.669907:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8cded3a3b600) 00010000:00010000:1.0:1782759395.669926:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759395.669929:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428400, rc 0) 00000100:00100000:1.0:1782759395.670024:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103040:x1869355218445184:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 604us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.670031:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2610 00000100:00100000:1.0:1782759395.674924:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.675867:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232793600 00000100:00100000:1.0:1782759395.675872:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232793600 00000100:00100000:1.0:1782759395.675928:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1782759395.675935:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:12673:x1869355232793600:12345-0@lo:104: 00010000:00010000:1.0:1782759395.675948:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.676001:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759395.676006:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:12673:x1869355232793600:12345-0@lo:104: Request processed in 72us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.676012:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00010000:00010000:2.0:1782759395.676051:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759395.676060:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.676070:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759395.676076:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759395.676096:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.676125:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.676130:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759395.676153:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 1/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.676159:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60b9ef lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b9f6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.676188:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759395.676189:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12673:1869355232793600:0@lo:104: 00010000:00010000:2.0:1782759395.676190:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759395.676192:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759395.676204:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232793728:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.676223:0:12673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.676247:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.676281:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232793728 00000100:00100000:3.0:1782759395.676286:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232793728 00010000:00010000:3.0:1782759395.676308:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b9f6 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b9ef expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.676345:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1782759395.676352:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec8150450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232793728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.676364:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1782759395.678790:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 23 batchid updated 00000020:00080000:2.0:1782759395.679165:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 23 00000004:00080000:2.0:1782759395.679243:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc45c30c0 with version 49 00000020:00080000:2.0:1782759395.679268:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 23 cancel update log [0x200000401:0x2:0x0].23: rc = 0 00000020:00080000:2.0:1782759395.679369:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 23 cancel update log [0x240000400:0x2:0x0].23: rc = 0 00000020:00080000:2.0:1782759395.679382:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 23 00010000:00010000:3.0:1782759395.679508:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60b9f6 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b9ef expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.679534:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:3.0:1782759395.679552:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.679564:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.679574:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.679635:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.679688:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec8150450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232793728:12345-0@lo:103:ldlm_bl.0 Request processed in 3334us (3438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.679701:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1782759395.679711:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232793984 00000100:00100000:1.0:1782759395.679719:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232793984 00000100:00100000:1.0:1782759395.679809:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:1.0:1782759395.679817:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355232793984:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759395.679852:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232793728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.679885:0:12673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.679894:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759395.679956:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1782759395.679963:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1782759395.679968:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232793984:12345-0@lo:1000:osp_up0-1.0 Request processed in 151us (437us total) trans 4294967936 rc 0/0 00000100:00100000:1.0:1782759395.679976:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:3.0:1782759395.680044:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232793984:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1782759395.680173:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60ba35 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.680192:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.680201:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:2.0:1782759395.680211:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759395.680214:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:2.0:1782759395.680270:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103040:x1869355218445312:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 5090us (5360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.680278:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2611 00000100:00100000:3.0:1782759395.687393:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218445440 00000100:00100000:3.0:1782759395.687406:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218445440 00000100:00100000:3.0:1782759395.687498:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 360 00000100:00100000:3.0:1782759395.687512:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218445440:12345-192.168.202.31@tcp:103:rmdir.0 00010000:00010000:3.0:1782759395.687532:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.687618:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ba12 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27131 expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.687641:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x11:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:3.0:1782759395.687660:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.687720:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218445440:12345-192.168.202.31@tcp:103:rmdir.0 Request processed in 212us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.687728:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 360 00000100:00100000:2.0:1782759395.687798:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218445696 00000100:00100000:2.0:1782759395.687804:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218445696 00000100:00100000:2.0:1782759395.687847:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2612 00000100:00100000:2.0:1782759395.687855:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103040:x1869355218445696:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:2.0:1782759395.687911:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759395.687929:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba20 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x11:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27138 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.687945:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x11:0x0].0x0 (ffff8cded3a3bc00) 00010000:00010000:2.0:1782759395.687949:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759395.688013:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.688023:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.688035:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.688061:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794112:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1782759395.688127:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.688163:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.688188:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232794112 00000100:00100000:2.0:1782759395.688192:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232794112 00000100:00100000:2.0:1782759395.688257:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:2.0:1782759395.688266:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6532:x1869355232794112:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759395.688278:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.688293:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60ba4a lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ba43 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.688319:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60ba4a lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba43 expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.688333:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60ba4a lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba43 expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.688341:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ff100) 00010000:00010000:2.0:1782759395.688344:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.688347:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759395.688393:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6532:x1869355232794112:12345-0@lo:101:mdt00_001.0 Request processed in 130us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.688400:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:1.0:1782759395.688467:0:6532:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967647 gen 2 00000004:00080000:1.0:1782759395.688474:0:6532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967647 committed transno 4294967647 00000100:00100000:1.0:1782759395.688506:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794112:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1782759395.688526:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.688536:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759395.688563:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759395.688609:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429e00/0xd5b45c7f5c60ba51 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.688618:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429e00/0xd5b45c7f5c60ba51 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.688626:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429e00/0xd5b45c7f5c60ba51 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.688640:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794240:0@lo:101:mdt00_001.0 00000100:00100000:1.0:1782759395.688672:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.688695:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.688918:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794240:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759395.688931:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429e00/0xd5b45c7f5c60ba51 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ba58 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.688942:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5429e00/0xd5b45c7f5c60ba51 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba58 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759395.688956:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00000100:00100000:2.0:1782759395.688993:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794368:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759395.689030:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.689056:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.689297:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794368:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759395.689346:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794496:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759395.689376:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.689393:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.689411:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232794496 00000100:00100000:2.0:1782759395.689417:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232794496 00000100:00100000:2.0:1782759395.689453:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:2.0:1782759395.689460:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6532:x1869355232794496:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759395.689669:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6532:x1869355232794496:12345-0@lo:1000:mdt00_001.0 Request processed in 209us (292us total) trans 0 rc 1/1 00000100:00100000:2.0:1782759395.689677:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00000100:00100000:3.0:1782759395.689698:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794496:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782759395.689752:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 3/0,1 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.689761:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 3/0,1 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.689769:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 3/0,1 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.689791:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794624:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782759395.689816:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.689840:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.690366:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232794624 00000100:00100000:1.0:1782759395.690373:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232794624 00000100:00100000:1.0:1782759395.690412:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:1.0:1782759395.690421:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6532:x1869355232794624:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1782759395.690432:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.690450:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60ba66 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ba5f expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.690472:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60ba66 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba5f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.690499:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60ba66 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba5f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.690508:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x11:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:1.0:1782759395.690510:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759395.690513:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759395.690562:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6532:x1869355232794624:12345-0@lo:101:mdt00_001.0 Request processed in 142us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.690569:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:3.0:1782759395.690618:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794624:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759395.690631:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690642:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690666:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ba6d lrc: 3/0,1 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690675:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ba6d lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690683:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ba6d lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690699:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690710:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690718:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690741:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.690764:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 8 pid: 6533 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.690776:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232794752:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759395.690844:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.698224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218445824 00000100:00100000:2.0:1782759395.698237:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218445824 00010000:00010000:2.0:1782759395.698289:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 9 pid: 6533 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.698344:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 697 00000100:00100000:2.0:1782759395.698355:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218445824:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.698376:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759395.698385:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 5/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 9 pid: 6533 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.698403:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 9 pid: 6533 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.698432:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8cded3a3b600) 00010000:00010000:2.0:1782759395.698439:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.698450:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.698473:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.698498:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759395.698530:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428400/0xd5b45c7f5c60ba2e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2713f expref: 9 pid: 6533 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.698569:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232794752:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759395.698613:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218445824:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 257us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.698624:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 697 00010000:00010000:3.0:1782759395.698643:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.698657:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.698664:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ba74 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.698716:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.698725:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.698735:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.698757:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232794880:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782759395.698855:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.698937:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.698975:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232794880 00000100:00100000:2.0:1782759395.698981:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232794880 00000100:00100000:2.0:1782759395.699034:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:2.0:1782759395.699043:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6532:x1869355232794880:12345-0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759395.699062:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.699077:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ba7b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.699100:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 5 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.699109:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 4/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.699133:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 5 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.699148:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 5 pid: 12673 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.699172:0:6537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6537:1869355232795008:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759395.699232:0:6537:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.701984:0:6537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6537:1869355232795008:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759395.702019:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702033:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:2.0:1782759395.702036:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759395.702040:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702050:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702056:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759395.702125:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6532:x1869355232794880:12345-0@lo:101:mdt00_001.0 Request processed in 3083us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.702133:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:3.0:1782759395.702300:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218445952 00000100:00100000:3.0:1782759395.702307:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218445952 00010000:00010000:3.0:1782759395.702342:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 6 pid: 12673 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.702405:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 698 00000100:00100000:3.0:1782759395.702416:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218445952:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.702433:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.702440:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 6 pid: 12673 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.702453:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 6 pid: 12673 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.702476:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ba3c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27146 expref: 6 pid: 12673 timeout: 3535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.702501:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:3.0:1782759395.702506:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.702516:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.702525:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.702620:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.702635:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6516:1869355232795136:0@lo:105: 00000100:00100000:3.0:1782759395.702676:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.702717:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.702767:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232795136 00000100:00100000:2.0:1782759395.702771:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232795136 00000100:00100000:2.0:1782759395.702799:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1782759395.702807:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6516:x1869355232795136:12345-0@lo:105: 00010000:00010000:2.0:1782759395.702817:0:18645:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 5/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702839:0:18645:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 5/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702849:0:18645:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 5/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702857:0:18645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702865:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702875:0:18645:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.702901:0:18645:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc3de5400) 00000100:00100000:2.0:1782759395.702946:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6516:x1869355232795136:12345-0@lo:105: Request processed in 139us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.702953:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:1.0:1782759395.702993:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6516:1869355232795136:0@lo:105: 00010000:00010000:1.0:1782759395.703009:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759395.703015:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.703026:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.703056:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218445952:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 643us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.703063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 698 00000100:00100000:3.0:1782759395.703810:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232795264:0@lo:403:mdt00_001.0 00000100:00100000:3.0:1782759395.704059:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.704131:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.704286:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232795264 00000100:00100000:2.0:1782759395.704292:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232795264 00000100:00100000:2.0:1782759395.704389:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:2.0:1782759395.704398:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6532:x1869355232795264:12345-0@lo:403:mdt00_001.0 00000100:00100000:2.0:1782759395.706268:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6532:x1869355232795264:12345-0@lo:403:mdt00_001.0 Request processed in 1861us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.706283:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:3.0:1782759395.706427:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232795264:0@lo:403:mdt00_001.0 00000040:00080000:3.0:1782759395.707447:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].14, 656 off47392 00000040:00080000:3.0:1782759395.707715:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].14, 736 off49152 00000004:00080000:3.0:1782759395.707722:0:6532:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc2700240 with version 29 00000004:00080000:3.0:1782759395.707764:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 29 rpc_version 29 00000020:00100000:3.0:1782759395.707796:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759395.707806:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4436d80 x1869355232795520/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1808/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759395.707831:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232795520:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782759395.707891:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.708276:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.709244:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232795520:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1782759395.709900:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759395.709909:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.709916:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759395.709920:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759395.709928:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.709960:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.709967:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759395.710003:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710012:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5400/0xd5b45c7f5c60ba7b lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba82 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710029:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759395.710032:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710038:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759395.710042:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 5/0,0 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759395.710050:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 5/0,0 mode: EX/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710073:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 4/0,0 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710080:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759395.710085:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5200/0xd5b45c7f5c60ba5f lrc: 3/0,0 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba66 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710092:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759395.710094:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759395.710096:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759395.710145:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232795776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759395.710197:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.710238:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759395.710244:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232795648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759395.710265:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.710296:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232795776 00000100:00100000:1.0:1782759395.710302:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232795776 00000100:00100000:1.0:1782759395.710340:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232795648 00000100:00100000:1.0:1782759395.710343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232795648 00000100:00100000:1.0:1782759395.710371:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1782759395.710380:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3665:x1869355232795776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759395.710392:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759395.710420:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60ba66 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba5f expref: 11 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.710435:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x11:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:1.0:1782759395.710444:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759395.710567:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1782759395.710613:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3665:x1869355232795648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.710623:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759395.710636:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ba82 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba7b expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.710648:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:2.0:1782759395.710655:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759395.710683:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3665:x1869355232795648:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.710690:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1782759395.710777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3665:x1869355232795776:12345-0@lo:103:ldlm_bl.0 Request processed in 397us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.710783:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1782759395.710814:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232795648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759395.710823:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232795776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.711074:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759395.711081:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.711088:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759395.711092:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759395.711099:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.711121:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 4/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.711127:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759395.711156:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60ba43 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60ba4a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.711164:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.711166:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.711167:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759395.711204:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759395.711214:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232795904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759395.711241:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.711304:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232795904 00000100:00100000:3.0:1782759395.711308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232795904 00000100:00100000:3.0:1782759395.711342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1782759395.711349:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3663:x1869355232795904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.711357:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.711369:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60ba4a lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba43 expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.711386:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ff100) 00010000:00010000:3.0:1782759395.711391:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.711424:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3663:x1869355232795904:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.711430:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1782759395.711455:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232795904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.712264:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759395.722777:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218446208 00000100:00100000:3.0:1782759395.722791:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218446208 00000100:00100000:3.0:1782759395.722903:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2613 00000100:00100000:3.0:1782759395.722916:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103042:x1869355218446208:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:3.0:1782759395.723077:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.723099:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.723113:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.723127:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.723139:0:8593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60ba58 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ba51 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.723148:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.723211:0:8593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60ba58 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ba51 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.723232:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232796032:0@lo:104: 00000100:00100000:3.0:1782759395.723300:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.723354:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.723670:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232796032:0@lo:104: 00010000:00010000:3.0:1782759395.723688:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.724054:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759395.724068:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232796160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759395.724107:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.724195:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796160 00000100:00100000:2.0:1782759395.724200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796160 00010000:00010000:2.0:1782759395.724230:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60ba58 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ba51 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.724291:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1782759395.724298:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec398d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232796160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.724311:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1782759395.727300:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967648 is committed 00010000:00010000:3.0:1782759395.727844:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.727853:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.728063:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232796160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.728410:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728421:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728430:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759395.728448:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c39eb5f8 reply state 000000009141c98b transno 4294967649 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728461:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728482:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:3.0:1782759395.728485:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759395.728488:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759395.728497:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0xe:0x0]: returning size 4096 00010000:00010000:3.0:1782759395.728507:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728515:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728521:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728528:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728534:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.728538:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728558:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728567:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3bb00) 00010000:00010000:3.0:1782759395.728569:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.728574:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728601:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60ba89 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759395.728617:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c39eb5f8 reply state 000000009141c98b transno 4294967649 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728631:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.728637:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:3.0:1782759395.728639:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759395.728641:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782759395.728735:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103042:x1869355218446208:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 5820us (6096us total) trans 4294967649 rc 0/0 00000100:00100000:3.0:1782759395.728743:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2613 00000100:00100000:3.0:1782759395.745036:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:0.0:1782759395.746262:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746281:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746288:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746296:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746303:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.746308:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746316:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746331:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2500) 00010000:00010000:0.0:1782759395.746334:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.746339:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746346:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60baa5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746359:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746366:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746372:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746383:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.746386:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746392:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746400:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:0.0:1782759395.746402:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.746404:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746410:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60baac lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746435:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60ba9e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746458:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.746523:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:0.0:1782759395.746526:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759395.746529:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dcc00, rc 0) 00000100:00100000:0.0:1782759395.746684:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103043:x1869355218446336:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1265us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.746693:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2614 00000100:00100000:2.0:1782759395.749832:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.749897:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218446592 00000100:00100000:3.0:1782759395.749907:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218446592 00000100:00100000:3.0:1782759395.749982:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2615 00000100:00100000:3.0:1782759395.749991:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103043:x1869355218446592:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:3.0:1782759395.750120:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796288:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782759395.751855:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.751911:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.751922:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796288 00000100:00100000:1.0:1782759395.751933:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796288 00000100:00100000:1.0:1782759395.752003:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:1.0:1782759395.752014:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6531:x1869355232796288:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.752118:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6531:x1869355232796288:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.752126:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:3.0:1782759395.752160:0:6531:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967648 gen 2 00000004:00080000:3.0:1782759395.752166:0:6531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967648 committed transno 4294967648 00000100:00100000:3.0:1782759395.752211:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796288:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782759395.752269:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796416:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782759395.752303:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.752327:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.752359:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796416 00000100:00100000:1.0:1782759395.752364:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796416 00000100:00100000:1.0:1782759395.752397:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:1.0:1782759395.752406:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6531:x1869355232796416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.752535:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6531:x1869355232796416:12345-0@lo:1000:mdt00_000.0 Request processed in 131us (232us total) trans 0 rc 1/1 00000100:00100000:3.0:1782759395.752595:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796416:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782759395.752652:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782759395.752681:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.752694:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.752705:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796544 00000100:00100000:3.0:1782759395.752708:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796544 00000100:00100000:3.0:1782759395.752726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:3.0:1782759395.752733:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6531:x1869355232796544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.752744:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:3.0:1782759395.752790:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6531:x1869355232796544:12345-0@lo:1000:mdt00_000.0 Request processed in 56us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.752797:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1782759395.752820:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796544:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1782759395.752881:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.752892:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.752903:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.752918:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796672:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1782759395.752953:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.752971:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.753016:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796672 00000100:00100000:2.0:1782759395.753022:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796672 00000100:00100000:2.0:1782759395.753066:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:2.0:1782759395.753075:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6531:x1869355232796672:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1782759395.753087:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.753103:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bac1 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60baba expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753127:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bac1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60baba expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753140:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bac1 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60baba expref: 6 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753149:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:2.0:1782759395.753152:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.753155:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759395.753191:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6531:x1869355232796672:12345-0@lo:101:mdt00_000.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.753197:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:1.0:1782759395.753231:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796672:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1782759395.753245:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.753254:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759395.753265:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759395.753279:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.753283:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.753288:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.753300:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796800:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1782759395.753316:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.753332:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.753368:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796800 00000100:00100000:2.0:1782759395.753373:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796800 00000100:00100000:2.0:1782759395.753411:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:2.0:1782759395.753419:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6531:x1869355232796800:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1782759395.753427:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.753439:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bac8 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753465:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 2/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753474:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 4/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753488:0:6536:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1782759395.753513:0:6536:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:2.0:1782759395.753565:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 3/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753572:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:2.0:1782759395.753589:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.753593:0:6536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 3/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.753601:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759395.753642:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232796800:12345-0@lo:101:mdt00_000.0 Request processed in 224us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.753662:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00000100:00100000:0.0:1782759395.753705:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232796800:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1782759395.753743:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.753757:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759395.756174:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967649 is committed 00010000:00010000:3.0:1782759395.756226:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756240:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756248:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756255:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.756259:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756268:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756285:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:3.0:1782759395.756288:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.756294:0:3649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756322:0:3649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756330:0:3649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756378:0:3649:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.756393:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3649:1869355232796928:0@lo:105: 00000100:00100000:3.0:1782759395.756459:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.756503:0:3649:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.756568:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232796928 00000100:00100000:2.0:1782759395.756614:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232796928 00000100:00100000:2.0:1782759395.756664:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1782759395.756673:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3649:x1869355232796928:12345-0@lo:105: 00010000:00010000:2.0:1782759395.756684:0:18645:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 5/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.756695:0:18645:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 5/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.756704:0:18645:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 5/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.756711:0:18645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 5/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.756718:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 6/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.756726:0:18645:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 6/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.756755:0:18645:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc5428600) 00000100:00100000:2.0:1782759395.756800:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3649:x1869355232796928:12345-0@lo:105: Request processed in 127us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.756809:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00010000:00010000:1.0:1782759395.756825:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.756837:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.756844:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3649:1869355232796928:0@lo:105: 00000004:00080000:1.0:1782759395.756865:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:3.0:1782759395.756873:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759395.756877:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:3.0:1782759395.756887:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ba90 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756902:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756909:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.756914:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232797056:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1782759395.756927:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756944:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.756948:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.756951:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759395.756961:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756973:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:3.0:1782759395.756976:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759395.756977:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1782759395.756979:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.756985:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ba97 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.757001:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232797056 00000100:00100000:2.0:1782759395.757006:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232797056 00000100:00100000:2.0:1782759395.757051:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:2.0:1782759395.757058:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232797056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759395.757139:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232797056:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.757146:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00100000:1.0:1782759395.757178:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232797056:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.757221:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232797184:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.757244:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.757263:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.757284:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232797184 00000100:00100000:2.0:1782759395.757288:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232797184 00000100:00100000:2.0:1782759395.757314:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:2.0:1782759395.757321:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232797184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759395.757371:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232797184:12345-0@lo:1000:mdt00_000.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.757378:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:1.0:1782759395.757389:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232797184:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.757422:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232797312:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759395.757444:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.757460:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.757482:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232797312 00000100:00100000:2.0:1782759395.757487:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232797312 00000100:00100000:2.0:1782759395.757519:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:2.0:1782759395.757525:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232797312:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759395.757671:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232797312:12345-0@lo:1000:mdt00_000.0 Request processed in 146us (226us total) trans 0 rc 1/1 00000100:00100000:2.0:1782759395.757679:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:1.0:1782759395.757724:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232797312:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1782759395.757748:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759395.757763:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.757772:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.757778:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.757806:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782759395.757813:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759395.757817:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.757825:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.757832:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.757848:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782759395.757861:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782759395.757871:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.757875:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759395.757883:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.757885:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428200 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759395.757893:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.757895:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759395.757902:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759395.757907:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.757909:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103043:x1869355218446592:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 7916us (8083us total) trans 0 rc -66/-66 00000004:00010000:3.0:1782759395.757912:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.757924:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2615 00010000:00010000:3.0:1782759395.757951:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.757955:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.757964:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759395.757975:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759395.757997:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.757999:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.758014:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428600/0xd5b45c7f5c60bac8 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bacf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.758017:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428200/0xd5b45c7f5c60baba lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bac1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.758028:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232797568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.758050:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.758054:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759395.758054:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759395.758058:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759395.758063:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759395.758066:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759395.758071:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759395.758080:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232797440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759395.758090:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232797568 00000100:00100000:0.0:1782759395.758095:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232797568 00000100:00100000:0.0:1782759395.758137:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1782759395.758147:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232797568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759395.758158:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759395.758174:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bac1 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60baba expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.758178:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759395.758193:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:0.0:1782759395.758203:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759395.758229:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232797440 00000100:00100000:2.0:1782759395.758234:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232797440 00000100:00100000:0.0:1782759395.758245:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232797568:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.758253:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1782759395.758260:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232797568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759395.758274:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1782759395.758285:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355232797440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759395.758294:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759395.758305:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bacf lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bac8 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.758330:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc24d2f00) 00010000:00010000:0.0:1782759395.758341:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759395.758376:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232797440:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.758383:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1782759395.758554:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232797440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759395.767654:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.767730:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218446848 00000100:00100000:1.0:1782759395.767740:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218446848 00000100:00100000:1.0:1782759395.767810:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2616 00000100:00100000:1.0:1782759395.767822:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103043:x1869355218446848:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759395.767969:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.767986:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.767997:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768009:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768016:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768022:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768067:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768078:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768087:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 4/0,1 mode: --/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768119:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.768145:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 6 pid: 42628 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.768160:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232797696:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759395.768233:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494af00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.774449:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.774702:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232797696:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759395.774732:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.774830:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218446976 00000100:00100000:0.0:1782759395.774836:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218446976 00010000:00010000:0.0:1782759395.774869:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 7 pid: 42628 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.774916:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 700 00000100:00100000:0.0:1782759395.774923:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218446976:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759395.774934:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759395.774939:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 7 pid: 42628 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.774947:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 7 pid: 42628 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.774963:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bab3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2714d expref: 7 pid: 42628 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.774974:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:0.0:1782759395.774978:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: --/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.774984:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.774989:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.775012:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759395.775039:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.775049:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.775058:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218446976:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 135us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.775064:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 700 00000040:00080000:1.0:1782759395.775920:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].24, 2216 off57128 00000040:00080000:1.0:1782759395.775992:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].24, 2360 off59904 00000004:00080000:1.0:1782759395.776002:0:6533:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc494af00 with version 50 00000004:00080000:3.0:1782759395.776632:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 50 rpc_version 50 00000020:00100000:3.0:1782759395.776668:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759395.776677:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4437480 x1869355232797952/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759395.776696:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232797952:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759395.776751:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.776782:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.777011:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232797952 00000100:00100000:2.0:1782759395.777017:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232797952 00000100:00100000:2.0:1782759395.777077:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:2.0:1782759395.777086:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232797952:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759395.777532:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232797952:12345-0@lo:1000:osp_up0-1.0 Request processed in 447us (779us total) trans 4294967938 rc 0/0 00000100:00100000:2.0:1782759395.777550:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:3.0:1782759395.777625:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232797952:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1782759395.778203:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0xf:0x0]: returning size 4096 00000004:00010000:0.0:1782759395.778219:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9495b18 reply state 0000000089371a8c transno 4294967650 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778234:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778240:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:0.0:1782759395.778242:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00000100:00100000:0.0:1782759395.778244:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759395.778250:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778255:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778259:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778263:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778266:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.778269:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778274:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778280:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe800) 00010000:00010000:0.0:1782759395.778281:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.778283:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778292:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bad6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759395.778307:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9495b18 reply state 0000000089371a8c transno 4294967650 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778311:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.778315:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fe600) 00010000:00010000:0.0:1782759395.778316:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759395.778318:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1782759395.778372:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103043:x1869355218446848:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 10552us (10725us total) trans 4294967650 rc 0/0 00000100:00100000:0.0:1782759395.778379:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2616 00000100:00100000:2.0:1782759395.786266:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.786327:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218447104 00000100:00100000:3.0:1782759395.786336:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218447104 00000100:00100000:3.0:1782759395.786408:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2617 00000100:00100000:3.0:1782759395.786418:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103044:x1869355218447104:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1782759395.786440:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.786459:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60baeb lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27154 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786515:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786528:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786549:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786560:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786566:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786570:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786818:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bb00 lrc: 3/1,0 mode: --/PR res: [0x240000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786825:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bb00 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786829:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bb00 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.786901:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0xf:0x0]: returning size 4096 00000004:00200000:3.0:1782759395.786917:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1782759395.786934:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bb00 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786942:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786947:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786951:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786955:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786959:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.786962:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786967:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786975:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3bb00) 00010000:00010000:3.0:1782759395.786977:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.786979:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.786983:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60baf2 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787001:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787006:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787009:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787013:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.787015:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787018:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787024:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fe600) 00010000:00010000:3.0:1782759395.787025:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.787027:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787030:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60baf9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787045:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60baeb lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27154 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787055:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bb00 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xf:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27154 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.787067:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xf:0x0].0x0 (ffff8cded3a3b300) 00010000:00010000:3.0:1782759395.787069:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759395.787071:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759395.787117:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103044:x1869355218447104:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 701us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.787121:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2617 00000100:00100000:2.0:1782759395.789886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.789943:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218447232 00000100:00100000:0.0:1782759395.789952:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218447232 00000100:00100000:0.0:1782759395.790000:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2618 00000100:00100000:0.0:1782759395.790010:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103044:x1869355218447232:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:0.0:1782759395.790028:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759395.790046:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb07 lrc: 2/0,0 mode: --/CR res: [0x240000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2715b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.790093:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 3/1,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.790105:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.790131:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759395.790168:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0xe:0x0]: returning size 4096 00000004:00200000:0.0:1782759395.790187:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1782759395.790220:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb07 lrc: 0/0,0 mode: --/CR res: [0x240000405:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.790239:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.790247:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:0.0:1782759395.790250:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759395.790254:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759395.790348:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103044:x1869355218447232:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 339us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.790356:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2618 00010000:00010000:1.0:1782759395.790380:0:7474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7474 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790392:0:7474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790401:0:7474:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790491:0:7474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790611:0:7474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790620:0:7474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790627:0:7474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.790632:0:7474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790639:0:7474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790650:0:7474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:1.0:1782759395.790653:0:7474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759395.790657:0:7474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 2/0,0 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.790663:0:7474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb15 lrc: 0/0,0 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7474 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.791922:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.791980:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218447360 00000100:00100000:3.0:1782759395.791986:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218447360 00000100:00100000:3.0:1782759395.792041:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2619 00000100:00100000:3.0:1782759395.792048:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103044:x1869355218447360:12345-192.168.202.31@tcp:101:rmdir.0 00010000:00010000:3.0:1782759395.792062:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.792075:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bb1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27162 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.792115:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.792125:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.792136:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.792175:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1782759395.792189:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782759395.792223:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bb1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792252:0:6556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.792254:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792273:0:6556:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.792284:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cded3a3bd00) 00010000:00010000:1.0:1782759395.792284:0:6556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.792291:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759395.792297:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00010000:00010000:1.0:1782759395.792365:0:6556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792378:0:6556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792384:0:6556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792389:0:6556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.792393:0:6556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792399:0:6556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792408:0:6556:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cded3a3bd00) 00010000:00010000:1.0:1782759395.792410:0:6556:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759395.792413:0:6556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.792418:0:6556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb2a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6556 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.792738:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103044:x1869355218447360:12345-192.168.202.31@tcp:101:rmdir.0 Request processed in 688us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.792746:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2619 00000100:00100000:2.0:1782759395.795165:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.796795:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218447616 00000100:00100000:0.0:1782759395.796808:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218447616 00000100:00100000:0.0:1782759395.796868:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2620 00000100:00100000:0.0:1782759395.796879:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103044:x1869355218447616:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:0.0:1782759395.796929:0:42628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759395.796956:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bb00 lrc: 0/0,0 mode: --/PR res: [0x240000405:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27154 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.796974:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xf:0x0].0x0 (ffff8cded3a3b300) 00010000:00010000:0.0:1782759395.796998:0:42628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759395.797020:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797032:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797042:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797052:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797058:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797061:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797117:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 3/0,1 mode: --/EX res: [0x240000405:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797121:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797125:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797136:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797142:0:42628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797156:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 4/0,1 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797180:0:42628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.797189:0:42628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 8 pid: 6532 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.797199:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:42628:1869355232798080:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759395.797265:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc35139c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.800724:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.800725:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:42628:1869355232798080:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759395.800748:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.801060:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218447744 00000100:00100000:1.0:1782759395.801067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218447744 00010000:00010000:1.0:1782759395.801101:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 9 pid: 6532 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.801139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 701 00000100:00100000:1.0:1782759395.801149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218447744:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759395.801163:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759395.801184:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 9 pid: 6532 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.801196:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 9 pid: 6532 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.801218:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bb0e lrc: 0/0,0 mode: --/PR res: [0x240000405:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2715b expref: 9 pid: 6532 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.801233:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:1.0:1782759395.801238:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.801248:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.801255:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.801282:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759395.801342:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.801353:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.801370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218447744:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 221us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.801379:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 701 00010000:00010000:3.0:1782759395.801397:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.801406:0:42628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.801415:0:42628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.801433:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:42628:1869355232798208:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1782759395.801473:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.801500:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.801520:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232798208 00000100:00100000:0.0:1782759395.801526:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232798208 00000100:00100000:0.0:1782759395.801620:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:0.0:1782759395.801630:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:42628:x1869355232798208:12345-0@lo:101:mdt00_005.0 00010000:00010000:0.0:1782759395.801651:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759395.801663:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bb4d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.801684:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.801706:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.801727:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.801739:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 8 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.801747:0:6537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6537:1869355232798336:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759395.801784:0:6537:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc35139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.803475:0:6537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6537:1869355232798336:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759395.803502:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.803513:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cded3a3bd00) 00010000:00010000:0.0:1782759395.803516:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759395.803519:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.803525:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.803530:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759395.803691:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:42628:x1869355232798208:12345-0@lo:101:mdt00_005.0 Request processed in 2062us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.803710:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1782759395.804964:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:42628:1869355232798208:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1782759395.804996:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.805008:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.805091:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.805154:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218447872 00000100:00100000:1.0:1782759395.805160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218447872 00010000:00010000:1.0:1782759395.805186:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 9 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.805212:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 702 00000100:00100000:1.0:1782759395.805218:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218447872:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759395.805233:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759395.805238:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 9 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.805246:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 9 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.805260:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bb23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27162 expref: 9 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.805270:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cded3a3bd00) 00010000:00010000:1.0:1782759395.805273:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.805281:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.805286:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.805307:0:6516:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.805317:0:6516:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6516:1869355232798464:0@lo:105: 00000100:00100000:1.0:1782759395.805349:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.805382:0:6516:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.805435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232798464 00000100:00100000:2.0:1782759395.805438:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232798464 00000100:00100000:2.0:1782759395.805471:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1782759395.805476:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6516:x1869355232798464:12345-0@lo:105: 00010000:00010000:2.0:1782759395.805482:0:6514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.805489:0:6514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.805494:0:6514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 5/0,1 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.805499:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.805503:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.805507:0:6514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 6/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.805529:0:6514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc3de4600) 00000100:00100000:1.0:1782759395.805628:0:6516:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6516:1869355232798464:0@lo:105: 00010000:00010000:1.0:1782759395.805660:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759395.805704:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218447872:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 483us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.805714:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 702 00000100:00100000:2.0:1782759395.808636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:6516:x1869355232798464:12345-0@lo:105: Request processed in 92us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.808651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00010000:00010000:0.0:1782759395.808881:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.808896:0:42628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.809642:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:42628:1869355232798592:0@lo:403:mdt00_005.0 00000100:00100000:0.0:1782759395.809699:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.809725:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc35139c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.811732:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232798592 00000100:00100000:1.0:1782759395.811745:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232798592 00000100:00100000:1.0:1782759395.811820:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:1.0:1782759395.811831:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:42628:x1869355232798592:12345-0@lo:403:mdt00_005.0 00000100:00100000:1.0:1782759395.814289:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:42628:x1869355232798592:12345-0@lo:403:mdt00_005.0 Request processed in 2454us (4583us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.814303:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:0.0:1782759395.814326:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:42628:1869355232798592:0@lo:403:mdt00_005.0 00000040:00080000:1.0:1782759395.815517:0:42628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].25, 656 off57784 00000040:00080000:1.0:1782759395.815744:0:42628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].25, 736 off60640 00000004:00080000:1.0:1782759395.815751:0:42628:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc494a0c0 with version 51 00000004:00080000:3.0:1782759395.815800:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 51 rpc_version 51 00000020:00100000:3.0:1782759395.815829:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759395.815838:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4437800 x1869355232798848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759395.815861:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232798848:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759395.815911:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.815952:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.815966:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232798848 00000100:00100000:0.0:1782759395.815975:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232798848 00000100:00100000:0.0:1782759395.816091:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:0.0:1782759395.816106:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232798848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759395.816887:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232798848:12345-0@lo:1000:osp_up0-1.0 Request processed in 781us (972us total) trans 4294967939 rc 0/0 00000100:00100000:0.0:1782759395.816896:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1782759395.816912:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232798848:0@lo:1000:osp_up0-1.0 00000004:00200000:1.0:1782759395.817492:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0xf:0x0]: returning size 4096 00010000:00010000:1.0:1782759395.817514:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817521:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817527:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817530:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.817533:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817538:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817607:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:1.0:1782759395.817611:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782759395.817617:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 2/0,0 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817624:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60bb46 lrc: 0/0,0 mode: --/EX res: [0x240000405:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817640:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817649:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817656:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817672:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782759395.817680:0:42628:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x5:0x0] 00010000:00010000:1.0:1782759395.817688:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817694:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 2/0,0 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817700:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817705:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.817708:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 3/0,0 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817732:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 4/0,0 mode: EX/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817740:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xf:0x0].0x0 (ffff8cddc24d2500) 00010000:00010000:1.0:1782759395.817743:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782759395.817746:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 2/0,0 mode: --/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817752:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bb3f lrc: 0/0,0 mode: --/EX res: [0x240000405:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817780:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817786:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817792:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817798:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817803:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.817806:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817811:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817818:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:1.0:1782759395.817826:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.817829:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817836:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bb31 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759395.817851:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e09444e reply state 00000000da7eceeb transno 4294967651 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817863:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.817869:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fe600) 00010000:00010000:1.0:1782759395.817871:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759395.817875:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759395.817939:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103044:x1869355218447616:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 21061us (22780us total) trans 4294967651 rc 0/0 00000100:00100000:1.0:1782759395.817947:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2620 00010000:00010000:0.0:1782759395.818217:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759395.818223:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.818231:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759395.818235:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759395.818254:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.818284:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.818290:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759395.818325:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 1/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.818334:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4600/0xd5b45c7f5c60bb4d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb54 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.818350:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759395.818353:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759395.818354:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1782759395.818356:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759395.818372:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232798976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759395.818416:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.818697:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232798976 00000100:00100000:2.0:1782759395.818704:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232798976 00000100:00100000:2.0:1782759395.818746:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1782759395.818754:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3663:x1869355232798976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759395.818766:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759395.818781:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bb54 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb4d expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.818794:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5:0x0].0x0 (ffff8cded3a3bd00) 00010000:00010000:2.0:1782759395.818800:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759395.818834:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3663:x1869355232798976:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.818840:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1782759395.818919:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232798976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759395.833790:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.833879:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218448128 00000100:00100000:1.0:1782759395.833889:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218448128 00000100:00100000:1.0:1782759395.834013:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2621 00000100:00100000:1.0:1782759395.834025:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103045:x1869355218448128:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759395.834046:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.834067:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb5b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27169 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759395.834165:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1782759395.834276:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb5b lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27169 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.834306:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fe500) 00010000:00010000:1.0:1782759395.834316:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759395.834322:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bb5b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27169 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.834342:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759395.834400:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103045:x1869355218448128:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 378us (616us total) trans 4294967940 rc 301/301 00000100:00100000:1.0:1782759395.834408:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2621 00000100:00100000:3.0:1782759395.839762:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.839905:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218448384 00000100:00100000:0.0:1782759395.839916:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218448384 00000100:00100000:0.0:1782759395.839979:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 305 00000100:00100000:0.0:1782759395.840630:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103045:x1869355218448384:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759395.840837:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103045:x1869355218448384:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 211us (1083us total) trans 4294967941 rc 0/0 00000100:00100000:0.0:1782759395.840845:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 305 00000100:00100000:2.0:1782759395.843362:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.843496:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218448640 00000100:00100000:1.0:1782759395.843504:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218448640 00000100:00100000:1.0:1782759395.843558:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5 00000100:00100000:1.0:1782759395.843566:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103045:x1869355218448640:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759395.843639:0:6546:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759395.843644:0:6546:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60b795) 00010000:00010000:1.0:1782759395.843647:0:6546:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759395.843690:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.843698:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.843705:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.843720:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799104:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1782759395.843757:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.843799:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.843813:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799104 00000100:00100000:2.0:1782759395.843817:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799104 00000100:00100000:2.0:1782759395.843872:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:2.0:1782759395.843880:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6546:x1869355232799104:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:2.0:1782759395.843894:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759395.843907:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60bb70 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bb69 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.843941:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60bb70 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb69 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.843955:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60bb70 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb69 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.843964:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cddc34ff500) 00010000:00010000:2.0:1782759395.843966:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.843969:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648a00, rc 0) 00000100:00100000:2.0:1782759395.844005:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6546:x1869355232799104:12345-0@lo:101:mdt_io00_002.0 Request processed in 126us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.844011:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00000100:00100000:1.0:1782759395.844100:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799104:0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1782759395.844117:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844128:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759395.844145:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1782759395.844222:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844237:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844245:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844257:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844264:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844271:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844285:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844292:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844308:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844330:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844337:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.844345:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.844357:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799232:0@lo:101:mdt_io00_002.0 00000100:00100000:1.0:1782759395.844384:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.844407:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.844409:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799232 00000100:00100000:0.0:1782759395.844414:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799232 00000100:00100000:1.0:1782759395.846385:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1782759395.846398:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6546:x1869355232799232:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1782759395.846416:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.846437:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bb93 lrc: 2/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bb8c expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.846465:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bb93 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb8c expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.846478:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bb93 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb8c expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.846488:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:1.0:1782759395.846504:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 24 00010000:00010000:1.0:1782759395.846508:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429400, rc 0) 00000100:00100000:1.0:1782759395.846627:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799232:12345-0@lo:101:mdt_io00_002.0 Request processed in 230us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.846635:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:3.0:1782759395.846863:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799232:0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1782759395.846882:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.846893:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759395.846925:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0xc:0x0] 00000100:00100000:3.0:1782759395.846967:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799360:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759395.847017:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.847041:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.847423:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799360 00000100:00100000:1.0:1782759395.847430:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799360 00000100:00100000:1.0:1782759395.847481:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:1.0:1782759395.847489:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799360:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.847596:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799360:12345-0@lo:1000:mdt_io00_002.0 Request processed in 87us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.847605:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000100:00100000:0.0:1782759395.847634:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799360:0@lo:1000:mdt_io00_002.0 00000004:00080000:0.0:1782759395.847658:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0xc:0x0] 00000100:00100000:0.0:1782759395.847697:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799488:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.847727:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.847746:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.847812:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799488 00000100:00100000:3.0:1782759395.847816:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799488 00000100:00100000:3.0:1782759395.847855:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:3.0:1782759395.847862:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799488:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759395.847922:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799488:12345-0@lo:1000:mdt_io00_002.0 Request processed in 60us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.847928:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00000100:00100000:0.0:1782759395.848053:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799488:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.848149:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799616:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.848173:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.848192:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.848219:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799616 00000100:00100000:2.0:1782759395.848236:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799616 00000100:00100000:2.0:1782759395.848311:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:2.0:1782759395.848320:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799616:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.848378:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799616:12345-0@lo:1000:mdt_io00_002.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.848385:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:0.0:1782759395.848651:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799616:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.848705:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799744:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.848729:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.848780:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.848817:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799744 00000100:00100000:3.0:1782759395.848822:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799744 00000100:00100000:3.0:1782759395.848850:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:3.0:1782759395.848856:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799744:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759395.848951:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799744:12345-0@lo:1000:mdt_io00_002.0 Request processed in 94us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.848957:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:0.0:1782759395.849054:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799744:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.849089:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799872:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.849109:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.849126:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.849153:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232799872 00000100:00100000:2.0:1782759395.849158:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232799872 00000100:00100000:2.0:1782759395.849191:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:2.0:1782759395.849198:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799872:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.849387:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232799872:12345-0@lo:1000:mdt_io00_002.0 Request processed in 189us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.849395:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1782759395.849436:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232799872:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.849665:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800000:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.849691:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.849748:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.849824:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800000 00000100:00100000:3.0:1782759395.849829:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800000 00000100:00100000:3.0:1782759395.849862:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:3.0:1782759395.849870:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232800000:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759395.849968:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232800000:12345-0@lo:1000:mdt_io00_002.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.849975:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:0.0:1782759395.850084:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800000:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.850114:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800128:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.850137:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.850155:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.850183:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800128 00000100:00100000:2.0:1782759395.850188:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800128 00000100:00100000:2.0:1782759395.850222:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:2.0:1782759395.850411:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232800128:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.850475:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232800128:12345-0@lo:1000:mdt_io00_002.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.850482:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:0.0:1782759395.851671:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800128:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.851722:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800256:0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.851756:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.851779:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.851792:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800256 00000100:00100000:3.0:1782759395.851796:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800256 00000100:00100000:3.0:1782759395.851837:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:3.0:1782759395.851845:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232800256:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759395.851902:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6546:x1869355232800256:12345-0@lo:1000:mdt_io00_002.0 Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.851909:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00100000:0.0:1782759395.851935:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800256:0@lo:1000:mdt_io00_002.0 00000040:00080000:0.0:1782759395.852702:0:6546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].26, 2320 off60104 00000040:00080000:0.0:1782759395.852814:0:6546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].26, 2400 off63040 00000004:00080000:0.0:1782759395.852819:0:6546:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4bebcc0 with version 52 00000004:00080000:3.0:1782759395.852851:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 52 rpc_version 52 00000020:00100000:3.0:1782759395.852874:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759395.852881:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4437b80 x1869355232800512/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3712/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759395.852896:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232800512:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759395.852931:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.852957:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.853019:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800512 00000100:00100000:2.0:1782759395.853024:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800512 00000100:00100000:2.0:1782759395.853066:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:2.0:1782759395.853074:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7476:x1869355232800512:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759395.853290:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:7476:x1869355232800512:12345-0@lo:1000:osp_up0-1.0 Request processed in 217us (357us total) trans 4294967942 rc 0/0 00000100:00100000:2.0:1782759395.853295:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1782759395.853406:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232800512:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1782759395.853436:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0xc:0x0] 00010000:00010000:0.0:1782759395.853446:0:6546:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853457:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853465:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853492:0:6546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759395.853499:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853507:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853513:0:6546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853518:0:6546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.853529:0:6546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853537:0:6546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 4/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853564:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fe000) 00010000:00010000:0.0:1782759395.853567:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759395.853572:0:6546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 2/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853605:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bb85 lrc: 0/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853636:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853648:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853657:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853670:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853675:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853679:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853694:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853703:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.853710:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.853718:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800640:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1782759395.853737:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.853762:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.853780:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800640 00000100:00100000:1.0:1782759395.853785:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800640 00010000:00010000:3.0:1782759395.853810:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759395.853817:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 2/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.853825:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3022 00010000:00010000:3.0:1782759395.853827:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759395.853834:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.853846:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6546:x1869355232800640:12345-0@lo:101:mdt_io00_002.0 00000004:00010000:3.0:1782759395.853859:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.853867:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.853877:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 2/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.853882:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 2/0,0 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bba8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.853899:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759395.853924:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bba8 expref: 13 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.853925:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 1/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.853934:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232800768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.853944:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428c00/0xd5b45c7f5c60bb8c lrc: 0/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb93 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.853951:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bba8 expref: 13 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.853957:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.853960:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759395.853961:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:3.0:1782759395.853963:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759395.853967:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759395.853971:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759395.853988:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429600, rc 0) 00000100:00100000:1.0:1782759395.854023:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:6546:x1869355232800640:12345-0@lo:101:mdt_io00_002.0 Request processed in 190us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.854029:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3022 00000100:00100000:3.0:1782759395.854117:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800768 00000100:00100000:3.0:1782759395.854122:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800768 00000100:00100000:3.0:1782759395.854191:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1782759395.854199:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3663:x1869355232800768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.854207:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.854221:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bb93 lrc: 0/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x24/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb8c expref: 13 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.854232:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:3.0:1782759395.854235:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.854270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3663:x1869355232800768:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.854277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1782759395.854354:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001-mdtlov_UUID:6546:1869355232800640:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1782759395.854366:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854375:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759395.854387:0:6546:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b09184db reply state 00000000c2f7cc8a transno 4294967652 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854395:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854400:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759395.854402:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759395.854404:0:6546:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759395.854408:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854412:0:6546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759395.854426:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0xc:0x0] 00000004:00010000:0.0:1782759395.854431:0:6546:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b09184db reply state 00000000c2f7cc8a transno 4294967652 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854439:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854445:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:0.0:1782759395.854448:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759395.854449:0:6546:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1782759395.854457:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854463:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854469:0:6546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854475:0:6546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.854477:0:6546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854483:0:6546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854491:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34fed00) 00010000:00010000:0.0:1782759395.854493:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.854496:0:6546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854511:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bb77 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759395.854523:0:6546:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b09184db reply state 00000000c2f7cc8a transno 4294967652 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854532:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854538:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34fe100) 00010000:00010000:0.0:1782759395.854551:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759395.854553:0:6546:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00010000:00010000:0.0:1782759395.854562:0:6546:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.854568:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232800768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759395.854838:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854843:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.854856:0:6546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759395.854874:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759395.854879:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.854895:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759395.854899:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759395.854906:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.854915:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103045:x1869355218448640:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 11348us (11557us total) trans 4294967652 rc 0/0 00000100:00100000:0.0:1782759395.854921:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5 00010000:00010000:3.0:1782759395.854925:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.854930:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759395.854960:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.854969:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429800/0xd5b45c7f5c60bb69 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bb70 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.854982:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759395.855176:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232800896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759395.855210:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759395.855324:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.855328:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759395.855480:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232800896 00000100:00100000:1.0:1782759395.855485:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232800896 00000100:00100000:1.0:1782759395.855515:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1782759395.855520:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3664:x1869355232800896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759395.855527:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759395.855538:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60bb70 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bb69 expref: 12 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.855564:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cddc34ff500) 00010000:00010000:1.0:1782759395.855571:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759395.855629:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3664:x1869355232800896:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.855636:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1782759395.855748:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232800896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759395.858938:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.859351:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218448896 00000100:00100000:0.0:1782759395.859360:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218448896 00000100:00100000:0.0:1782759395.859409:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2622 00000100:00100000:0.0:1782759395.859432:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103045:x1869355218448896:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759395.859476:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759395.859498:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60bbb6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27170 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.859574:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.859617:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.859628:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859680:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859690:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859698:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759395.859852:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x10:0x0]: returning size 4096 00010000:00010000:2.0:1782759395.859922:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859930:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859935:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859941:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859946:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759395.859951:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859958:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859969:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2200) 00010000:00010000:2.0:1782759395.859972:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.859976:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.859982:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bbbd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860006:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860011:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860022:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860027:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759395.860030:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860037:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860044:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34fe100) 00010000:00010000:2.0:1782759395.860046:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.860049:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860055:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bbc4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860086:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60bbb6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27170 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860096:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2200) 00010000:00010000:2.0:1782759395.860098:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759395.860102:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60bbb6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27170 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.860117:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:2.0:1782759395.860178:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103045:x1869355218448896:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 760us (1250us total) trans 4294967653 rc 301/301 00000100:00100000:2.0:1782759395.860194:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2622 00000100:00100000:1.0:1782759395.863066:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.863159:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449024 00000100:00100000:3.0:1782759395.863169:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449024 00000100:00100000:3.0:1782759395.863227:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2623 00000100:00100000:3.0:1782759395.863238:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103045:x1869355218449024:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759395.863258:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.863272:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbd2 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27177 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.863334:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60bbd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.863348:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60bbd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.863359:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60bbd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.863401:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1782759395.863406:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782759395.863538:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbd2 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27177 expref: 14 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.863567:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60bbd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27177 expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.863613:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:3.0:1782759395.863617:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759395.863621:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5800, rc 0) 00000100:00100000:3.0:1782759395.863792:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103045:x1869355218449024:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 554us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.863801:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2623 00000100:00100000:0.0:1782759395.867144:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.867223:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449152 00000100:00100000:3.0:1782759395.867233:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449152 00000100:00100000:3.0:1782759395.867297:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2624 00000100:00100000:3.0:1782759395.867308:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103045:x1869355218449152:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759395.867359:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.867380:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bbe0 lrc: 2/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2717e expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.867439:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.867455:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 2/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bba8 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.867465:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 4/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.867510:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60bba8 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.867527:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232801024:0@lo:104: 00000100:00100000:3.0:1782759395.867602:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.867634:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801024 00000100:00100000:0.0:1782759395.867640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801024 00000100:00100000:3.0:1782759395.867676:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.867679:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:0.0:1782759395.867689:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6532:x1869355232801024:12345-0@lo:104: 00010000:00010000:0.0:1782759395.867702:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.867763:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759395.867770:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:6532:x1869355232801024:12345-0@lo:104: Request processed in 83us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.867777:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00010000:00010000:1.0:1782759395.867791:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759395.867800:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.867810:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759395.867816:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759395.867825:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.867860:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 2/0,0 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.867867:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759395.867893:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 1/0,0 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.867901:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dce00/0xd5b45c7f5c60bba8 lrc: 0/0,0 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bbaf expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.867918:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232801152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759395.867920:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759395.867923:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759395.867926:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759395.867951:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.868037:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232801024:0@lo:104: 00010000:00010000:3.0:1782759395.868054:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.868153:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801152 00000100:00100000:1.0:1782759395.868157:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801152 00010000:00010000:1.0:1782759395.868172:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bba8 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.868196:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1782759395.868200:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3665:x1869355232801152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759395.868207:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1782759395.870778:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967942 is committed 00000001:00080000:3.0:1782759395.870801:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967941 is committed 00000020:00080000:3.0:1782759395.870817:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc2700f00 refcount 2 committed 0 result 0 batchid 14 00000020:00080000:3.0:1782759395.870822:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc49d7e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc2700240 00000020:00080000:3.0:1782759395.870826:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].14 00000020:00080000:3.0:1782759395.870836:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc49d7400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cded8612400 00000020:00080000:3.0:1782759395.870839:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].14 00000020:00080000:3.0:1782759395.870861:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cded855c840 refcount 2 committed 0 result 0 batchid 13 00000020:00080000:3.0:1782759395.870865:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61fb00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc5787480 00000020:00080000:3.0:1782759395.870868:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].13 00000020:00080000:3.0:1782759395.870870:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4875c00 00000020:00080000:3.0:1782759395.870873:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].13 00000020:00080000:1.0:1782759395.870894:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 14 committed batchid 12 00010000:00010000:0.0:1782759395.870969:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782759395.870970:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12 00010000:00010000:2.0:1782759395.870988:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bbaf lrc: 0/0,0 mode: --/PW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60bba8 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871010:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.871016:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:0.0:1782759395.871018:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.871025:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871028:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.871035:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.871040:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.871050:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 4/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871051:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871065:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x11:0x0].0x0 (ffff8cded3a3bc00) 00010000:00010000:0.0:1782759395.871070:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.871074:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871081:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60b9e1 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.871091:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759395.871096:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871104:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871111:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871117:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.871128:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.871129:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871141:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.871144:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.871159:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8cded3a3b600) 00000100:00100000:2.0:1782759395.871166:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232801152:12345-0@lo:103:ldlm_bl.0 Request processed in 2961us (3211us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759395.871166:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.871171:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.871180:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00010000:00010000:0.0:1782759395.871180:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60b9e8 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.871198:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xc:0x0]: returning size 4096 00000100:00100000:1.0:1782759395.871203:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232801152:0@lo:103:ldlm_bl.0 00000004:00200000:3.0:1782759395.871207:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782759395.871249:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bbe0 lrc: 0/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2717e expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.871264:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2717e expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.871271:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:3.0:1782759395.871274:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759395.871276:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759395.871323:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218449152:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 4018us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.871330:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2624 00000100:00100000:2.0:1782759395.875905:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.875956:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449280 00000100:00100000:3.0:1782759395.875979:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449280 00000100:00100000:3.0:1782759395.876156:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2625 00000100:00100000:3.0:1782759395.876168:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103045:x1869355218449280:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759395.876189:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.876209:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbee lrc: 2/0,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27185 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.876297:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bbf5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.876312:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bbf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.876323:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bbf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.876403:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x10:0x0]: returning size 4096 00000004:00200000:3.0:1782759395.876423:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1782759395.876446:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bbf5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.876472:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27185 expref: 15 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.876490:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bbf5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27185 expref: 14 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.876500:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:3.0:1782759395.876503:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759395.876507:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759395.876621:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:103045:x1869355218449280:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 454us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.876628:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2625 00000100:00100000:1.0:1782759395.881843:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.881913:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449408 00000100:00100000:3.0:1782759395.881923:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449408 00000100:00100000:3.0:1782759395.881975:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 306 00000100:00100000:3.0:1782759395.881985:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:103045:x1869355218449408:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:3.0:1782759395.887991:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:103045:x1869355218449408:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 5997us (6146us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.888007:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 306 00000100:00100000:2.0:1782759395.892532:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.892649:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449536 00000100:00100000:0.0:1782759395.892659:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449536 00000100:00100000:0.0:1782759395.892715:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 307 00000100:00100000:0.0:1782759395.892726:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218449536:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759395.897105:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218449536:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 4369us (4570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.897134:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 307 00000100:00100000:1.0:1782759395.905067:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.905444:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449664 00000100:00100000:3.0:1782759395.905454:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449664 00000100:00100000:3.0:1782759395.905617:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2626 00000100:00100000:3.0:1782759395.905629:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218449664:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:3.0:1782759395.905697:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 3/1,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905724:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 3/1,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905738:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 3/1,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905754:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 3/1,0 mode: --/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905761:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905786:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905872:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/1,0 mode: --/PR res: [0x200000421:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905880:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905887:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759395.905935:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905949:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 4/1,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905956:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 4/1,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905962:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 3/0,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905969:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 4/0,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905975:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.905979:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 4/0,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.905986:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 5/0,0 mode: CR/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906006:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:3.0:1782759395.906008:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.906013:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 3/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906018:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bbfc lrc: 0/0,0 mode: --/CR res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906031:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906037:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906042:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906046:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.906049:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906055:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906062:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x1c8b5715 (ffff8cddc34f4f00) 00010000:00010000:3.0:1782759395.906064:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.906067:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 2/0,0 mode: --/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906072:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc03 lrc: 0/0,0 mode: --/PR res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906094:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906100:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 2/0,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906105:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906109:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.906112:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906117:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 4/0,0 mode: PR/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906123:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xd:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759395.906126:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.906128:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 2/0,0 mode: --/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.906133:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc0a lrc: 0/0,0 mode: --/PR res: [0x200000421:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.906206:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218449664:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 578us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.906213:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2626 00000100:00100000:2.0:1782759395.908281:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.908377:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218449920 00000100:00100000:1.0:1782759395.908385:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218449920 00000100:00100000:1.0:1782759395.908479:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2627 00000100:00100000:1.0:1782759395.908489:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218449920:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759395.908510:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.908529:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc11 lrc: 2/0,0 mode: --/CR res: [0x200000421:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2718c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.908654:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.908667:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.908678:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759395.908690:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0xd:0x0]: returning size 0 00010000:00010000:1.0:1782759395.908840:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc11 lrc: 0/0,0 mode: --/CR res: [0x200000421:0xd:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.908859:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.908868:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xd:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:1.0:1782759395.908871:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782759395.908887:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429200, rc 0) 00000100:00100000:1.0:1782759395.908944:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103045:x1869355218449920:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 456us (669us total) trans 4294967943 rc 0/0 00000100:00100000:1.0:1782759395.908952:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2627 00000100:00100000:1.0:1782759395.911514:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.911617:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218450048 00000100:00100000:2.0:1782759395.911626:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218450048 00000100:00080000:3.0:1782759395.911663:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759395.911694:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1027 00000100:00100000:2.0:1782759395.911706:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218450048:12345-192.168.202.31@tcp:1:lfs.0 00002000:00010000:2.0:1782759395.911774:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x6a42bfd9, atime: 0x6a42bfd9, ctime: 0x6a42bfd9, blocks: 0x0 00010000:00010000:2.0:1782759395.911784:0:82628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911813:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=3436s v=(0 0) 00010000:00010000:2.0:1782759395.911816:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759395.911821:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911832:0:82628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911845:0:82628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911850:0:82628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911857:0:82628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911864:0:82628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759395.911868:0:82628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911876:0:82628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911902:0:82628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.911915:0:82628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60bc26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.911992:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218450048:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 287us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.912000:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1027 00000100:00100000:2.0:1782759395.914364:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.914419:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.914510:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.914523:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218450176 00000100:00100000:3.0:1782759395.914531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218450176 00000100:00100000:0.0:1782759395.914568:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218450304 00000100:00100000:0.0:1782759395.914574:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218450304 00000100:00100000:0.0:1782759395.914639:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 369 00000100:00100000:0.0:1782759395.914649:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218450304:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:0.0:1782759395.914664:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759395.914688:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bbe7 lrc: 0/0,0 mode: --/PR res: [0x200000421:0xc:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2717e expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.914704:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34fee00) 00010000:00010000:0.0:1782759395.914713:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.914743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218450432 00000100:00100000:3.0:1782759395.914757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218450432 00000100:00100000:0.0:1782759395.914760:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218450304:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.914776:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 369 00000100:00100000:3.0:1782759395.915306:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 370 00000100:00100000:3.0:1782759395.915316:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2403:x1869355218450176:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:3.0:1782759395.915326:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.915340:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bbf5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27185 expref: 15 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.915353:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:3.0:1782759395.915356:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.915386:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2403:x1869355218450176:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 71us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.915393:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 370 00000100:00100000:3.0:1782759395.915408:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 371 00000100:00100000:3.0:1782759395.915415:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:2403:x1869355218450432:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:3.0:1782759395.915423:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.915434:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5800/0xd5b45c7f5c60bbd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27177 expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.915445:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:3.0:1782759395.915449:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759395.915470:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2403:x1869355218450432:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 56us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.915478:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 371 00000100:00100000:0.0:1782759395.915486:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759395.915532:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218450688 00000100:00100000:0.0:1782759395.915536:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218450688 00000100:00100000:3.0:1782759395.915616:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:3.0:1782759395.915631:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103045:x1869355218450688:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759395.915701:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.915714:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.915773:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.915855:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801280:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759395.915895:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.915923:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.915928:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801280 00000100:00100000:0.0:1782759395.915932:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801280 00000100:00100000:0.0:1782759395.916004:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023 00000100:00100000:0.0:1782759395.916010:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801280:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.916060:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801280:12345-0@lo:1000:mdt_io00_000.0 Request processed in 51us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.916064:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023 00000100:00100000:0.0:1782759395.916101:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801280:0@lo:1000:mdt_io00_000.0 00000004:00080000:0.0:1782759395.916136:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x10:0x0] 00000100:00100000:0.0:1782759395.916260:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801408:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.916279:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.916323:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded855ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.916568:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801408 00000100:00100000:3.0:1782759395.916573:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801408 00000100:00100000:3.0:1782759395.916624:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024 00000100:00100000:3.0:1782759395.916631:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801408:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759395.916693:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801408:12345-0@lo:1000:mdt_io00_000.0 Request processed in 62us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.916699:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024 00000100:00100000:0.0:1782759395.916714:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801408:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.917420:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801536:0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1782759395.917458:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.917494:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdee7f1a780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.917660:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801536 00000100:00100000:1.0:1782759395.917665:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801536 00000100:00100000:1.0:1782759395.917711:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:1.0:1782759395.917720:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801536:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1782759395.919434:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801536:12345-0@lo:403:mdt_io00_000.0 Request processed in 1706us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.919447:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00000100:00100000:3.0:1782759395.919534:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801536:0@lo:403:mdt_io00_000.0 00000100:00100000:3.0:1782759395.920908:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801664:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759395.920961:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.921009:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc27000c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.922111:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801664 00000100:00100000:2.0:1782759395.922121:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801664 00000100:00100000:2.0:1782759395.922191:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:2.0:1782759395.922201:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801664:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759395.922302:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801664:12345-0@lo:1000:mdt_io00_000.0 Request processed in 102us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.922310:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00100000:3.0:1782759395.922347:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801664:0@lo:1000:mdt_io00_000.0 00010000:00010000:3.0:1782759395.922415:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.922441:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.922456:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.922471:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801792:0@lo:101:mdt_io00_000.0 00000100:00100000:3.0:1782759395.922497:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.922527:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.922607:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801792 00000100:00100000:0.0:1782759395.922612:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801792 00000100:00100000:0.0:1782759395.922652:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3027 00000100:00100000:0.0:1782759395.922660:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232801792:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1782759395.922674:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759395.922693:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 2/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bc34 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.922712:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 2/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.922732:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 4/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.922746:0:6536:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:0.0:1782759395.922773:0:6536:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:0.0:1782759395.922814:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.922823:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759395.922826:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.922830:0:6536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.922838:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759395.922870:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6544:x1869355232801792:12345-0@lo:101:mdt_io00_000.0 Request processed in 211us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.922875:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3027 00000100:00100000:3.0:1782759395.922947:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232801792:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1782759395.922961:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.922969:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 4/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759395.925187:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967653 is committed 00010000:00010000:0.0:1782759395.925238:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925250:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925274:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925280:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.925284:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925293:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925303:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925311:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34fe100) 00010000:00010000:3.0:1782759395.925314:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925316:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.925322:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925325:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925337:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428a00/0xd5b45c7f5c60bb7e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925339:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.925344:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925363:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925371:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925374:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925381:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925388:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fe600) 00010000:00010000:0.0:1782759395.925389:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.925393:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.925395:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925398:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925408:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60badd lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925423:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925424:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925440:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925445:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:3.0:1782759395.925447:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925451:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.925457:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.925458:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925462:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925471:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bb9a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925473:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925491:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0xe:0x0].0x0 (ffff8cded3a3bf00) 00010000:00010000:3.0:1782759395.925494:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:3.0:1782759395.925497:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925500:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925521:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925522:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60bae4 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0xe:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925556:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925559:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925565:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.925569:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925571:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925608:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925619:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925620:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.925626:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925633:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759395.925639:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.925640:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925646:0:3648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 2/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 5 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925652:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fe600) 00010000:00010000:3.0:1782759395.925656:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.925659:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.925677:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bb38 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925684:0:3648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 5 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925706:0:3648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 5 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.925746:0:3648:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 5 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.925760:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3648:1869355232801920:0@lo:105: 00000100:00100000:0.0:1782759395.925825:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.925869:0:3648:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdee7f1a780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.925879:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232801920 00000100:00100000:2.0:1782759395.925888:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232801920 00000100:00100000:2.0:1782759395.925933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1782759395.925943:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:3648:x1869355232801920:12345-0@lo:105: 00010000:00010000:2.0:1782759395.925953:0:6514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.925964:0:6514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.925979:0:6514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 5/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.925986:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 5/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.926003:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.926012:0:6514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 6/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.926035:0:6514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc3de5600) 00010000:00010000:3.0:1782759395.926064:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.926075:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.926082:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:3648:x1869355232801920:12345-0@lo:105: Request processed in 139us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759395.926099:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000004:00080000:3.0:1782759395.926117:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0x5:0x0] 00010000:00010000:3.0:1782759395.926148:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.926155:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.926164:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.926179:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802048:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1782759395.926192:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0001_UUID:3648:1869355232801920:0@lo:105: 00010000:00010000:0.0:1782759395.926208:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.926216:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759395.926223:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bba1 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6546 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.926522:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802048 00000100:00100000:3.0:1782759395.926526:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.926528:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802048 00000100:00100000:1.0:1782759395.926692:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3028 00000100:00100000:1.0:1782759395.926711:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6544:x1869355232802048:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759395.926726:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.926741:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bc42 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.926760:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc42 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.926771:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc42 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.926778:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x1c8b5715 (ffff8cded88bf400) 00010000:00010000:1.0:1782759395.926781:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.926792:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759395.926849:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802048:12345-0@lo:101:mdt_io00_000.0 Request processed in 150us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.926856:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3028 00000100:00100000:3.0:1782759395.926962:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802048:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1782759395.926975:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.926984:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759395.926997:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0x5:0x0] 00010000:00010000:3.0:1782759395.927013:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 3/0,1 mode: --/CW res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927021:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927030:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927117:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,1 mode: --/PW res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927124:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927131:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927171:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: --/EX res: [0x200000421:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927183:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927190:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 4/0,1 mode: --/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927213:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.927225:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 7 pid: 6531 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.927236:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6544:1869355232802176:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759395.927321:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700180 going to sleep for 11 seconds 00010000:00010000:0.0:1782759395.929705:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@00000000cef79720 x1869355232802176) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 7 pid: 6531 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929722:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 7 pid: 6531 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929739:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60bc18 lrc: 0/0,0 mode: --/PW res: [0x200000421:0xd:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2718c expref: 7 pid: 6531 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.929766:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000_UUID:6544:1869355232802176:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759395.929781:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xd:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:0.0:1782759395.929784:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: --/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929791:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929796:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929808:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929815:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.929818:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.929940:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802304:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.929975:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.929998:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.930101:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802304 00000100:00100000:1.0:1782759395.930108:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802304 00000100:00100000:1.0:1782759395.930167:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1782759395.930177:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802304:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759395.930313:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802304:12345-0@lo:1000:mdt_io00_000.0 Request processed in 136us (335us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759395.930320:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00000100:00100000:0.0:1782759395.930740:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802304:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.930784:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802432:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.930805:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.930822:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdee7f1a780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.930900:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802432 00000100:00100000:1.0:1782759395.930904:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802432 00000100:00100000:1.0:1782759395.931047:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1782759395.931055:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802432:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759395.931225:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802432:12345-0@lo:1000:mdt_io00_000.0 Request processed in 171us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.931233:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00100000:0.0:1782759395.931256:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802432:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.931324:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802560:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.931344:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.931362:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded855ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.931381:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802560 00000100:00100000:1.0:1782759395.931386:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802560 00000100:00100000:1.0:1782759395.931420:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031 00000100:00100000:1.0:1782759395.931428:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802560:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759395.931495:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802560:12345-0@lo:1000:mdt_io00_000.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.931504:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031 00000100:00100000:0.0:1782759395.931519:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802560:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.931647:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802688:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.931671:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.931716:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.931876:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802688 00000100:00100000:3.0:1782759395.931879:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802688 00000100:00100000:3.0:1782759395.931905:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032 00000100:00100000:3.0:1782759395.931915:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802688:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759395.931987:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6544:x1869355232802688:12345-0@lo:1000:mdt_io00_000.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.931991:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032 00000100:00100000:0.0:1782759395.932024:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802688:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.932114:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802816:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.932132:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.932145:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.932171:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802816 00000100:00100000:1.0:1782759395.932176:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802816 00000100:00100000:1.0:1782759395.932220:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3033 00000100:00100000:1.0:1782759395.932228:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232802816:12345-0@lo:1000:mdt_io00_000.0 00000100:00080000:3.0:1782759395.932247:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759395.932331:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232802816:12345-0@lo:1000:mdt_io00_000.0 Request processed in 106us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.932337:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3033 00000100:00100000:0.0:1782759395.932439:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802816:0@lo:1000:mdt_io00_000.0 00000040:00080000:0.0:1782759395.932762:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].15, 1272 off48664 00000040:00080000:0.0:1782759395.932796:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].15, 1352 off50504 00000100:00100000:0.0:1782759395.932812:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802944:0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759395.932831:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.932847:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.932862:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232802944 00000100:00100000:3.0:1782759395.932867:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232802944 00000100:00100000:3.0:1782759395.932898:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3034 00000100:00100000:3.0:1782759395.932904:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6544:x1869355232802944:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759395.932990:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6544:x1869355232802944:12345-0@lo:1000:mdt_io00_000.0 Request processed in 86us (157us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1782759395.932997:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3034 00000100:00100000:0.0:1782759395.933018:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-mdtlov_UUID:6544:1869355232802944:0@lo:1000:mdt_io00_000.0 00000004:00080000:0.0:1782759395.933026:0:6544:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc4e97e40 with version 30 00000004:00080000:3.0:1782759395.933079:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 30 rpc_version 30 00000020:00100000:3.0:1782759395.933097:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759395.933105:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4bcd180 x1869355232803200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 3104/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759395.933119:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232803200:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782759395.933140:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.933155:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc27000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.933188:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232803200 00000100:00100000:1.0:1782759395.933194:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232803200 00000100:00100000:1.0:1782759395.933221:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:1.0:1782759395.933227:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7666:x1869355232803200:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759395.933996:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7666:x1869355232803200:12345-0@lo:1000:osp_up1-0.0 Request processed in 756us (840us total) trans 4294967654 rc 0/0 00000100:00100000:1.0:1782759395.934006:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00100000:3.0:1782759395.934056:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232803200:0@lo:1000:osp_up1-0.0 00000004:00010000:0.0:1782759395.934098:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073541b32 reply state 00000000c2cc3b1b transno 4294967944 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: EX/EX res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934120:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934135:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xd:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:0.0:1782759395.934138:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:0.0:1782759395.934142:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759395.934151:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934159:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934166:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934173:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934179:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.934184:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934192:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934201:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34f4d00) 00010000:00010000:0.0:1782759395.934204:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759395.934207:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 3/0,0 mode: --/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934212:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bc50 lrc: 0/0,0 mode: --/CW res: [0x200000421:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759395.934230:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073541b32 reply state 00000000c2cc3b1b transno 4294967944 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934249:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934256:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x1c8b5715 (ffff8cddc34f4400) 00010000:00010000:0.0:1782759395.934259:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759395.934260:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:0.0:1782759395.934265:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0x5:0x0] 00010000:00010000:0.0:1782759395.934274:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934281:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934289:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934316:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1782759395.934322:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0x5:0x0] 00010000:00010000:0.0:1782759395.934327:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.934340:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759395.934348:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.934350:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 2/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759395.934369:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x10:0x0] 00010000:00010000:0.0:1782759395.934377:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.934378:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759395.934387:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934388:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934416:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759395.934417:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934431:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759395.934435:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934443:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.934452:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 2/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934453:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:0.0:1782759395.934460:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.934465:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759395.934476:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.934484:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bc2d lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.934491:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 1/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.934505:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5600/0xd5b45c7f5c60bc34 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bc3b expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.934510:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232803328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.934526:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.934530:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759395.934532:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759395.934571:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103045:x1869355218450688:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 18938us (19083us total) trans 4294967944 rc 0/0 00000100:00100000:1.0:1782759395.934572:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.934873:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 6 00000100:00100000:0.0:1782759395.934903:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232803328 00000100:00100000:0.0:1782759395.934908:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232803328 00000100:00100000:0.0:1782759395.934951:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1782759395.934960:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3662:x1869355232803328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759395.934971:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759395.934989:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bc3b lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc34 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.935012:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759395.935022:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759395.935064:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232803328:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.935071:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1782759395.935097:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232803328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759395.938489:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.938523:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218450944 00000100:00100000:3.0:1782759395.938530:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218450944 00000100:00100000:3.0:1782759395.938617:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 308 00000100:00100000:3.0:1782759395.938628:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103045:x1869355218450944:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759395.938814:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218450944:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 188us (330us total) trans 4294967655 rc 0/0 00000100:00100000:3.0:1782759395.938819:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 308 00000100:00100000:2.0:1782759395.943536:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.943616:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218451072 00000100:00100000:1.0:1782759395.943627:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218451072 00000100:00100000:1.0:1782759395.943681:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2628 00000100:00100000:1.0:1782759395.943692:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103045:x1869355218451072:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759395.943724:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.943746:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bc65 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27193 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943804:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943817:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943844:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943857:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943864:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943870:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943941:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943949:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.943957:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759395.944042:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x10:0x0]: returning size 4096 00000004:00200000:1.0:1782759395.944047:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1782759395.944067:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944079:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944086:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944102:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944109:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944115:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.944119:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944127:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944137:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf300) 00010000:00010000:1.0:1782759395.944141:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.944145:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944152:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bc6c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944165:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944171:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944190:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944196:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.944204:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944211:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944219:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cded88bfd00) 00010000:00010000:1.0:1782759395.944222:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.944225:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944230:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bc73 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944266:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bc65 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944281:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.944289:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bfc00) 00010000:00010000:1.0:1782759395.944292:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759395.944294:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759395.944353:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103045:x1869355218451072:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 663us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.944359:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2628 00000100:00100000:0.0:1782759395.946164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.946231:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218451328 00000100:00100000:2.0:1782759395.946240:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218451328 00000100:00100000:2.0:1782759395.946288:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2629 00000100:00100000:2.0:1782759395.946299:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103045:x1869355218451328:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759395.946406:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946420:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946441:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946455:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946465:0:12673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946473:0:12673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946502:0:12673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.946516:0:12673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 7 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.946530:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12673:1869355232803456:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759395.946637:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.947812:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12673:1869355232803456:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759395.947835:0:12673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.948194:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.948285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218451456 00000100:00100000:3.0:1782759395.948291:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218451456 00010000:00010000:3.0:1782759395.948315:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 8 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.948375:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 704 00000100:00100000:3.0:1782759395.948384:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218451456:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759395.948396:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759395.948402:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 8 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.948412:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 8 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.948429:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bc7a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27193 expref: 8 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.948444:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bfc00) 00010000:00010000:3.0:1782759395.948448:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.948456:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.948462:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.948482:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759395.948520:0:12673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.948529:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.948535:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218451456:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 150us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.948554:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 704 00010000:00010000:2.0:1782759395.948603:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.948613:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.948621:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.948797:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.948805:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.948813:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 3/0,1 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.948829:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232803584:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1782759395.948870:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.948897:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.948914:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232803584 00000100:00100000:3.0:1782759395.948925:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232803584 00000100:00100000:3.0:1782759395.948975:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:3.0:1782759395.948983:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355232803584:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1782759395.948996:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.949009:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc9d lrc: 2/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bc96 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.949028:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc9d lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc96 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.949040:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc9d lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc96 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.949065:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34f4f00) 00010000:00010000:3.0:1782759395.949067:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:3.0:1782759395.949069:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759395.949102:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355232803584:12345-0@lo:101:mdt00_004.0 Request processed in 120us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.949108:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1782759395.949132:0:12673:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967942 gen 2 00000004:00080000:2.0:1782759395.949139:0:12673:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967936 committed transno 4294967942 00000004:00080000:2.0:1782759395.949152:0:12673:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967938 committed transno 4294967942 00000020:00080000:2.0:1782759395.949158:0:12673:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc494a900 refcount 2 committed 0 result 0 batchid 24 00000020:00080000:2.0:1782759395.949162:0:12673:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec54b0800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc494af00 00000020:00080000:2.0:1782759395.949166:0:12673:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].24 00000020:00080000:2.0:1782759395.949169:0:12673:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec54b0a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4bede00 00000020:00080000:2.0:1782759395.949171:0:12673:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].24 00000004:00080000:2.0:1782759395.949200:0:12673:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967939 committed transno 4294967942 00000020:00080000:2.0:1782759395.949204:0:12673:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc494ac00 refcount 2 committed 0 result 0 batchid 25 00000020:00080000:2.0:1782759395.949207:0:12673:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc271e200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc494a0c0 00000020:00080000:1.0:1782759395.949209:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 24 committed batchid 23 00000020:00080000:2.0:1782759395.949210:0:12673:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].25 00000020:00080000:2.0:1782759395.949216:0:12673:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec54b0b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc480ee00 00000020:00080000:2.0:1782759395.949219:0:12673:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].25 00000004:00080000:2.0:1782759395.949229:0:12673:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967942 committed transno 4294967942 00000020:00080000:2.0:1782759395.949232:0:12673:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc4beb780 refcount 2 committed 0 result 0 batchid 26 00000020:00080000:2.0:1782759395.949234:0:12673:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedb66e400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4bebcc0 00000020:00080000:2.0:1782759395.949237:0:12673:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].26 00000020:00080000:2.0:1782759395.949239:0:12673:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedb66ec00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4875200 00000020:00080000:2.0:1782759395.949241:0:12673:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].26 00000100:00100000:2.0:1782759395.949256:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232803584:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1782759395.949270:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.949280:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782759395.949285:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 26 committed batchid 23 00000020:00080000:1.0:1782759395.949304:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 23 00000100:00100000:2.0:1782759395.950274:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232803712:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1782759395.950395:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.950421:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.950436:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232803712 00000100:00100000:1.0:1782759395.950447:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232803712 00000100:00100000:1.0:1782759395.950494:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:1.0:1782759395.950504:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355232803712:12345-0@lo:403:mdt00_004.0 00000100:00100000:1.0:1782759395.952030:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355232803712:12345-0@lo:403:mdt00_004.0 Request processed in 1523us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.952042:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00100000:2.0:1782759395.952148:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232803712:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1782759395.952942:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].27, 392 off60496 00000040:00080000:2.0:1782759395.953115:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].27, 472 off63512 00000004:00080000:2.0:1782759395.953122:0:12673:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc45c3c00 with version 53 00000004:00080000:3.0:1782759395.953419:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 53 rpc_version 53 00000020:00100000:3.0:1782759395.953449:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759395.953458:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4bce680 x1869355232803968/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1176/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759395.953477:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232803968:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759395.953523:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759395.953567:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.953657:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232803968 00000100:00100000:0.0:1782759395.953663:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232803968 00000100:00100000:0.0:1782759395.953716:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:0.0:1782759395.953725:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232803968:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759395.954100:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232803968:12345-0@lo:1000:osp_up0-1.0 Request processed in 370us (569us total) trans 4294967945 rc 0/0 00000100:00100000:0.0:1782759395.954108:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:3.0:1782759395.954277:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232803968:0@lo:1000:osp_up0-1.0 00000004:00010000:2.0:1782759395.954337:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014423abb reply state 00000000e7887500 transno 4294967656 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954358:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954367:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:2.0:1782759395.954370:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00000100:00100000:2.0:1782759395.954374:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759395.954381:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954389:0:12673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759395.954401:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014423abb reply state 00000000e7887500 transno 4294967656 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954410:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954415:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bfc00) 00010000:00010000:2.0:1782759395.954418:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00000100:00100000:2.0:1782759395.954420:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1782759395.954424:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000014423abb reply state 00000000e7887500 transno 4294967656 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954432:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.954438:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:2.0:1782759395.954440:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759395.954448:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1782759395.954515:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103045:x1869355218451328:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 8212us (8349us total) trans 4294967656 rc 0/0 00000100:00100000:2.0:1782759395.954524:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2629 00000100:00100000:0.0:1782759395.963224:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.963287:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218451712 00000100:00100000:3.0:1782759395.963297:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218451712 00000100:00100000:3.0:1782759395.963400:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2630 00000100:00100000:3.0:1782759395.963412:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103046:x1869355218451712:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759395.963435:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.963455:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bca4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2719a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963533:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963556:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963567:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963609:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963617:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963624:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.963786:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x10:0x0]: returning size 4096 00010000:00010000:3.0:1782759395.963851:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963859:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963878:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963884:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963890:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.963894:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963901:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963913:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:3.0:1782759395.963916:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.963919:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963925:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bcab lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963937:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963942:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963948:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963952:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.963961:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963968:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963975:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759395.963977:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.963979:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.963985:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bcb2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.964019:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bca4 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2719a expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.964029:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:3.0:1782759395.964031:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759395.964034:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bca4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2719a expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.964043:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759395.964108:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103046:x1869355218451712:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 698us (893us total) trans 4294967657 rc 301/301 00000100:00100000:3.0:1782759395.964115:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2630 00000100:00100000:0.0:1782759395.966848:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.967112:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218451840 00000100:00100000:3.0:1782759395.967122:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218451840 00000100:00100000:3.0:1782759395.967180:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2631 00000100:00100000:3.0:1782759395.967192:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103046:x1869355218451840:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759395.967224:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.967242:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bcc0 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271a1 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.967292:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.967305:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.967317:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.967358:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1782759395.967362:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1782759395.967395:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bcc0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.967413:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.967422:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:3.0:1782759395.967425:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759395.967428:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759395.967493:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218451840:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 305us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.967501:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2631 00000100:00100000:0.0:1782759395.970123:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759395.970169:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218452096 00000100:00100000:3.0:1782759395.970178:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218452096 00000100:00100000:3.0:1782759395.970243:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2632 00000100:00100000:3.0:1782759395.970253:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218452096:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759395.970271:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.970288:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bcce lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271a8 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.970348:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.970360:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.970369:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.970382:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.970389:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.970394:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759395.970525:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x10:0x0]: returning size 4096 00010000:00010000:2.0:1782759395.970685:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970693:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970697:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970703:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970710:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759395.970713:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970720:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970732:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:2.0:1782759395.970735:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.970740:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970747:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bcd5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970759:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970771:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970774:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970777:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759395.970779:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970782:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970787:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc34f4700) 00010000:00010000:2.0:1782759395.970788:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759395.970790:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970794:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bcdc lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970821:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bcce lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a8 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970826:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:2.0:1782759395.970828:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759395.970830:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bcce lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a8 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.970843:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:2.0:1782759395.970895:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103046:x1869355218452096:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 644us (776us total) trans 4294967658 rc 301/301 00000100:00100000:2.0:1782759395.970903:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2632 00000100:00100000:0.0:1782759395.975005:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.976613:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218452352 00000100:00100000:1.0:1782759395.976625:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218452352 00000100:00100000:1.0:1782759395.976689:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 309 00000100:00100000:1.0:1782759395.976700:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9346850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103046:x1869355218452352:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759395.976915:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9346850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103046:x1869355218452352:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 217us (1918us total) trans 4294967659 rc 0/0 00000100:00100000:1.0:1782759395.976924:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 309 00000100:00100000:0.0:1782759395.980848:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.980907:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218452608 00000100:00100000:2.0:1782759395.980917:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218452608 00000100:00100000:2.0:1782759395.980975:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 310 00000100:00100000:2.0:1782759395.980988:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103046:x1869355218452608:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1782759395.981208:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103046:x1869355218452608:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 222us (368us total) trans 4294967660 rc 0/0 00000100:00100000:2.0:1782759395.981217:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 310 00000100:00100000:0.0:1782759395.982828:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759395.982889:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218452736 00000100:00100000:1.0:1782759395.982897:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218452736 00000100:00100000:1.0:1782759395.982944:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2633 00000100:00100000:1.0:1782759395.982954:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103046:x1869355218452736:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1782759395.983013:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983030:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983040:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983053:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983077:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983084:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983151:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983174:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983181:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759395.983196:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x10:0x0]: returning size 4096 00000004:00010000:1.0:1782759395.983209:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983219:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983226:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983232:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983238:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983244:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.983253:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983261:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983272:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:1.0:1782759395.983276:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.983279:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983286:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bcea lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983299:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983305:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983311:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983316:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.983319:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983325:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983346:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cded88bf300) 00010000:00010000:1.0:1782759395.983348:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.983357:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983363:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bcf1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983376:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983382:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983388:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983393:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759395.983396:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983403:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983410:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bfc00) 00010000:00010000:1.0:1782759395.983413:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.983417:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.983423:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bcf8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.983496:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103046:x1869355218452736:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 543us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.983504:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2633 00000100:00100000:0.0:1782759395.984775:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759395.984829:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218452992 00000100:00100000:2.0:1782759395.984837:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218452992 00000100:00100000:2.0:1782759395.984887:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:2.0:1782759395.984898:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103046:x1869355218452992:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759395.984961:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.984974:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.984984:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759395.985001:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00000100:00100000:2.0:1782759395.985045:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804096:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.985106:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.985132:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.986637:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804096 00000100:00100000:1.0:1782759395.986646:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804096 00000100:00100000:1.0:1782759395.986710:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:1.0:1782759395.986719:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804096:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.986826:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804096:12345-0@lo:1000:mdt_io00_002.0 Request processed in 108us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.986836:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:2.0:1782759395.986868:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804096:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.986936:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804224:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.986975:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.986990:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.987295:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804224 00000100:00100000:0.0:1782759395.987300:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804224 00000100:00100000:0.0:1782759395.987332:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:0.0:1782759395.987340:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804224:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.987417:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804224:12345-0@lo:1000:mdt_io00_002.0 Request processed in 78us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.987425:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00100000:2.0:1782759395.987445:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804224:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.987481:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804352:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.987502:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.987525:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.987573:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804352 00000100:00100000:1.0:1782759395.987615:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804352 00000100:00100000:1.0:1782759395.987656:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:1.0:1782759395.987664:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804352:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.987764:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804352:12345-0@lo:1000:mdt_io00_002.0 Request processed in 101us (260us total) trans 0 rc 1/1 00000100:00100000:1.0:1782759395.987772:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00000100:00100000:0.0:1782759395.987814:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804352:0@lo:1000:mdt_io00_002.0 00010000:00010000:0.0:1782759395.987868:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.987876:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.987883:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.987891:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804480:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1782759395.987909:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.987931:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759395.987965:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804480 00000100:00100000:3.0:1782759395.987971:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804480 00000100:00100000:3.0:1782759395.988016:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:3.0:1782759395.988022:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804480:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:3.0:1782759395.988029:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759395.988056:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bd06 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.988076:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 2/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.988096:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 4/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.988113:0:6537:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1782759395.988139:0:6537:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:3.0:1782759395.988201:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.988211:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:3.0:1782759395.988214:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.988218:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.988227:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759395.988265:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6546:x1869355232804480:12345-0@lo:101:mdt_io00_002.0 Request processed in 243us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.988271:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1782759395.988301:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804480:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1782759395.988326:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 4/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.988337:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 4/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.989715:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759395.989738:0:7461:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989763:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989773:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989792:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989799:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.989804:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989811:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989822:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:3.0:1782759395.989824:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759395.989827:0:3649:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989834:0:3649:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989839:0:3649:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.989861:0:3649:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.989872:0:3649:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3649:1869355232804608:0@lo:105: 00000100:00100000:3.0:1782759395.989913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759395.989929:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 2/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.989944:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759395.989961:0:3649:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.989972:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804608 00010000:00010000:0.0:1782759395.989974:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649200/0xd5b45c7f5c60bc96 lrc: 0/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bc9d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.989979:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804608 00000100:00100000:3.0:1782759395.989989:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000001:00080000:0.0:1782759395.990006:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967660 is committed 00000100:00100000:3.0:1782759395.990010:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232804736:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1782759395.990029:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 26 batchid updated 00000100:00100000:2.0:1782759395.990035:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000020:00080000:0.0:1782759395.990036:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 24 batchid updated 00000100:00100000:2.0:1782759395.990052:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3649:x1869355232804608:12345-0@lo:105: 00000100:00100000:3.0:1782759395.990053:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1782759395.990055:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967654 is committed 00010000:00010000:2.0:1782759395.990067:0:18645:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 5/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759395.990072:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 26 00010000:00010000:2.0:1782759395.990081:0:18645:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 5/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.990089:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804736 00010000:00010000:2.0:1782759395.990092:0:18645:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 5/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.990095:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804736 00010000:00010000:2.0:1782759395.990104:0:18645:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 5/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759395.990122:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4f37f00 with version 54 00010000:00010000:2.0:1782759395.990125:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 6/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759395.990135:0:18645:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 6/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759395.990136:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 24 cancel update log [0x200000401:0x2:0x0].24: rc = 0 00000100:00100000:1.0:1782759395.990139:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1782759395.990150:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355232804736:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1782759395.990162:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759395.990165:0:18645:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cdecd4dda00) 00010000:00010000:1.0:1782759395.990178:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bc9d lrc: 0/0,0 mode: --/EX res: [0x200000421:0xc:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc96 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.990204:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x0 (ffff8cddc34f4f00) 00000100:00100000:2.0:1782759395.990207:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:3649:x1869355232804608:12345-0@lo:105: Request processed in 160us (292us total) trans 0 rc 0/0 00000020:00080000:0.0:1782759395.990209:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 24 cancel update log [0x240000400:0x2:0x0].24: rc = 0 00010000:00010000:1.0:1782759395.990214:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759395.990222:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000004:00080000:0.0:1782759395.990243:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4f37540 with version 55 00000020:00080000:0.0:1782759395.990248:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 25 cancel update log [0x200000401:0x2:0x0].25: rc = 0 00000100:00100000:1.0:1782759395.990254:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3662:x1869355232804736:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 103us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759395.990262:0:6546:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759395.990262:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00010000:2.0:1782759395.990274:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759395.990275:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 25 cancel update log [0x240000400:0x2:0x0].25: rc = 0 00000004:00080000:2.0:1782759395.990302:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00000004:00080000:0.0:1782759395.990303:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cdec76dbd80 with version 56 00000100:00100000:3.0:1782759395.990308:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232804736:0@lo:103:jbd2/dm-1-8.0 00000020:00080000:0.0:1782759395.990310:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 26 cancel update log [0x200000401:0x2:0x0].26: rc = 0 00010000:00010000:2.0:1782759395.990337:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759395.990340:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 26 cancel update log [0x240000400:0x2:0x0].26: rc = 0 00010000:00010000:2.0:1782759395.990350:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759395.990354:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 26 00000100:00100000:3.0:1782759395.990356:0:3649:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0001_UUID:3649:1869355232804608:0@lo:105: 00010000:00010000:2.0:1782759395.990365:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759395.990368:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 54 rpc_version 54 00010000:00010000:3.0:1782759395.990373:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990383:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60bc81 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.990387:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804864:0@lo:101:mdt_io00_002.0 00000020:00100000:0.0:1782759395.990391:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1782759395.990400:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.990401:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cded3bd7100 x1869355232805120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1782759395.990415:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.990425:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759395.990427:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.990428:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232805120:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1782759395.990439:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.990456:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990463:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.990469:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3e40 going to sleep for 11 seconds 00010000:00010000:3.0:1782759395.990473:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bfc00) 00010000:00010000:3.0:1782759395.990477:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:3.0:1782759395.990480:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990496:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60bc88 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x10:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990508:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990514:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990519:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990524:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759395.990526:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990531:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990549:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:3.0:1782759395.990552:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:3.0:1782759395.990556:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759395.990561:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60bc8f lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.990653:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.990675:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232804864 00000100:00100000:1.0:1782759395.990680:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232804864 00000100:00100000:0.0:1782759395.990685:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb798600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.990719:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232805120 00000100:00100000:1.0:1782759395.990723:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232805120 00000100:00100000:1.0:1782759395.990742:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:1.0:1782759395.990750:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6546:x1869355232804864:12345-0@lo:101:mdt_io00_002.0 00000100:00100000:2.0:1782759395.990752:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:2.0:1782759395.990765:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232805120:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1782759395.990767:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.990784:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bd14 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.990804:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd14 expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.990817:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd14 expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759395.990824:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cded88bfd00) 00010000:00010000:1.0:1782759395.990827:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759395.990829:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759395.990865:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6546:x1869355232804864:12345-0@lo:101:mdt_io00_002.0 Request processed in 116us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.990869:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1782759395.991096:0:6546:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967654 gen 2 00000004:00080000:0.0:1782759395.991102:0:6546:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967654 committed transno 4294967654 00000100:00100000:0.0:1782759395.991118:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232804864:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1782759395.991137:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.991147:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759395.991285:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:0.0:1782759395.991311:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.991318:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.991326:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759395.991339:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232805248:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1782759395.991364:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759395.991388:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.991399:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232805248 00000100:00100000:1.0:1782759395.991403:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232805248 00000100:00100000:1.0:1782759395.991431:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:1.0:1782759395.991436:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6546:x1869355232805248:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:1.0:1782759395.991443:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759395.991452:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bd29 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bd22 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.991460:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232805120:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1782759395.991466:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bd29 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd22 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759395.991473:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 55 rpc_version 55 00000100:00100000:2.0:1782759395.991474:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232805120:12345-0@lo:1000:osp_up0-1.0 Request processed in 702us (999us total) trans 4294967946 rc 0/0 00010000:00010000:1.0:1782759395.991480:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bd29 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd22 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759395.991487:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000020:00100000:3.0:1782759395.991489:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1782759395.991493:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759395.991499:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:3.0:1782759395.991503:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf92dc00 x1869355232805504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1782759395.991504:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:3.0:1782759395.991517:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232805504:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759395.991558:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232805248:12345-0@lo:101:mdt_io00_002.0 Request processed in 120us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759395.991566:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.991573:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000100:00100000:0.0:1782759395.991573:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232805248:0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1782759395.991609:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759395.991619:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759395.991625:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759395.991626:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232805504 00000100:00100000:2.0:1782759395.991632:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232805504 00000004:00080000:0.0:1782759395.991634:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x10:0x0] 00000100:00100000:2.0:1782759395.991675:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1782759395.991677:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232805632:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.991685:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232805504:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759395.991709:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.991732:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232805632 00000100:00100000:1.0:1782759395.991736:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232805632 00000100:00100000:0.0:1782759395.991736:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.991764:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:1.0:1782759395.991773:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232805632:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.991790:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232805504:12345-0@lo:1000:osp_up0-1.0 Request processed in 106us (227us total) trans 4294967947 rc 0/0 00000100:00100000:2.0:1782759395.991798:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:0.0:1782759395.991811:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232805504:0@lo:1000:osp_up0-1.0 00000004:00080000:0.0:1782759395.991824:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 56 rpc_version 56 00000020:00100000:0.0:1782759395.991838:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759395.991843:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cded3bd5c00 x1869355232805888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759395.991854:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232805632:12345-0@lo:1000:mdt_io00_002.0 Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.991855:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232805888:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759395.991865:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232805632:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.991869:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1782759395.991895:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1782759395.991908:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x10:0x0] 00000100:00100000:0.0:1782759395.991916:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdefc494840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.991919:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232805888 00000100:00100000:1.0:1782759395.991930:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232805888 00000100:00100000:3.0:1782759395.991941:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806016:0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.991965:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:3.0:1782759395.991978:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759395.991984:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232805888:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759395.992003:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806016 00000100:00100000:0.0:1782759395.992007:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806016 00000100:00100000:3.0:1782759395.992010:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.992032:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:0.0:1782759395.992040:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806016:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.992108:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232805888:12345-0@lo:1000:osp_up0-1.0 Request processed in 134us (212us total) trans 4294967948 rc 0/0 00000100:00100000:0.0:1782759395.992116:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806016:12345-0@lo:1000:mdt_io00_002.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.992120:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1782759395.992129:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:2.0:1782759395.992245:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806016:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759395.992341:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232805888:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759395.992783:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806144:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1782759395.992814:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.992833:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.992848:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806144 00000100:00100000:0.0:1782759395.992852:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806144 00000100:00100000:0.0:1782759395.992877:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:0.0:1782759395.992882:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806144:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1782759395.994312:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806144:12345-0@lo:403:mdt_io00_002.0 Request processed in 1426us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.994320:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00100000:2.0:1782759395.994458:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806144:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1782759395.995084:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806272:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.995115:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.995135:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.995241:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806272 00000100:00100000:0.0:1782759395.995246:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806272 00000100:00100000:0.0:1782759395.995286:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:0.0:1782759395.995291:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806272:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.995352:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806272:12345-0@lo:1000:mdt_io00_002.0 Request processed in 60us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.995359:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00000100:00100000:2.0:1782759395.995468:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806272:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.995500:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806400:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.995523:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.995563:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.995604:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806400 00000100:00100000:0.0:1782759395.995610:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806400 00000100:00100000:0.0:1782759395.995638:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052 00000100:00100000:0.0:1782759395.995645:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806400:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.995695:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806400:12345-0@lo:1000:mdt_io00_002.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.995701:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052 00000100:00100000:2.0:1782759395.995853:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806400:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.996336:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806528:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1782759395.996369:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.996389:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.996400:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806528 00000100:00100000:1.0:1782759395.996405:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806528 00000100:00100000:1.0:1782759395.996444:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:1.0:1782759395.996452:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806528:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:1.0:1782759395.998053:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806528:12345-0@lo:403:mdt_io00_002.0 Request processed in 1597us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.998063:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00100000:2.0:1782759395.998092:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806528:0@lo:403:mdt_io00_002.0 00000100:00100000:2.0:1782759395.998710:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806656:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.998749:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.998774:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.998810:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806656 00000100:00100000:0.0:1782759395.998818:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806656 00000100:00100000:0.0:1782759395.998868:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1782759395.998875:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806656:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.998944:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806656:12345-0@lo:1000:mdt_io00_002.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.998951:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:2.0:1782759395.999004:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806656:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.999065:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806784:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.999082:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.999096:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.999119:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806784 00000100:00100000:1.0:1782759395.999125:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806784 00000100:00100000:1.0:1782759395.999159:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:1.0:1782759395.999167:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806784:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.999230:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806784:12345-0@lo:1000:mdt_io00_002.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.999235:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:2.0:1782759395.999280:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806784:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.999301:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806912:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.999333:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.999356:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759395.999406:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232806912 00000100:00100000:0.0:1782759395.999411:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232806912 00000100:00100000:0.0:1782759395.999440:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:0.0:1782759395.999445:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806912:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759395.999568:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232806912:12345-0@lo:1000:mdt_io00_002.0 Request processed in 121us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759395.999574:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:2.0:1782759395.999640:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232806912:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.999671:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807040:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759395.999695:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759395.999717:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759395.999811:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807040 00000100:00100000:1.0:1782759395.999816:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807040 00000100:00100000:1.0:1782759395.999888:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:1.0:1782759395.999896:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807040:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:1.0:1782759395.999965:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807040:12345-0@lo:1000:mdt_io00_002.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759395.999971:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00100000:2.0:1782759396.000041:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807040:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759396.000069:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807168:0@lo:1000:mdt_io00_002.0 00000100:00100000:2.0:1782759396.000098:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.001124:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.001253:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807168 00000100:00100000:0.0:1782759396.001259:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807168 00000100:00100000:0.0:1782759396.001299:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:0.0:1782759396.001306:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807168:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759396.001382:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807168:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.001390:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:2.0:1782759396.001420:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807168:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759396.002478:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807296:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1782759396.002517:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.002549:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.002570:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807296 00000100:00100000:0.0:1782759396.002598:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807296 00000100:00100000:0.0:1782759396.002638:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:0.0:1782759396.002811:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807296:12345-0@lo:403:mdt_io00_002.0 00000100:00100000:0.0:1782759396.004602:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807296:12345-0@lo:403:mdt_io00_002.0 Request processed in 1931us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.004613:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00100000:3.0:1782759396.004622:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807296:0@lo:403:mdt_io00_002.0 00000100:00100000:3.0:1782759396.005175:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807424:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759396.005202:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.005226:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.005246:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807424 00000100:00100000:0.0:1782759396.005252:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807424 00000100:00100000:0.0:1782759396.005336:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:0.0:1782759396.005345:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807424:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759396.005416:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807424:12345-0@lo:1000:mdt_io00_002.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.005423:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00100000:3.0:1782759396.005479:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807424:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759396.005509:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807552:0@lo:1000:mdt_io00_002.0 00000100:00100000:3.0:1782759396.005525:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.005550:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.005745:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807552 00000100:00100000:0.0:1782759396.005750:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807552 00000100:00100000:0.0:1782759396.005814:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:0.0:1782759396.005821:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807552:12345-0@lo:1000:mdt_io00_002.0 00000100:00100000:0.0:1782759396.005874:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6546:x1869355232807552:12345-0@lo:1000:mdt_io00_002.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.005881:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:3.0:1782759396.006090:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807552:0@lo:1000:mdt_io00_002.0 00000040:00080000:3.0:1782759396.007369:0:6546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].16, 2456 off51120 00000040:00080000:3.0:1782759396.007433:0:6546:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].16, 2536 off53040 00000004:00080000:3.0:1782759396.007440:0:6546:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc2700780 with version 31 00000004:00080000:2.0:1782759396.007473:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 31 rpc_version 31 00000020:00100000:2.0:1782759396.007510:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759396.007519:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc208ce00 x1869355232807808/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759396.007549:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232807808:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759396.007617:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.007643:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.007674:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807808 00000100:00100000:0.0:1782759396.007686:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807808 00000100:00100000:0.0:1782759396.007746:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:0.0:1782759396.007755:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:7666:x1869355232807808:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782759396.008121:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+10:7666:x1869355232807808:12345-0@lo:1000:osp_up1-0.0 Request processed in 368us (504us total) trans 4294967661 rc 0/0 00000100:00100000:0.0:1782759396.008127:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000100:00100000:2.0:1782759396.008167:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232807808:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1782759396.008233:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008250:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008263:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008281:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008288:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008295:0:6546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008320:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008326:0:6546:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.008336:0:6546:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.008349:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807936:0@lo:101:mdt_io00_002.0 00000100:00100000:3.0:1782759396.008378:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.008399:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.008450:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232807936 00000100:00100000:0.0:1782759396.008455:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232807936 00000100:00100000:0.0:1782759396.008491:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:0.0:1782759396.008497:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:6546:x1869355232807936:12345-0@lo:101:mdt_io00_002.0 00010000:00010000:0.0:1782759396.008510:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759396.008524:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bd3e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.008558:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 5 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.008567:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.008613:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 5 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.008626:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 5 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.008637:0:6537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6537:1869355232808064:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759396.008706:0:6537:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.010117:0:6537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6537:1869355232808064:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759396.010145:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010158:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:0.0:1782759396.010161:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.010165:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010174:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759396.010325:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:6546:x1869355232807936:12345-0@lo:101:mdt_io00_002.0 Request processed in 1826us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.010329:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-mdtlov_UUID:6546:1869355232807936:0@lo:101:mdt_io00_002.0 00000100:00100000:0.0:1782759396.010336:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00010000:00010000:3.0:1782759396.010358:0:6546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.010369:0:6546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.010390:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759396.010442:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218453120 00000100:00100000:0.0:1782759396.010448:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218453120 00010000:00010000:0.0:1782759396.010471:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 6 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.010504:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 705 00000100:00100000:0.0:1782759396.010513:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218453120:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.010524:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.010529:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 6 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010537:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 6 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010602:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bcc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271a1 expref: 6 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010616:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:0.0:1782759396.010621:0:9534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010630:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010638:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.010666:0:9534:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.010679:0:9534:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9534:1869355232808192:0@lo:105: 00000100:00100000:0.0:1782759396.010711:0:9534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.010918:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808192 00000100:00100000:2.0:1782759396.010924:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808192 00000100:00100000:0.0:1782759396.010928:0:9534:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759396.010965:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1782759396.010975:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9534:x1869355232808192:12345-0@lo:105: 00010000:00010000:2.0:1782759396.010996:0:6514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.011006:0:6514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.011015:0:6514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 5/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.011023:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 5/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.011061:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.011069:0:6514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 6/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.011091:0:6514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cddc3de5000) 00010000:00010000:3.0:1782759396.011120:0:6546:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011132:0:6546:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.011142:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9534:x1869355232808192:12345-0@lo:105: Request processed in 166us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.011151:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000004:00010000:3.0:1782759396.011160:0:6546:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035fe1a4a reply state 0000000001bb380f transno 4294967949 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.011163:0:9534:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:9534:1869355232808192:0@lo:105: 00010000:00010000:3.0:1782759396.011180:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011181:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759396.011191:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:3.0:1782759396.011194:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759396.011197:0:6546:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759396.011204:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011213:0:6546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.011224:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218453120:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 711us (835us total) trans 0 rc 0/0 00000004:00080000:3.0:1782759396.011225:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000400:0x5:0x0] 00000100:00100000:0.0:1782759396.011236:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 705 00000004:00010000:3.0:1782759396.011238:0:6546:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035fe1a4a reply state 0000000001bb380f transno 4294967949 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011260:0:6546:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011267:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759396.011269:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759396.011271:0:6546:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:3.0:1782759396.011281:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x10:0x0] 00010000:00010000:3.0:1782759396.011288:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011296:0:6546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759396.011307:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:3.0:1782759396.011313:0:6546:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011320:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011327:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011353:0:6546:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782759396.011358:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:3.0:1782759396.011363:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011371:0:6546:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011376:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.011383:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759396.011392:0:6546:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:3.0:1782759396.011402:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011402:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759396.011413:0:6546:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011413:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011432:0:6546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759396.011435:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011462:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011468:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782759396.011515:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232808320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759396.011547:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759396.011554:0:6546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.011559:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011560:0:6546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011603:0:6546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011608:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dda00/0xd5b45c7f5c60bd06 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bd0d expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.011612:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808320 00010000:00010000:3.0:1782759396.011616:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cddc34ff400) 00000100:00100000:1.0:1782759396.011617:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808320 00010000:00010000:3.0:1782759396.011622:0:6546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759396.011627:0:6546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.011634:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bcff lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.011637:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.011641:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.011644:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759396.011648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1782759396.011655:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+11:3664:x1869355232808320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759396.011664:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759396.011676:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd0d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd06 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.011689:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ffb00) 00010000:00010000:1.0:1782759396.011696:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759396.011721:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+10:3664:x1869355232808320:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.011728:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1782759396.011757:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232808320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759396.011795:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218452992:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 26898us (27021us total) trans 4294967949 rc 0/0 00000100:00100000:3.0:1782759396.011802:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 7 00000100:00100000:2.0:1782759396.014859:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759396.014906:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218453376 00000100:00100000:1.0:1782759396.014914:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218453376 00000100:00100000:1.0:1782759396.014978:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2634 00000100:00100000:1.0:1782759396.014986:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103046:x1869355218453376:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759396.015002:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759396.015017:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bd4c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271af expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015075:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015089:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015107:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015116:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015123:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd14 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015129:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.015154:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60bd14 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.015241:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232808448:0@lo:104: 00000100:00100000:1.0:1782759396.015277:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.015306:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759396.015326:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759396.015339:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808448 00000100:00100000:2.0:1782759396.015343:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808448 00000100:00100000:2.0:1782759396.015378:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1782759396.015387:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6533:x1869355232808448:12345-0@lo:104: 00010000:00010000:2.0:1782759396.015399:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.015469:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759396.015475:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6533:x1869355232808448:12345-0@lo:104: Request processed in 91us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.015482:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1782759396.015569:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232808448:0@lo:104: 00010000:00010000:3.0:1782759396.015631:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.015635:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.015645:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.015654:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759396.015659:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759396.015676:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.015701:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.015708:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759396.015732:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.015740:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648e00/0xd5b45c7f5c60bd14 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bd1b expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.015759:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759396.015762:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232808576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.015763:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.015766:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759396.015797:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.015837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808576 00000100:00100000:3.0:1782759396.015843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808576 00010000:00010000:3.0:1782759396.015864:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bd14 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.015937:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782759396.015946:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+10:3665:x1869355232808576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759396.015956:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1782759396.018175:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967661 is committed 00010000:00010000:3.0:1782759396.018268:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bd1b lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60bd14 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.018287:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cded88bfd00) 00010000:00010000:3.0:1782759396.018292:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.018302:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.018310:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.018342:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759396.018412:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+8:3665:x1869355232808576:12345-0@lo:103:ldlm_bl.0 Request processed in 2466us (2613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.018422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1782759396.018462:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232808576:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759396.018507:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.018516:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.018682:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232808704:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759396.018721:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.018750:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.018761:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808704 00000100:00100000:0.0:1782759396.018767:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808704 00000100:00100000:0.0:1782759396.018817:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:0.0:1782759396.018825:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232808704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782759396.018896:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232808704:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.018902:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:3.0:1782759396.019103:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232808704:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1782759396.019153:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019164:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019172:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019184:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019190:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019196:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019202:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019208:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759396.019212:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019220:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019229:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf300) 00010000:00010000:3.0:1782759396.019231:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759396.019235:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019251:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bd53 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019263:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019269:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019275:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019280:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759396.019283:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019289:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019297:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cded88bfd00) 00010000:00010000:3.0:1782759396.019300:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759396.019302:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019308:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bd5a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019347:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bd4c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019362:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.019376:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759396.019379:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759396.019381:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759396.019424:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103046:x1869355218453376:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 4437us (4573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.019431:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2634 00000100:00100000:2.0:1782759396.021497:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.025005:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218453632 00000100:00100000:3.0:1782759396.025020:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218453632 00000100:00100000:3.0:1782759396.025087:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2635 00000100:00100000:3.0:1782759396.025098:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218453632:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759396.025123:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759396.025144:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd68 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271b6 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759396.025296:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x13:0x0]: returning size 4096 00010000:00010000:3.0:1782759396.025467:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd68 lrc: 1/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271b6 expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.025481:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759396.025485:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759396.025490:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd68 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271b6 expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.025504:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759396.025607:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103046:x1869355218453632:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 510us (4115us total) trans 4294967950 rc 301/301 00000100:00100000:3.0:1782759396.025630:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2635 00000100:00100000:0.0:1782759396.027550:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.027634:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218453760 00000100:00100000:3.0:1782759396.027643:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218453760 00000100:00100000:3.0:1782759396.027910:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2636 00000100:00100000:3.0:1782759396.027920:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103046:x1869355218453760:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759396.027939:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759396.027955:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bd76 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271bd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.028010:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bd7d lrc: 3/1,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.028023:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bd7d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.028035:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bd7d lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759396.028076:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x6:0x0]: returning size 4096 00000004:00200000:3.0:1782759396.028081:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782759396.028114:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bd76 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271bd expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.028130:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bd7d lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271bd expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.028138:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:3.0:1782759396.028141:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759396.028156:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759396.028210:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103046:x1869355218453760:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 292us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.028218:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2636 00000100:00100000:0.0:1782759396.035191:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.035457:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218453888 00000100:00100000:3.0:1782759396.035467:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218453888 00000100:00100000:3.0:1782759396.035619:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2637 00000100:00100000:3.0:1782759396.035630:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103046:x1869355218453888:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759396.035659:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759396.035679:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bd84 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271c4 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.035731:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.035745:0:8593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.035755:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.035787:0:8593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.035802:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232808832:0@lo:104: 00000100:00100000:3.0:1782759396.035846:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.035892:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759396.036129:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808832 00000100:00100000:2.0:1782759396.036148:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808832 00000100:00100000:2.0:1782759396.036188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1782759396.036195:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8593:x1869355232808832:12345-0@lo:104: 00010000:00010000:2.0:1782759396.036207:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.036271:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759396.036278:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:8593:x1869355232808832:12345-0@lo:104: Request processed in 84us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.036284:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1782759396.036289:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232808832:0@lo:104: 00010000:00010000:3.0:1782759396.036304:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.036346:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.036358:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.036366:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759396.036371:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759396.036380:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.036405:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.036412:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759396.036437:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.036445:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5000/0xd5b45c7f5c60bd3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bd45 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.036454:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232808960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.036462:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.036464:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.036465:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759396.036482:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.036893:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232808960 00000100:00100000:0.0:1782759396.036898:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232808960 00010000:00010000:0.0:1782759396.036916:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.036944:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1782759396.036951:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+8:3662:x1869355232808960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.036968:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.037745:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60bd45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60bd3e expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.037759:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:0.0:1782759396.037763:0:9534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.037772:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.037780:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.037807:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759396.037853:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232808960:12345-0@lo:103:ldlm_bl.0 Request processed in 902us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.037860:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1782759396.037975:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232808960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759396.038081:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.038089:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759396.038156:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000400:0x5:0x0]: returning size 4096 00000004:00200000:3.0:1782759396.038162:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782759396.038210:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bd84 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271c4 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.038225:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271c4 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.038232:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:3.0:1782759396.038234:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759396.038236:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759396.038284:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218453888:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2656us (3112us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.038291:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2637 00000100:00100000:2.0:1782759396.040721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.040928:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454016 00000100:00100000:3.0:1782759396.040938:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454016 00000100:00100000:3.0:1782759396.041035:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2638 00000100:00100000:3.0:1782759396.041047:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103046:x1869355218454016:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759396.041066:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759396.041102:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bd92 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271cb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.041182:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bd99 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.041196:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bd99 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.041207:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bd99 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759396.041295:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x13:0x0]: returning size 4096 00000004:00200000:3.0:1782759396.041301:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1782759396.041321:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bd99 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.041344:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60bd92 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271cb expref: 14 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.041364:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bd99 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271cb expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.041372:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759396.041374:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759396.041378:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759396.041438:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103046:x1869355218454016:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 394us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.041444:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2638 00000100:00100000:0.0:1782759396.044250:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759396.044336:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454144 00000100:00100000:1.0:1782759396.044346:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454144 00000100:00100000:1.0:1782759396.044431:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 311 00000100:00100000:1.0:1782759396.044441:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103046:x1869355218454144:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759396.047179:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103046:x1869355218454144:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 2730us (2928us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.047193:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 311 00000100:00100000:2.0:1782759396.050678:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.050719:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454272 00000100:00100000:3.0:1782759396.050739:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454272 00000100:00100000:3.0:1782759396.050797:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 312 00000100:00100000:3.0:1782759396.050807:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218454272:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:2.0:1782759396.053526:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218454272:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 2712us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.053549:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 312 00000100:00100000:0.0:1782759396.055814:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759396.055930:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454400 00000100:00100000:1.0:1782759396.055940:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454400 00000100:00100000:1.0:1782759396.055996:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2639 00000100:00100000:1.0:1782759396.056005:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218454400:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1782759396.056069:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056085:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056097:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056107:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056116:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bc42 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056125:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056180:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60bc42 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.056195:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1869355232809088:0@lo:104: 00000100:00100000:1.0:1782759396.056239:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.056287:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc35133c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.056289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809088 00000100:00100000:0.0:1782759396.056295:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809088 00000100:00100000:0.0:1782759396.056377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1782759396.056385:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6531:x1869355232809088:12345-0@lo:104: 00010000:00010000:0.0:1782759396.056397:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.056461:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759396.056473:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6531:x1869355232809088:12345-0@lo:104: Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.056482:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1869355232809088:0@lo:104: 00000100:00100000:0.0:1782759396.056497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00010000:00010000:1.0:1782759396.056505:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.056558:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759396.056564:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.056570:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759396.056574:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759396.056603:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056664:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056671:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759396.056706:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056714:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60bc42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bc49 expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.056734:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759396.056737:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232809216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759396.056737:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759396.056740:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759396.056773:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.056828:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809216 00000100:00100000:1.0:1782759396.056833:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809216 00010000:00010000:1.0:1782759396.056851:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bc42 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.056888:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1782759396.056896:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3663:x1869355232809216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759396.056907:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759396.057246:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60bc49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60bc42 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.057258:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x1c8b5715 (ffff8cded88bf400) 00010000:00010000:1.0:1782759396.057262:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.057270:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.057276:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.057295:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759396.057328:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.057331:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232809216:12345-0@lo:103:ldlm_bl.0 Request processed in 436us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.057346:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00010000:00010000:0.0:1782759396.057346:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057428:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/1,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057435:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057440:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.057551:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232809216:0@lo:103:ldlm_bl.0 00000004:00010000:0.0:1782759396.057678:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057692:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057698:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057704:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057711:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057717:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.057729:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057738:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057748:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:0.0:1782759396.057750:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.057754:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057760:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60bda0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057770:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057777:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057783:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057789:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.057792:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057797:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057803:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x1c8b5715 (ffff8cded88bf400) 00010000:00010000:0.0:1782759396.057804:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.057811:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057814:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429400/0xd5b45c7f5c60bda7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057824:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057828:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057831:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057834:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.057835:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057838:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057842:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759396.057843:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.057845:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 2/0,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.057857:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdae lrc: 0/0,0 mode: --/PR res: [0x240000405:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.057904:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218454400:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 1900us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.057908:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2639 00000100:00100000:0.0:1782759396.061839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759396.061914:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454656 00000100:00100000:1.0:1782759396.061925:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454656 00000100:00100000:1.0:1782759396.061989:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2640 00000100:00100000:1.0:1782759396.062000:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218454656:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759396.062019:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759396.062059:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60bdb5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271d2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.062169:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 3/0,1 mode: --/PW res: [0x240000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.062182:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.062193:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759396.062206:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x11:0x0]: returning size 0 00010000:00010000:1.0:1782759396.062319:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60bdb5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.062332:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.062338:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cded88bf800) 00010000:00010000:1.0:1782759396.062340:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782759396.062342:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428600, rc 0) 00000100:00100000:1.0:1782759396.062386:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103046:x1869355218454656:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 389us (556us total) trans 4294967662 rc 0/0 00000100:00100000:1.0:1782759396.062390:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2640 00000100:00100000:1.0:1782759396.064452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759396.064562:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454784 00000100:00100000:2.0:1782759396.064569:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454784 00000100:00100000:2.0:1782759396.064642:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2641 00000100:00100000:2.0:1782759396.064659:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103046:x1869355218454784:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759396.064784:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759396.064801:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bdca lrc: 2/0,0 mode: --/CR res: [0x240000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271d9 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.064840:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bdca lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d9 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.064860:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bdca lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d9 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.064873:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cded88bf800) 00010000:00010000:2.0:1782759396.064875:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759396.064877:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759396.064916:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218454784:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 267us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.064924:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2641 00000100:00100000:0.0:1782759396.066885:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759396.066932:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218454912 00000100:00100000:2.0:1782759396.066939:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218454912 00000100:00100000:2.0:1782759396.066978:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1028 00000100:00100000:2.0:1782759396.066998:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218454912:12345-192.168.202.31@tcp:1:lfs.0 00002000:00010000:2.0:1782759396.067048:0:8600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x6a42bfd9, atime: 0x6a42bfd9, ctime: 0x6a42bfd9, blocks: 0x0 00010000:00010000:2.0:1782759396.067056:0:8600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067071:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=3436s v=(0 0) 00010000:00010000:2.0:1782759396.067076:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759396.067082:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067159:0:8600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067195:0:8600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067203:0:8600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067211:0:8600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067218:0:8600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759396.067222:0:8600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067231:0:8600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067248:0:8600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.067256:0:8600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60bdd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.067325:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218454912:12345-192.168.202.31@tcp:1:lfs.0 Request processed in 338us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.067334:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1028 00000100:00100000:0.0:1782759396.068898:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759396.068935:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759396.068961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759396.069004:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759396.069007:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218455040 00000100:00100000:2.0:1782759396.069016:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218455040 00000100:00100000:0.0:1782759396.069032:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218455552 00000100:00100000:0.0:1782759396.069038:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218455552 00000100:00100000:2.0:1782759396.069067:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218455168 00000100:00100000:2.0:1782759396.069072:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218455168 00000100:00100000:0.0:1782759396.069086:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 8 00000100:00100000:1.0:1782759396.069088:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218455296 00000100:00100000:1.0:1782759396.069094:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218455296 00000100:00100000:0.0:1782759396.069098:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103046:x1869355218455552:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:2.0:1782759396.069116:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 375 00000100:00100000:2.0:1782759396.069126:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2403:x1869355218455040:12345-192.168.202.31@tcp:103:lfs.0 00000100:00100000:1.0:1782759396.069138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 376 00010000:00010000:2.0:1782759396.069140:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1782759396.069149:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:2403:x1869355218455168:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:2.0:1782759396.069176:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bd99 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271cb expref: 14 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.069176:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.069187:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.069194:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bd8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271c4 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.069197:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:0.0:1782759396.069199:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.069206:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759396.069221:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:0.0:1782759396.069221:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.069230:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759396.069246:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809344:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1782759396.069257:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:2403:x1869355218455040:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 131us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.069265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218455168:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 118us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.069267:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 375 00000100:00100000:1.0:1782759396.069279:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 376 00000100:00100000:0.0:1782759396.069292:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.069303:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 377 00000100:00100000:1.0:1782759396.069310:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2403:x1869355218455296:12345-192.168.202.31@tcp:103:lfs.0 00010000:00010000:1.0:1782759396.069317:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759396.069327:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bd7d lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271bd expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.069333:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734240 going to sleep for 11 seconds 00010000:00010000:1.0:1782759396.069336:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:1.0:1782759396.069340:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759396.069357:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:2403:x1869355218455296:12345-192.168.202.31@tcp:103:lfs.0 Request processed in 48us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.069360:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809344 00000100:00100000:1.0:1782759396.069365:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 377 00000100:00100000:0.0:1782759396.069367:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809344 00000100:00100000:0.0:1782759396.069417:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:0.0:1782759396.069428:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6544:x1869355232809344:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1782759396.069437:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759396.069451:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bddf lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bdd8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.069483:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bddf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bdd8 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.069495:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bddf lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bdd8 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.069502:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759396.069505:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.069507:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759396.069554:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809344:12345-0@lo:101:mdt_io00_000.0 Request processed in 129us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.069560:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:1.0:1782759396.070231:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809344:0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759396.070249:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.070259:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759396.070286:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000004:00080000:1.0:1782759396.070302:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x13:0x0] 00000100:00100000:1.0:1782759396.070338:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809472:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759396.070373:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.070407:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759396.070452:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809472 00000100:00100000:3.0:1782759396.070457:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809472 00000100:00100000:3.0:1782759396.070499:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:3.0:1782759396.070507:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809472:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.070613:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809472:12345-0@lo:1000:mdt_io00_000.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.070622:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:1.0:1782759396.070631:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809472:0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759396.071339:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809600:0@lo:403:mdt_io00_000.0 00000100:00100000:1.0:1782759396.071369:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.071395:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdf02142b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.071563:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809600 00000100:00100000:0.0:1782759396.071567:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809600 00000100:00100000:0.0:1782759396.071617:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:0.0:1782759396.071623:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809600:12345-0@lo:403:mdt_io00_000.0 00000100:00100000:0.0:1782759396.072976:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809600:12345-0@lo:403:mdt_io00_000.0 Request processed in 1349us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.072987:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00100000:2.0:1782759396.073109:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809600:0@lo:403:mdt_io00_000.0 00000100:00100000:2.0:1782759396.073763:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809728:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.073792:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.073814:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759396.073826:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809728 00000100:00100000:1.0:1782759396.073832:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809728 00000100:00100000:1.0:1782759396.073873:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:1.0:1782759396.073880:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809728:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759396.073967:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809728:12345-0@lo:1000:mdt_io00_000.0 Request processed in 87us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.073974:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00100000:2.0:1782759396.074126:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809728:0@lo:1000:mdt_io00_000.0 00010000:00010000:2.0:1782759396.074168:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.074175:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.074181:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.074196:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809856:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1782759396.074212:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.074230:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759396.074254:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809856 00000100:00100000:1.0:1782759396.074259:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809856 00000100:00100000:1.0:1782759396.074288:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:1.0:1782759396.074294:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6544:x1869355232809856:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759396.074304:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759396.074317:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 2/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bde6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.074338:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 2/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.074353:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 4/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.074372:0:6537:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1782759396.074393:0:6537:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1782759396.074428:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 3/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.074434:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:1.0:1782759396.074436:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759396.074439:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 3/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 12 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.074448:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759396.074477:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:6544:x1869355232809856:12345-0@lo:101:mdt_io00_000.0 Request processed in 182us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.074482:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:2.0:1782759396.074500:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232809856:0@lo:101:mdt_io00_000.0 00010000:00010000:2.0:1782759396.074512:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.074521:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 4/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.080549:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759396.080570:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080611:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080622:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080630:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.080641:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080667:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759396.080668:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759396.080674:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080683:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080698:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xc:0x0].0x1c8b5715 (ffff8cddc34f4400) 00010000:00010000:0.0:1782759396.080702:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759396.080703:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdecd4dd000/0xd5b45c7f5c60bd22 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bd29 expref: -99 pid: 6546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080707:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080721:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60bc57 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0xc:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759396.080740:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967950 is committed 00010000:00010000:0.0:1782759396.080743:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.080744:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232809984:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1782759396.080755:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759396.080756:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967948 is committed 00010000:00010000:0.0:1782759396.080765:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080771:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.080775:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782759396.080776:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cded855ca80 refcount 2 committed 0 result 0 batchid 15 00000020:00080000:3.0:1782759396.080784:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedb66ed00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc56619c0 00010000:00010000:0.0:1782759396.080788:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782759396.080789:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedb66e200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4e97e40 00000020:00080000:3.0:1782759396.080798:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].15 00000020:00080000:3.0:1782759396.080802:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedb66e000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4875a00 00000020:00080000:3.0:1782759396.080804:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].15 00010000:00010000:0.0:1782759396.080819:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0xd:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:0.0:1782759396.080822:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000020:00080000:3.0:1782759396.080825:0:6509:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 14 batchid updated 00010000:00010000:0.0:1782759396.080826:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 2/0,0 mode: --/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.080829:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759396.080838:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60bc5e lrc: 0/0,0 mode: --/TXN res: [0x200000421:0xd:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782759396.080846:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 15 committed batchid 14 00010000:00010000:0.0:1782759396.080859:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080867:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080874:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080880:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.080884:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080891:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080900:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:0.0:1782759396.080903:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.080906:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080912:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60bd30 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080936:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080944:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080950:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080956:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00000004:00080000:3.0:1782759396.080957:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc2700240 with version 32 00010000:00010000:0.0:1782759396.080960:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.080968:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782759396.080977:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 13 cancel update log [0x240000401:0x2:0x0].13: rc = 0 00010000:00010000:0.0:1782759396.080978:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:0.0:1782759396.080985:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.080989:0:3648:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 2/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.081002:0:3648:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.081005:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232809984 00000100:00100000:1.0:1782759396.081013:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232809984 00010000:00010000:0.0:1782759396.081015:0:3648:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1782759396.081022:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 13 cancel update log [0x200000400:0x2:0x0].13: rc = 0 00010000:00010000:0.0:1782759396.081043:0:3648:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759396.081055:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cded855c840 with version 33 00000020:00080000:3.0:1782759396.081061:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 14 cancel update log [0x240000401:0x2:0x0].14: rc = 0 00000100:00100000:0.0:1782759396.081066:0:3648:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3648:1869355232810112:0@lo:105: 00000100:00100000:1.0:1782759396.081077:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000020:00080000:3.0:1782759396.081089:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 14 cancel update log [0x200000400:0x2:0x0].14: rc = 0 00000100:00100000:0.0:1782759396.081096:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1782759396.081100:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00000100:00100000:1.0:1782759396.081102:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232809984:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1782759396.081118:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759396.081122:0:3648:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc47343c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782759396.081137:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bd29 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x10:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bd22 expref: 6 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.081137:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232810112 00000100:00100000:0.0:1782759396.081141:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232810112 00000100:00100000:0.0:1782759396.081175:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00010000:00010000:1.0:1782759396.081179:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x10:0x0].0x0 (ffff8cded88bf600) 00000100:00100000:0.0:1782759396.081181:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3648:x1869355232810112:12345-0@lo:105: 00010000:00010000:1.0:1782759396.081190:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759396.081191:0:6514:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.081199:0:6514:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.081205:0:6514:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 5/0,1 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.081210:0:6514:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 5/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.081215:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.081221:0:6514:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 6/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759396.081231:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232809984:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 144us (404us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759396.081239:0:6514:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cdedf649400) 00000100:00100000:1.0:1782759396.081240:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1782759396.081291:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3648:x1869355232810112:12345-0@lo:105: Request processed in 110us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.081298:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1782759396.081501:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232809984:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:2.0:1782759396.081526:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 32 rpc_version 32 00000020:00100000:2.0:1782759396.081555:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759396.081562:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc208df80 x1869355232810368/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759396.081614:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232810368:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759396.081644:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.081670:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3d80 going to sleep for 11 seconds 00010000:00010000:2.0:1782759396.081686:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.081696:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759396.081725:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x6:0x0] 00010000:00010000:2.0:1782759396.081753:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.081760:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.081769:0:6544:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.081776:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232810368 00000100:00100000:3.0:1782759396.081782:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232810368 00000100:00100000:2.0:1782759396.081783:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232810496:0@lo:101:mdt_io00_000.0 00000100:00100000:2.0:1782759396.081826:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759396.082712:0:3648:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3648:1869355232810112:0@lo:105: 00010000:00010000:1.0:1782759396.082729:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.082737:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60bd37 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6546 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.083155:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232810496 00000100:00100000:3.0:1782759396.083162:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232810496 00000100:00100000:2.0:1782759396.083170:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759396.083208:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:3.0:1782759396.083217:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7666:x1869355232810368:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759396.083238:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:1.0:1782759396.083247:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6544:x1869355232810496:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759396.083261:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759396.083376:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60bdfb lrc: 2/0,0 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bdf4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.083400:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60bdfb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bdf4 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.083413:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60bdfb lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bdf4 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.083420:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x1c8b5715 (ffff8cded88bf100) 00010000:00010000:1.0:1782759396.083422:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759396.083430:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:3.0:1782759396.083497:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7666:x1869355232810368:12345-0@lo:1000:osp_up1-0.0 Request processed in 280us (1850us total) trans 4294967663 rc 0/0 00000100:00100000:3.0:1782759396.083506:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:2.0:1782759396.083565:0:7666:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967661 gen 2 00000004:00080000:2.0:1782759396.083570:0:7666:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967661 committed transno 4294967661 00000020:00080000:2.0:1782759396.083575:0:7666:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc2700480 refcount 2 committed 0 result 0 batchid 16 00000100:00100000:1.0:1782759396.083877:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232810496:12345-0@lo:101:mdt_io00_000.0 Request processed in 631us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.083883:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000020:00080000:2.0:1782759396.083924:0:7666:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc49d7f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc2700780 00000020:00080000:2.0:1782759396.083926:0:7666:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].16 00000020:00080000:2.0:1782759396.083928:0:7666:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc49d7b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc483fc00 00000020:00080000:2.0:1782759396.083929:0:7666:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].16 00000100:00100000:2.0:1782759396.083957:0:7666:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8cddc208df80 x1869355232810368/t4294967663(4294967663) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1782759412 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782759396.083969:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232810368:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1782759396.083983:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 33 rpc_version 33 00000020:00100000:2.0:1782759396.083997:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759396.084001:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc208ce00 x1869355232810752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759396.084018:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232810752:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759396.084049:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.084059:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759396.084376:0:6544:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967948 gen 2 00000004:00080000:3.0:1782759396.084381:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967945 committed transno 4294967948 00000020:00080000:3.0:1782759396.084385:0:6544:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc45c30c0 refcount 2 committed 0 result 0 batchid 27 00000020:00080000:3.0:1782759396.084388:0:6544:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61f200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3c00 00000020:00080000:3.0:1782759396.084390:0:6544:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].27 00000020:00080000:3.0:1782759396.084392:0:6544:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61f800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc483ea00 00000020:00080000:3.0:1782759396.084393:0:6544:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].27 00000004:00080000:3.0:1782759396.084412:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967946 committed transno 4294967948 00000004:00080000:3.0:1782759396.084419:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967947 committed transno 4294967948 00000004:00080000:3.0:1782759396.084426:0:6544:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967948 committed transno 4294967948 00000100:00100000:3.0:1782759396.084433:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232810496:0@lo:101:mdt_io00_000.0 00010000:00010000:3.0:1782759396.084444:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084453:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759396.084474:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x6:0x0] 00010000:00010000:3.0:1782759396.084490:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084496:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084508:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084515:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084519:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084522:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084572:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6544 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782759396.084604:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 16 committed batchid 14 00000100:00100000:0.0:1782759396.084615:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232810752 00010000:00010000:3.0:1782759396.084619:0:6544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.084622:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232810752 00010000:00010000:3.0:1782759396.084631:0:6544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782759396.084650:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 14 00010000:00010000:3.0:1782759396.084654:0:6544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.084669:0:6544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.084679:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001_UUID:6544:1869355232810880:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759396.084746:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700f00 going to sleep for 11 seconds 00000020:00080000:2.0:1782759396.084757:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 27 committed batchid 26 00000020:00080000:2.0:1782759396.084785:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 26 00000100:00100000:0.0:1782759396.084885:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1782759396.084895:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7666:x1869355232810752:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782759396.085008:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7666:x1869355232810752:12345-0@lo:1000:osp_up1-0.0 Request processed in 115us (957us total) trans 4294967664 rc 0/0 00000100:00100000:0.0:1782759396.085016:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:2.0:1782759396.085843:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232810752:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1782759396.086420:0:6544:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.31@tcp) returned -22 from blocking AST (req@000000000699e590 x1869355232810880) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086441:0:6544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086464:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bdbc lrc: 0/0,0 mode: --/PW res: [0x240000405:0x11:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d2 expref: 9 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.086490:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001_UUID:6544:1869355232810880:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759396.086506:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cded88bf800) 00010000:00010000:3.0:1782759396.086511:0:6544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086521:0:6544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086528:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086555:0:6544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086564:0:6544:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.086569:0:6544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.086727:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811008:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.086783:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.086812:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.086848:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811008 00000100:00100000:0.0:1782759396.086854:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811008 00000100:00100000:0.0:1782759396.086902:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:0.0:1782759396.086923:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811008:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759396.087032:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811008:12345-0@lo:1000:mdt_io00_000.0 Request processed in 121us (248us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759396.087040:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00100000:2.0:1782759396.087068:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811008:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.087112:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811136:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.087143:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.087167:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.087204:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811136 00000100:00100000:0.0:1782759396.087209:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811136 00000100:00100000:0.0:1782759396.087239:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074 00000100:00100000:0.0:1782759396.087298:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811136:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759396.087352:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811136:12345-0@lo:1000:mdt_io00_000.0 Request processed in 58us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.087359:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074 00000100:00100000:2.0:1782759396.087385:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811136:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.087472:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811264:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.087496:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.087518:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.087618:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811264 00000100:00100000:0.0:1782759396.087622:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811264 00000100:00100000:2.0:1782759396.087721:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3075 00000100:00100000:2.0:1782759396.087731:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811264:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.087795:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811264:12345-0@lo:1000:mdt_io00_000.0 Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.087812:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3075 00000100:00100000:3.0:1782759396.087825:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811264:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.087867:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811392:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.087894:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.087911:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.087979:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811392 00000100:00100000:0.0:1782759396.087991:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811392 00000100:00100000:0.0:1782759396.088026:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1782759396.088032:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811392:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:0.0:1782759396.088084:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811392:12345-0@lo:1000:mdt_io00_000.0 Request processed in 52us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.088092:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:3.0:1782759396.088110:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811392:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.088170:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811520:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.088195:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.088224:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759396.088250:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811520 00000100:00100000:2.0:1782759396.088255:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811520 00000100:00100000:2.0:1782759396.088291:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:2.0:1782759396.088298:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811520:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.088417:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6544:x1869355232811520:12345-0@lo:1000:mdt_io00_000.0 Request processed in 119us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.088430:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00100000:3.0:1782759396.088444:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811520:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.088532:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811648:0@lo:1000:mdt_io00_000.0 00000100:00100000:3.0:1782759396.088572:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.088616:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.088622:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811648 00000100:00100000:0.0:1782759396.088627:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811648 00000100:00100000:0.0:1782759396.088734:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1782759396.088743:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6544:x1869355232811648:12345-0@lo:1000:mdt_io00_000.0 00000100:00080000:3.0:1782759396.088793:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759396.088814:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:6544:x1869355232811648:12345-0@lo:1000:mdt_io00_000.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.088830:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:2.0:1782759396.088841:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811648:0@lo:1000:mdt_io00_000.0 00000040:00080000:2.0:1782759396.089151:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].28, 1272 off61768 00000040:00080000:2.0:1782759396.089205:0:6544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].28, 1352 off64864 00000100:00100000:2.0:1782759396.089231:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811776:0@lo:1000:mdt_io00_000.0 00000100:00100000:2.0:1782759396.089259:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.089280:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759396.089296:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232811776 00000100:00100000:1.0:1782759396.089302:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232811776 00000100:00100000:1.0:1782759396.089342:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079 00000100:00100000:1.0:1782759396.089352:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:6544:x1869355232811776:12345-0@lo:1000:mdt_io00_000.0 00000100:00100000:1.0:1782759396.089470:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6544:x1869355232811776:12345-0@lo:1000:mdt_io00_000.0 Request processed in 119us (208us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1782759396.089477:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079 00000100:00100000:2.0:1782759396.089557:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001-mdtlov_UUID:6544:1869355232811776:0@lo:1000:mdt_io00_000.0 00000004:00080000:2.0:1782759396.089566:0:6544:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc2700780 with version 57 00000004:00080000:3.0:1782759396.089712:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 57 rpc_version 57 00000020:00100000:3.0:1782759396.089734:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759396.089742:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4bce680 x1869355232812032/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759396.089756:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232812032:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759396.089785:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.089797:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec76db000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.089922:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232812032 00000100:00100000:0.0:1782759396.089928:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232812032 00000100:00100000:0.0:1782759396.089963:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:0.0:1782759396.089971:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232812032:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759396.090208:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232812032:12345-0@lo:1000:osp_up0-1.0 Request processed in 239us (423us total) trans 4294967951 rc 0/0 00000100:00100000:0.0:1782759396.090213:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00100000:3.0:1782759396.090262:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232812032:0@lo:1000:osp_up0-1.0 00000004:00010000:2.0:1782759396.090323:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d69d416 reply state 00000000e413fe48 transno 4294967665 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090343:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090352:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cded88bf800) 00010000:00010000:2.0:1782759396.090355:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00000100:00100000:2.0:1782759396.090358:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759396.090366:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090374:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090381:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090387:0:6544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090408:0:6544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759396.090412:0:6544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090420:0:6544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090432:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:2.0:1782759396.090434:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759396.090438:0:6544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090444:0:6544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60be02 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759396.090462:0:6544:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d69d416 reply state 00000000e413fe48 transno 4294967665 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090482:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090489:0:6544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x1c8b5715 (ffff8cded3a3b400) 00010000:00010000:2.0:1782759396.090491:0:6544:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759396.090493:0:6544:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00080000:2.0:1782759396.090498:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x6:0x0] 00010000:00010000:2.0:1782759396.090504:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090511:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090529:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090563:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782759396.090570:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000400:0x6:0x0] 00010000:00010000:2.0:1782759396.090607:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090616:0:6544:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759396.090628:0:6544:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x13:0x0] 00010000:00010000:2.0:1782759396.090636:0:6544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.090644:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 4/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.090791:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.090798:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.090805:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759396.090810:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759396.090829:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.090854:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.090860:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759396.090884:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 1/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.090891:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60bde6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bded expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.090906:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759396.090908:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232812160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.090910:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.090913:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759396.090949:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.091022:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232812160 00000100:00100000:0.0:1782759396.091027:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232812160 00000100:00100000:0.0:1782759396.091063:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782759396.091072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3665:x1869355232812160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.091085:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.091101:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bded lrc: 0/0,0 mode: --/CW res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bde6 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091114:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:0.0:1782759396.091120:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759396.091154:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3665:x1869355232812160:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.091167:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1782759396.091179:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232812160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759396.091211:0:6544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.091229:0:6544:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782759396.091333:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218455552:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 22237us (22327us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1782759396.091338:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 8 00010000:00010000:0.0:1782759396.091373:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.091377:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091382:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759396.091385:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759396.091390:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091403:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091406:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759396.091423:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 1/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091428:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dcc00/0xd5b45c7f5c60bdd8 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bddf expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091437:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.091439:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759396.091440:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759396.091445:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232812288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759396.091475:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.091849:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232812288 00000100:00100000:0.0:1782759396.091855:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232812288 00000100:00100000:0.0:1782759396.091935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1782759396.091944:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3662:x1869355232812288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.091961:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.091974:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60bddf lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bdd8 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.091988:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759396.091995:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759396.092034:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355232812288:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.092041:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1782759396.092062:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232812288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759396.094086:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.094232:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218455808 00000100:00100000:3.0:1782759396.094240:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218455808 00000100:00100000:3.0:1782759396.094287:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 313 00000100:00100000:3.0:1782759396.094299:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103046:x1869355218455808:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759396.094493:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103046:x1869355218455808:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 196us (414us total) trans 4294967952 rc 0/0 00000100:00100000:3.0:1782759396.094502:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 313 00000100:00100000:3.0:1782759396.096320:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759396.096547:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218455936 00000100:00100000:0.0:1782759396.096556:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218455936 00000100:00100000:0.0:1782759396.096642:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2642 00000100:00100000:0.0:1782759396.097007:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103046:x1869355218455936:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759396.097029:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759396.097051:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60be17 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271e0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097114:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097128:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097139:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097150:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097174:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097181:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097237:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60be2c lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097246:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60be2c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097253:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60be2c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759396.097275:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60be2c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097285:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097289:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097293:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097297:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097300:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.097303:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097313:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097322:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:0.0:1782759396.097324:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.097327:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097331:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60be1e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097339:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097343:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097346:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097349:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759396.097351:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097354:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097357:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759396.097359:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759396.097360:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097369:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60be25 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097388:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60be17 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e0 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097397:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60be2c lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e0 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.097401:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:0.0:1782759396.097403:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759396.097405:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc000, rc 0) 00000100:00100000:0.0:1782759396.097464:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103046:x1869355218455936:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 813us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.097472:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2642 00000100:00100000:0.0:1782759396.099408:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759396.099480:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.099529:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456064 00000100:00100000:3.0:1782759396.099549:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456064 00000100:00100000:2.0:1782759396.099558:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456192 00000100:00100000:2.0:1782759396.099562:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456192 00000100:00100000:2.0:1782759396.099654:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 381 00000100:00100000:2.0:1782759396.099664:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:2402:x1869355218456192:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759396.099681:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759396.099703:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60be2c lrc: 0/0,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e0 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.099718:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:2.0:1782759396.099722:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759396.099776:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2402:x1869355218456192:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 113us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759396.099784:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 381 00000100:00100000:3.0:1782759396.100078:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2643 00000100:00100000:3.0:1782759396.100087:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103046:x1869355218456064:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759396.100106:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759396.100124:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60be33 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271e7 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.100169:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.100180:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.100189:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759396.100321:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x13:0x0]: returning size 4096 00000004:00200000:3.0:1782759396.100326:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1782759396.100358:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60be33 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.100381:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.100388:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759396.100390:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759396.100393:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759396.100430:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218456064:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 344us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.100436:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2643 00000100:00100000:0.0:1782759396.102259:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.102321:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456448 00000100:00100000:3.0:1782759396.102328:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456448 00000100:00100000:3.0:1782759396.102369:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2644 00000100:00100000:3.0:1782759396.102378:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103046:x1869355218456448:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759396.102482:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.102492:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.102503:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.102523:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232812416:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1782759396.102752:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.102858:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759396.102894:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232812416 00000100:00100000:1.0:1782759396.102900:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232812416 00000100:00100000:1.0:1782759396.102995:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081 00000100:00100000:1.0:1782759396.103003:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12673:x1869355232812416:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759396.103018:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759396.103034:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60be41 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.103071:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be41 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.103081:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be41 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.103086:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759396.103088:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759396.103090:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759396.103133:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232812416:12345-0@lo:101:mdt00_004.0 Request processed in 131us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.103140:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081 00000100:00100000:2.0:1782759396.103166:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232812416:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1782759396.103180:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.103190:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759396.103209:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759396.103235:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 3/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.103242:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 3/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.103250:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 3/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.103271:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232812544:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1782759396.103299:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.103323:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.103335:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232812544 00000100:00100000:0.0:1782759396.103340:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232812544 00000100:00100000:0.0:1782759396.103371:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:0.0:1782759396.103378:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:12673:x1869355232812544:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1782759396.103387:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759396.103398:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60be4f expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.103413:0:39509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.103428:0:39509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 4/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.103451:0:39509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.103463:0:39509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 9 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.103475:0:39509:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:39509:1869355232812672:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759396.103549:0:39509:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759396.107055:0:39509:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001_UUID:39509:1869355232812672:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759396.107090:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 3/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.107099:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:1.0:1782759396.107101:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759396.107104:0:39509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 3/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.107110:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc200, rc 0) 00000100:00100000:1.0:1782759396.107159:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:12673:x1869355232812544:12345-0@lo:101:mdt00_004.0 Request processed in 3781us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.107168:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000100:00100000:2.0:1782759396.107186:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232812544:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1782759396.107203:0:12673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.107214:0:12673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.107979:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759396.108018:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456576 00000100:00100000:2.0:1782759396.108025:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456576 00010000:00010000:2.0:1782759396.108057:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 10 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.108093:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 709 00000100:00100000:2.0:1782759396.108104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218456576:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759396.108117:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759396.108123:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 10 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108135:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 10 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108155:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60bd61 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271af expref: 10 pid: 6533 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108188:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:2.0:1782759396.108194:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108204:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108212:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108247:0:6515:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.108260:0:6515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6515:1869355232812800:0@lo:105: 00000100:00100000:2.0:1782759396.108299:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.108338:0:6515:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.108559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232812800 00000100:00100000:0.0:1782759396.108564:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232812800 00000100:00100000:0.0:1782759396.108621:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:0.0:1782759396.108629:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6515:x1869355232812800:12345-0@lo:105: 00010000:00010000:0.0:1782759396.108639:0:6513:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 5/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.108658:0:6513:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 5/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.108667:0:6513:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 5/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.108674:0:6513:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 5/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.108688:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 6/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.108817:0:6513:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 6/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.108835:0:6513:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8cdedf649000) 00010000:00010000:2.0:1782759396.108854:0:12673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108864:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108897:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108909:0:12673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.108924:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6515:x1869355232812800:12345-0@lo:105: Request processed in 297us (624us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759396.108929:0:12673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 4/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.108932:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00010000:00010000:2.0:1782759396.108952:0:12673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.108965:0:12673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 7 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.108976:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12673:1869355232812928:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759396.109092:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759396.109475:0:6515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001_UUID:6515:1869355232812800:0@lo:105: 00010000:00010000:1.0:1782759396.109496:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759396.110131:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218456576:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 2026us (2153us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.110140:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 709 00000100:00100000:2.0:1782759396.114389:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12673:1869355232812928:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759396.114427:0:12673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.114816:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759396.115147:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456704 00000100:00100000:3.0:1782759396.115154:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456704 00010000:00010000:3.0:1782759396.115187:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 8 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759396.115270:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 710 00000100:00100000:3.0:1782759396.115279:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218456704:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759396.115293:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759396.115299:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 8 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.115311:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 8 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.115331:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60be3a lrc: 0/0,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271e7 expref: 8 pid: 8593 timeout: 3536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.115345:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759396.115349:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.115357:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.115364:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.115393:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759396.115444:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218456704:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 165us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.115452:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 710 00010000:00010000:2.0:1782759396.115454:0:12673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115460:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115492:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115502:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115509:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115558:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115565:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.115574:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 3/0,1 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.115606:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232813056:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1782759396.115649:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.115730:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.116930:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813056 00000100:00100000:0.0:1782759396.116939:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813056 00000100:00100000:0.0:1782759396.117101:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083 00000100:00100000:0.0:1782759396.117112:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:12673:x1869355232813056:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1782759396.117130:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759396.117148:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60be72 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60be6b expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.117170:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60be72 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be6b expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.117184:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60be72 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be6b expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.117219:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:0.0:1782759396.117233:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:0.0:1782759396.117236:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759396.117305:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:12673:x1869355232813056:12345-0@lo:101:mdt00_004.0 Request processed in 195us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.117314:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083 00000100:00100000:2.0:1782759396.117381:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232813056:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1782759396.117397:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.117408:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.118110:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232813184:0@lo:403:mdt00_004.0 00000100:00100000:2.0:1782759396.118162:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759396.118191:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759396.118262:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813184 00000100:00100000:0.0:1782759396.118268:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813184 00000100:00100000:0.0:1782759396.118314:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1782759396.118323:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:12673:x1869355232813184:12345-0@lo:403:mdt00_004.0 00000100:00100000:0.0:1782759396.121233:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:12673:x1869355232813184:12345-0@lo:403:mdt00_004.0 Request processed in 2902us (3062us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.121247:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:2.0:1782759396.121375:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12673:1869355232813184:0@lo:403:mdt00_004.0 00000040:00080000:2.0:1782759396.122407:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].17, 392 off51512 00000040:00080000:2.0:1782759396.122839:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].17, 472 off53512 00000004:00080000:2.0:1782759396.122847:0:12673:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc45c3b40 with version 34 00000004:00080000:3.0:1782759396.123027:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 34 rpc_version 34 00000020:00100000:3.0:1782759396.123069:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759396.123077:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc3742300 x1869355232813440/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1176/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759396.123100:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232813440:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782759396.123158:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759396.123189:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759396.123240:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813440 00000100:00100000:2.0:1782759396.123253:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813440 00000100:00100000:2.0:1782759396.123315:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:2.0:1782759396.123325:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7666:x1869355232813440:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759396.123685:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+11:7666:x1869355232813440:12345-0@lo:1000:osp_up1-0.0 Request processed in 360us (526us total) trans 4294967666 rc 0/0 00000100:00100000:2.0:1782759396.123694:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:1.0:1782759396.123858:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232813440:0@lo:1000:osp_up1-0.0 00000004:00010000:2.0:1782759396.123926:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084ee5739 reply state 00000000fc50b48f transno 4294967953 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.123949:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.123956:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:2.0:1782759396.123958:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00000100:00100000:2.0:1782759396.123961:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759396.123967:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 4/0,1 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.123972:0:12673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759396.123982:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000084ee5739 reply state 00000000fc50b48f transno 4294967953 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.124056:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.124060:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:2.0:1782759396.124061:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3e 00000100:00100000:2.0:1782759396.124063:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1782759396.124072:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.124076:0:12673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759396.124084:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759396.124088:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759396.124091:0:12673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.124149:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103046:x1869355218456448:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 21772us (21894us total) trans 4294967953 rc 0/0 00000100:00100000:2.0:1782759396.124155:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2644 00000100:00100000:1.0:1782759396.237814:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232813568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759396.237877:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.237928:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813568 00000100:00100000:0.0:1782759396.237938:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813568 00000100:00100000:1.0:1782759396.238038:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3086 00000100:00100000:1.0:1782759396.238050:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232813568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759396.238086:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445941248 avail 1299701760 00000100:00100000:1.0:1782759396.238139:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232813568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759396.238146:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3086 00000100:00100000:2.0:1782759396.238186:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232813568:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1782759396.505468:0:138693:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebc4bdea0 20000000:00000080:0.0:1782759396.505484:0:138693:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4ab2c00 uarg=0000000000000000 00010000:00010000:0.0:1782759396.505711:0:138693:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759396.505738:0:138693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cded88bf800) 00010000:00010000:0.0:1782759396.505741:0:138693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759396.505752:0:138693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bdca lrc: 0/0,0 mode: --/CR res: [0x240000405:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271d9 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.505768:0:138693:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759396.505793:0:138693:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759396.505804:0:138693:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759396.505822:0:138693:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759396.505835:0:138693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.505857:0:138693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.505863:0:138693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.505889:0:138693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.505901:0:138693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 23 pid: 6526 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.505917:0:138693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138693:1869355232813696:0@lo:104: 00000100:00100000:0.0:1782759396.505979:0:138693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.506035:0:138693:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759396.506130:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813696 00000100:00100000:3.0:1782759396.506136:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813696 00000100:00100000:3.0:1782759396.506179:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1782759396.506188:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:138693:x1869355232813696:12345-0@lo:104: 00010000:00010000:3.0:1782759396.506200:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.506254:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759396.506260:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:138693:x1869355232813696:12345-0@lo:104: Request processed in 73us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759396.506266:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:0.0:1782759396.506272:0:138693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:138693:1869355232813696:0@lo:104: 00010000:00010000:1.0:1782759396.506284:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759396.506290:0:138693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.506291:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.506306:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759396.506310:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.506317:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759396.506322:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759396.506336:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759396.506365:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.506372:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759396.506392:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759396.506397:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60b97f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60b986 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.506404:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1782759396.506410:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759396.506413:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759396.506415:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759396.506417:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232813824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759396.506442:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759396.506471:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813824 00000100:00100000:0.0:1782759396.506477:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813824 00010000:00010000:0.0:1782759396.506497:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 24 pid: 6526 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759396.506525:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1782759396.506533:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232813824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.506554:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759396.506560:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 24 pid: 6526 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506626:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 24 pid: 6526 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506638:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60b986 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60b97f expref: 24 pid: 6526 timeout: 3586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506652:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506660:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506672:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506679:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506686:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506692:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506698:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759396.506702:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506710:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506739:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759396.506749:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759396.506782:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232813824:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759396.506790:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00010000:00010000:3.0:1782759396.506791:0:138693:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.506800:0:138693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759396.506807:0:138693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60be79 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 138693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759396.506808:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232813824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759396.684045:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759397.258723:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232813952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.258767:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232814080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.258795:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.258821:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.258829:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232814208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.258846:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232814464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759397.258873:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.258883:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232814336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759397.258907:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232814720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.258919:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232813952 00000100:00100000:0.0:1782759397.258927:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232813952 00000100:00100000:1.0:1782759397.258990:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814080 00000100:00100000:1.0:1782759397.258996:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814080 00000100:00100000:3.0:1782759397.259001:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232814592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759397.259033:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4870 00000100:00100000:1.0:1782759397.259042:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259093:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232814080:12345-0@lo:400:kworker.0 Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.259101:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4870 00000100:00100000:0.0:1782759397.259225:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:0.0:1782759397.259234:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232813952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.259268:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.259276:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232813952:12345-0@lo:400:kworker.0 Request processed in 43us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.259284:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1782759397.259298:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232815104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259317:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814208 00000100:00100000:0.0:1782759397.259322:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814208 00000100:00100000:3.0:1782759397.259327:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.259345:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232815616:0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259354:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814592 00000100:00100000:1.0:1782759397.259358:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814592 00000100:00100000:3.0:1782759397.259375:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.259375:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087 00000100:00100000:0.0:1782759397.259389:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232814208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259398:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:1.0:1782759397.259406:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232814592:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759397.259414:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232814080:0@lo:400:kworker.0 00002000:00000024:1.0:1782759397.259426:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759397.259433:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232814208:12345-0@lo:400:kworker.0 Request processed in 47us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.259450:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087 00000100:00100000:3.0:1782759397.259454:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815104 00000100:00100000:3.0:1782759397.259458:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815104 00000100:00100000:1.0:1782759397.259467:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232814592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.259480:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:0.0:1782759397.259488:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.259490:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815616 00000100:00100000:3.0:1782759397.259494:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815616 00000100:00100000:1.0:1782759397.259505:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:1.0:1782759397.259514:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232815104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.259521:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:0.0:1782759397.259525:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232814848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259555:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232815104:12345-0@lo:400:kworker.0 Request processed in 42us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.259560:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00100000:0.0:1782759397.259570:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759397.259591:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759397.259595:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759397.259616:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232815104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259621:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232815360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.259637:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232815616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259639:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232814592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759397.259684:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232815616:12345-0@lo:400:kworker.0 Request processed in 154us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.259691:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:0.0:1782759397.259709:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.259720:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814336 00000100:00100000:3.0:1782759397.259724:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814336 00000100:00100000:1.0:1782759397.259743:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232815616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259752:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.259753:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814848 00000100:00100000:3.0:1782759397.259757:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814848 00000100:00100000:2.0:1782759397.259765:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815360 00000100:00100000:2.0:1782759397.259770:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815360 00000100:00100000:1.0:1782759397.259775:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814464 00000100:00100000:0.0:1782759397.259777:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232814976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259782:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814464 00000100:00100000:3.0:1782759397.259791:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4871 00000100:00100000:3.0:1782759397.259803:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232814336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259805:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.259819:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4872 00000100:00100000:2.0:1782759397.259830:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232814848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259830:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232815488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.259834:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:1.0:1782759397.259849:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:3665:x1869355232814464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259856:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.259878:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232813952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.259904:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814976 00000100:00100000:2.0:1782759397.259905:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232814848:12345-0@lo:400:kworker.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.259910:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232814336:12345-0@lo:400:kworker.0 Request processed in 110us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.259910:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814976 00000100:00100000:2.0:1782759397.259923:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4872 00000100:00100000:1.0:1782759397.259925:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+11:3665:x1869355232814464:12345-0@lo:400:kworker.0 Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.259931:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4871 00000100:00100000:1.0:1782759397.259941:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:2.0:1782759397.259946:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4873 00000100:00100000:0.0:1782759397.259947:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815488 00000100:00100000:0.0:1782759397.259953:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815488 00000100:00100000:2.0:1782759397.259957:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232815360:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759397.259966:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759397.259972:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759397.259989:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.259995:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232815360:12345-0@lo:400:kworker.0 Request processed in 40us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.260003:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4873 00000100:00100000:1.0:1782759397.260014:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232814720 00000100:00100000:1.0:1782759397.260018:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232814720 00000100:00100000:1.0:1782759397.260048:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4874 00000100:00100000:1.0:1782759397.260054:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232814720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.260076:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232814720:12345-0@lo:400:kworker.0 Request processed in 25us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.260085:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4874 00000100:00080000:1.0:1782759397.260096:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759397.260169:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1782759397.260176:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232814976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260200:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232814976:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.260204:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1782759397.260211:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1782759397.260214:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232815488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260229:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232815488:12345-0@lo:400:kworker.0 Request processed in 14us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.260244:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1782759397.260278:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232814336:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260286:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232814848:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260291:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232815360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260309:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232814464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260314:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232814976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759397.260319:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232815488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.260566:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232815232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.260657:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.260691:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232814208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759397.260702:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232814720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.260724:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815232 00000100:00100000:1.0:1782759397.260727:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815232 00000100:00080000:0.0:1782759397.260756:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759397.260761:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4875 00000100:00100000:1.0:1782759397.260769:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232815232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759397.260810:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232815232:12345-0@lo:400:kworker.0 Request processed in 41us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.260817:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4875 00000100:00100000:1.0:1782759397.260849:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232815232:0@lo:400:kworker.0 00010000:00010000:0.0:1782759397.706750:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759397.771840:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759397.771862:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232815744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759397.771942:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.772011:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815744 00000100:00100000:2.0:1782759397.772018:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815744 00000100:00100000:2.0:1782759397.772063:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:2.0:1782759397.772071:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232815744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759397.772090:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759397.772132:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232815744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.772140:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:3.0:1782759397.772183:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232815744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759397.870722:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759397.870794:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456832 00000100:00100000:2.0:1782759397.870804:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456832 00000100:00100000:2.0:1782759397.870909:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2645 00000100:00100000:2.0:1782759397.870920:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103119:x1869355218456832:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759397.870941:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759397.870967:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60be80 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271ee expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871024:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871036:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871045:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871055:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871059:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871063:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871099:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871103:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871107:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871111:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871115:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759397.871122:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871127:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871135:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:2.0:1782759397.871138:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.871141:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871145:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60be87 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871153:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871156:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871160:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871163:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759397.871165:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871168:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871171:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cddc34fd500) 00010000:00010000:2.0:1782759397.871172:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.871177:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871181:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60be8e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871201:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60be80 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271ee expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871207:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:2.0:1782759397.871208:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.871211:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60be80 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271ee expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.871215:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759397.871258:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103119:x1869355218456832:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 342us (545us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759397.871266:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2645 00000100:00080000:0.0:1782759397.872603:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759397.875190:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.875234:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218456960 00000100:00100000:1.0:1782759397.875244:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218456960 00000100:00100000:1.0:1782759397.875299:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2646 00000100:00100000:1.0:1782759397.875311:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103119:x1869355218456960:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759397.875332:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.875350:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60be95 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271f5 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875420:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875434:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875446:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875460:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875473:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875480:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875532:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875540:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875546:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875553:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875559:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759397.875563:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875570:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875628:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759397.875632:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.875637:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875644:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60be9c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875664:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875671:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875815:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875821:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759397.875824:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875830:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875839:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cded88bf500) 00010000:00010000:1.0:1782759397.875841:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.875845:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875851:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bea3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875879:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60be95 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271f5 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875886:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759397.875888:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.875943:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60be95 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271f5 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.875952:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428800, rc 0) 00000100:00100000:1.0:1782759397.876004:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103119:x1869355218456960:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 697us (820us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759397.876010:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2646 00000100:00100000:1.0:1782759397.879031:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759397.879076:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218457088 00000100:00100000:3.0:1782759397.879087:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218457088 00000100:00100000:3.0:1782759397.879142:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2647 00000100:00100000:3.0:1782759397.879152:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:103119:x1869355218457088:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759397.879183:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759397.879203:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60beaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb271fc expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.879259:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.879271:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be41 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.879277:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.879304:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60be41 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.879329:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232815872:0@lo:104: 00000100:00100000:3.0:1782759397.879381:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.879435:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232815872 00000100:00100000:0.0:1782759397.879441:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232815872 00000100:00100000:3.0:1782759397.879442:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c96240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.879497:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:0.0:1782759397.879508:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6533:x1869355232815872:12345-0@lo:104: 00010000:00010000:0.0:1782759397.879521:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.879616:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759397.879624:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6533:x1869355232815872:12345-0@lo:104: Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.879633:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1782759397.879661:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232815872:0@lo:104: 00010000:00010000:0.0:1782759397.879661:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759397.879670:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.879686:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.879688:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759397.879696:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759397.879708:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.879748:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.879755:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759397.879793:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.879801:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc3de5800/0xd5b45c7f5c60be41 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60be48 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.879818:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.879820:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.879822:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759397.879831:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759397.879842:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232816000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759397.879874:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759397.882702:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816000 00000100:00100000:1.0:1782759397.882715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816000 00010000:00010000:1.0:1782759397.882752:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60be41 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.882792:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1782759397.882803:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+11:3665:x1869355232816000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759397.882817:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759397.888990:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759397.889008:0:7461:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 3/0,0 mode: PW/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889064:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 2/0,0 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889076:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759397.889104:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60bdf4 lrc: 0/0,0 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bdfb expref: -99 pid: 6544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759397.889120:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967666 is committed 00000100:00100000:3.0:1782759397.889125:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232816128:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:2.0:1782759397.889141:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967665 is committed 00000020:00080000:2.0:1782759397.889155:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 27 batchid updated 00010000:00010000:2.0:1782759397.889185:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.889190:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759397.889199:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889207:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889213:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759397.889217:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889225:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.889237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816128 00010000:00010000:2.0:1782759397.889239:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x1c8b5715 (ffff8cded3a3b400) 00010000:00010000:2.0:1782759397.889244:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759397.889245:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816128 00010000:00010000:2.0:1782759397.889249:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889257:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60be09 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889283:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.889291:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00010000:00010000:2.0:1782759397.889293:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889301:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.889304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232816128:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782759397.889318:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759397.889321:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759397.889323:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889331:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.889342:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60bdfb lrc: 0/0,0 mode: --/PW res: [0x200000400:0x6:0x0].0x1c8b5715 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bdf4 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.889342:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x11:0x0].0x0 (ffff8cded88bf800) 00010000:00010000:2.0:1782759397.889355:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 25 00010000:00010000:3.0:1782759397.889357:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x1c8b5715 (ffff8cded88bf100) 00010000:00010000:2.0:1782759397.889359:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.889364:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759397.889370:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60be10 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x11:0x0].0x0 bits 0x25/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6544 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759397.889398:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 27 00000100:00100000:3.0:1782759397.889403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3665:x1869355232816128:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 100us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.889412:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1782759397.889448:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232816128:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:2.0:1782759397.889466:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4f376c0 with version 58 00000020:00080000:2.0:1782759397.889479:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 27 cancel update log [0x200000401:0x2:0x0].27: rc = 0 00000004:00080000:3.0:1782759397.889499:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 58 rpc_version 58 00000020:00100000:3.0:1782759397.889517:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759397.889533:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc3740700 x1869355232816384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759397.889551:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232816384:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1782759397.889563:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 27 cancel update log [0x240000400:0x2:0x0].27: rc = 0 00000020:00080000:2.0:1782759397.889595:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 27 00000100:00100000:3.0:1782759397.889605:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.889626:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c96240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759397.889631:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816384 00000100:00100000:2.0:1782759397.889637:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816384 00000100:00100000:2.0:1782759397.889685:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:2.0:1782759397.889692:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232816384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759397.889811:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232816384:12345-0@lo:1000:osp_up0-1.0 Request processed in 118us (205us total) trans 4294967954 rc 0/0 00000100:00100000:2.0:1782759397.889818:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:3.0:1782759397.889965:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232816384:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1782759397.890743:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60be48 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60be41 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.890757:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759397.890761:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.890770:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.890777:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.890836:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759397.890886:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3665:x1869355232816000:12345-0@lo:103:ldlm_bl.0 Request processed in 8085us (11011us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.890894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1782759397.890961:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232816000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759397.891006:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.891014:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759397.891060:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759397.891064:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759397.891084:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.891113:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60beaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271fc expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.891134:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271fc expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.891142:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:2.0:1782759397.891145:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759397.891147:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:2.0:1782759397.891228:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103119:x1869355218457088:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 12078us (12208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.891244:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2647 00000100:00100000:2.0:1782759397.894912:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.894959:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218457344 00000100:00100000:0.0:1782759397.894969:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218457344 00000100:00100000:0.0:1782759397.895028:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2648 00000100:00100000:0.0:1782759397.895040:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103119:x1869355218457344:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759397.895104:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759397.895130:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60beb1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb271fc expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.895148:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:0.0:1782759397.895158:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759397.895216:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103119:x1869355218457344:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 179us (310us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759397.895223:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2648 00000100:00100000:2.0:1782759397.904641:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.904702:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218457472 00000100:00100000:0.0:1782759397.904713:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218457472 00000100:00100000:0.0:1782759397.904777:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2649 00000100:00100000:0.0:1782759397.904790:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103120:x1869355218457472:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759397.904825:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.904850:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60beb8 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27203 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.904911:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.904925:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.904935:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.904948:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.904967:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.904974:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905023:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905041:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905054:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905060:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905066:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759397.905070:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905077:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905090:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759397.905093:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.905096:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905102:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bebf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905119:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905125:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905130:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905136:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759397.905139:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905145:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905153:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759397.905155:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.905158:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905162:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bec6 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905192:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60beb8 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27203 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905202:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759397.905204:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.905214:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60beb8 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27203 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.905228:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dcc00, rc 0) 00000100:00100000:0.0:1782759397.905291:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103120:x1869355218457472:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 504us (660us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759397.905299:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2649 00000100:00100000:0.0:1782759397.907023:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.907085:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218457600 00000100:00100000:1.0:1782759397.907094:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218457600 00000100:00100000:1.0:1782759397.907151:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2650 00000100:00100000:1.0:1782759397.907179:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103120:x1869355218457600:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759397.907194:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.907214:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60becd lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2720a expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907267:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907280:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907292:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907309:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907327:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907336:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907367:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907387:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907394:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907400:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907407:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759397.907411:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907420:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907432:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf500) 00010000:00010000:1.0:1782759397.907436:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.907440:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907447:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60bed4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907463:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907469:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907475:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907488:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759397.907492:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907500:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907511:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cded88bff00) 00010000:00010000:1.0:1782759397.907514:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.907517:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907532:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bedb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907562:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60becd lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2720a expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907570:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf500) 00010000:00010000:1.0:1782759397.907572:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.907591:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60becd lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2720a expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.907602:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759397.907655:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103120:x1869355218457600:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 480us (637us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759397.907664:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2650 00000100:00100000:2.0:1782759397.909730:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.909923:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218457728 00000100:00100000:1.0:1782759397.909940:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218457728 00000100:00100000:1.0:1782759397.910121:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2651 00000100:00100000:1.0:1782759397.910133:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103120:x1869355218457728:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759397.910150:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.910170:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27211 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.910222:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bee9 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.910234:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bee9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.910244:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bee9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759397.910282:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759397.910285:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759397.910304:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bee9 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.910326:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60bee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27211 expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.910346:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bee9 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27211 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.910354:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf300) 00010000:00010000:1.0:1782759397.910357:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759397.910360:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759397.910426:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103120:x1869355218457728:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 295us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.910433:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2651 00000100:00100000:3.0:1782759397.913537:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759397.913572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759397.913669:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218458112 00000100:00100000:2.0:1782759397.913679:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218458112 00000100:00100000:0.0:1782759397.913704:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218457856 00000100:00100000:0.0:1782759397.913711:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218457856 00000100:00100000:2.0:1782759397.913746:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2652 00000100:00100000:0.0:1782759397.913773:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2653 00000100:00100000:2.0:1782759397.913774:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103120:x1869355218458112:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:0.0:1782759397.913787:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218457856:12345-192.168.202.31@tcp:41:lfs.0 00000004:00000024:0.0:1782759397.913815:0:6532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00010000:00010000:2.0:1782759397.913825:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759397.913861:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60bee9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27211 expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759397.913879:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218457856:12345-192.168.202.31@tcp:41:lfs.0 Request processed in 95us (305us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759397.913882:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf300) 00000100:00100000:0.0:1782759397.913889:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2653 00010000:00010000:2.0:1782759397.913895:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759397.913932:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103120:x1869355218458112:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 169us (411us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759397.913939:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2652 00000100:00100000:0.0:1782759397.920968:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.921010:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759397.921033:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218458240 00000100:00100000:2.0:1782759397.921043:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218458240 00000100:00100000:1.0:1782759397.921049:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218458496 00000100:00100000:1.0:1782759397.921056:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218458496 00000100:00080000:0.0:1782759397.921097:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759397.921126:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2654 00000100:00100000:1.0:1782759397.921137:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2655 00000100:00100000:2.0:1782759397.921142:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:103121:x1869355218458496:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:1.0:1782759397.921151:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218458240:12345-192.168.202.31@tcp:41:mkdir.0 00000004:00000024:1.0:1782759397.921182:0:12673:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445941248 avail 1299701760 00000100:00100000:2.0:1782759397.921252:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816512:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759397.921254:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218458240:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.921265:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2655 00000100:00100000:2.0:1782759397.921299:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.921328:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.921345:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816512 00000100:00100000:0.0:1782759397.921350:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816512 00000100:00100000:0.0:1782759397.921400:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:0.0:1782759397.921408:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232816512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.921460:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232816512:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.921467:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:2.0:1782759397.921490:0:6531:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967666 gen 2 00000004:00080000:2.0:1782759397.921507:0:6531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967663 committed transno 4294967666 00000004:00080000:2.0:1782759397.921538:0:6531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967664 committed transno 4294967666 00000004:00080000:2.0:1782759397.921547:0:6531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967666 committed transno 4294967666 00000100:00100000:2.0:1782759397.921563:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.921632:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816640:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.921657:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.921669:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.921728:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816640 00000100:00100000:0.0:1782759397.921736:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816640 00000100:00100000:0.0:1782759397.921768:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1782759397.921774:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232816640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.921846:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232816640:12345-0@lo:1000:mdt00_000.0 Request processed in 72us (189us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759397.921852:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:2.0:1782759397.921909:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816640:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1782759397.921953:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.921963:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.921971:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.921982:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816768:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1782759397.922004:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.922022:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.922293:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816768 00000100:00100000:0.0:1782759397.922297:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816768 00000100:00100000:0.0:1782759397.922326:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092 00000100:00100000:0.0:1782759397.922332:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6531:x1869355232816768:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1782759397.922341:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.922355:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bef7 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bef0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.922375:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bef7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bef0 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.922386:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bef7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bef0 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.922393:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759397.922396:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.922399:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd200, rc 0) 00000100:00100000:0.0:1782759397.922478:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6531:x1869355232816768:12345-0@lo:101:mdt00_000.0 Request processed in 146us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.922484:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092 00000100:00100000:2.0:1782759397.922542:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816768:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1782759397.922554:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.922564:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759397.922608:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759397.922634:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.922642:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.922649:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.922660:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816896:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1782759397.922698:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.922715:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.922738:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232816896 00000100:00100000:0.0:1782759397.922742:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232816896 00000100:00100000:0.0:1782759397.922776:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093 00000100:00100000:0.0:1782759397.922783:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6531:x1869355232816896:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1782759397.922792:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.922803:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60befe expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.922831:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60befe expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.922841:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60befe expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.922848:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759397.922850:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.922852:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc000, rc 0) 00000100:00100000:0.0:1782759397.922886:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232816896:12345-0@lo:101:mdt00_000.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.922892:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093 00000100:00100000:2.0:1782759397.922912:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232816896:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1782759397.922922:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.922929:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759397.922938:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00000100:00100000:2.0:1782759397.922956:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.922981:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.923011:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.923034:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817024 00000100:00100000:0.0:1782759397.923039:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817024 00000100:00100000:0.0:1782759397.923071:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:0.0:1782759397.923077:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.923126:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817024:12345-0@lo:1000:mdt00_000.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.923132:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:2.0:1782759397.923154:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923186:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817152:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923206:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.923223:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.923253:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817152 00000100:00100000:0.0:1782759397.923259:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817152 00000100:00100000:0.0:1782759397.923288:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:0.0:1782759397.923302:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.923364:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817152:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (155us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759397.923370:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:2.0:1782759397.923395:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817152:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923475:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923498:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.923516:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.923543:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817280 00000100:00100000:0.0:1782759397.923549:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817280 00000100:00100000:0.0:1782759397.923594:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:0.0:1782759397.923602:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.923667:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817280:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (167us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759397.923674:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:2.0:1782759397.923688:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923730:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817408:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923751:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.923769:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.923782:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817408 00000100:00100000:0.0:1782759397.923787:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817408 00000100:00100000:0.0:1782759397.923814:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:0.0:1782759397.923820:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.923863:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817408:12345-0@lo:1000:mdt00_000.0 Request processed in 44us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.923867:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000100:00100000:2.0:1782759397.923892:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817408:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923923:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817536:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.923939:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.923953:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.923975:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817536 00000100:00100000:0.0:1782759397.923980:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817536 00000100:00100000:0.0:1782759397.924006:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098 00000100:00100000:0.0:1782759397.924012:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.924069:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817536:12345-0@lo:1000:mdt00_000.0 Request processed in 58us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.924077:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098 00000100:00100000:2.0:1782759397.924094:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817536:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.924131:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817664:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759397.924155:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.924181:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.924193:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817664 00000100:00100000:0.0:1782759397.924204:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817664 00000100:00100000:0.0:1782759397.924231:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099 00000100:00100000:0.0:1782759397.924237:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817664:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759397.924294:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:6531:x1869355232817664:12345-0@lo:1000:mdt00_000.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.924301:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099 00000100:00100000:2.0:1782759397.924310:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6531:1869355232817664:0@lo:1000:mdt00_000.0 00000040:00080000:2.0:1782759397.924812:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].18, 1000 off52512 00000040:00080000:2.0:1782759397.924865:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].18, 1152 off54664 00000004:00080000:2.0:1782759397.924873:0:6531:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc4f37000 with version 35 00000004:00080000:1.0:1782759397.924945:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 35 rpc_version 35 00000020:00100000:1.0:1782759397.924969:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759397.924978:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4bb1880 x1869355232817920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759397.924994:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232817920:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759397.925030:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759397.925062:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.925081:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232817920 00000100:00100000:0.0:1782759397.925085:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232817920 00000100:00100000:0.0:1782759397.925117:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:0.0:1782759397.925125:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7666:x1869355232817920:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782759397.925474:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7666:x1869355232817920:12345-0@lo:1000:osp_up1-0.0 Request processed in 348us (442us total) trans 4294967667 rc 0/0 00000100:00100000:0.0:1782759397.925482:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:1.0:1782759397.925540:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232817920:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1782759397.925631:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,1 mode: --/PW res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925646:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925658:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759397.925698:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000100c650c reply state 00000000ac251677 transno 4294967955 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925710:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925718:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:2.0:1782759397.925721:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759397.925725:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759397.925732:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x15:0x0]: returning size 4096 00000004:00080000:2.0:1782759397.925739:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759397.925747:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925755:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925762:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925790:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782759397.925796:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759397.925801:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.925808:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.925811:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759397.925820:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.925831:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759397.925837:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759397.925847:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.925873:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.925881:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759397.925883:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103121:x1869355218458496:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 4746us (4870us total) trans 4294967955 rc 0/0 00000100:00100000:2.0:1782759397.925899:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2654 00010000:00010000:0.0:1782759397.925915:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.925924:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649200/0xd5b45c7f5c60bef0 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bef7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.925934:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232818048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759397.925942:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.925945:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.925947:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759397.925964:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.925991:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818048 00000100:00100000:0.0:1782759397.925996:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818048 00000100:00100000:0.0:1782759397.926038:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1782759397.926045:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3662:x1869355232818048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759397.926057:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759397.926072:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bef7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bef0 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.926085:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759397.926092:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759397.926134:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+9:3662:x1869355232818048:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.926141:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1782759397.926165:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232818048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759397.936489:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759397.936554:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218458624 00000100:00100000:2.0:1782759397.936609:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218458624 00000100:00100000:2.0:1782759397.936669:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2656 00000100:00100000:2.0:1782759397.936680:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103122:x1869355218458624:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759397.936715:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759397.936737:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60bf13 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27218 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936811:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936825:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936844:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936856:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936865:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60befe expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936873:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.936904:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60befe expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.936937:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1869355232818176:0@lo:104: 00000100:00100000:2.0:1782759397.936995:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.937058:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded314b540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759397.937059:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759397.937074:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818176 00000100:00100000:3.0:1782759397.937078:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818176 00000100:00100000:3.0:1782759397.937113:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1782759397.937122:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf852050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6532:x1869355232818176:12345-0@lo:104: 00010000:00010000:3.0:1782759397.937134:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.937213:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759397.937220:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf852050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:6532:x1869355232818176:12345-0@lo:104: Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.937227:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00010000:00010000:0.0:1782759397.937254:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759397.937271:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.937281:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759397.937287:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759397.937303:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.937339:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.937347:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759397.937365:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1869355232818176:0@lo:104: 00010000:00010000:0.0:1782759397.937378:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 1/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.937383:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.937388:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648400/0xd5b45c7f5c60befe lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bf05 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.937409:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.937411:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.937413:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759397.937440:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759397.937452:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232818304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759397.937488:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759397.937539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818304 00000100:00100000:0.0:1782759397.937544:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818304 00010000:00010000:0.0:1782759397.937563:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60befe expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759397.937628:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1782759397.937636:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3662:x1869355232818304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759397.937647:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1782759397.938962:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967667 is committed 00010000:00010000:3.0:1782759397.939048:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60bf05 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60befe expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.939064:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cdecda0a100) 00010000:00010000:3.0:1782759397.939068:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.939077:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.939083:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.939108:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759397.939153:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232818304:12345-0@lo:103:ldlm_bl.0 Request processed in 1518us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.939177:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1782759397.939189:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232818304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759397.939241:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939249:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.939341:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232818432:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759397.939413:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.939432:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759397.939446:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818432 00000100:00100000:0.0:1782759397.939452:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818432 00000100:00100000:0.0:1782759397.939513:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:0.0:1782759397.939521:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232818432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759397.939636:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232818432:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.939644:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:2.0:1782759397.939661:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232818432:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1782759397.939692:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60bf28 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939699:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60bf28 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939704:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60bf28 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759397.939720:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60bf28 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939737:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939741:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939745:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939749:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939752:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759397.939755:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939759:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939765:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc34ff300) 00010000:00010000:2.0:1782759397.939766:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.939769:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939772:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf1a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939779:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939782:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939788:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939792:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759397.939793:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939796:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939800:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cdecda0a100) 00010000:00010000:2.0:1782759397.939802:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759397.939803:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939806:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60bf21 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939827:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60bf13 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27218 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939837:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60bf28 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27218 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.939841:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34fdd00) 00010000:00010000:2.0:1782759397.939842:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759397.939843:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759397.939879:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103122:x1869355218458624:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 3203us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.939895:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2656 00000100:00100000:3.0:1782759397.941745:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.945488:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218458752 00000100:00100000:0.0:1782759397.945503:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218458752 00000100:00100000:0.0:1782759397.945597:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2657 00000100:00100000:0.0:1782759397.945608:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:103122:x1869355218458752:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759397.945632:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.945650:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bf2f lrc: 2/0,0 mode: --/CR res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2721f expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.945699:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bf36 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.945710:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bf36 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.945722:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bf36 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759397.945775:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x15:0x0]: returning size 4096 00000004:00200000:0.0:1782759397.945779:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1782759397.945814:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bf2f lrc: 0/0,0 mode: --/CR res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2721f expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.945832:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bf36 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2721f expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.945860:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:0.0:1782759397.945863:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759397.945866:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc400, rc 0) 00000100:00100000:0.0:1782759397.945920:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103122:x1869355218458752:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 314us (4181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.945927:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2657 00000100:00100000:3.0:1782759397.949154:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.949298:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218459008 00000100:00100000:1.0:1782759397.949306:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218459008 00000100:00100000:1.0:1782759397.949350:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2658 00000100:00100000:1.0:1782759397.949357:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103122:x1869355218459008:12345-192.168.202.31@tcp:36:lfs.0 00000100:00100000:1.0:1782759397.949470:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103122:x1869355218459008:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 113us (324us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759397.949474:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2658 00000100:00100000:1.0:1782759397.955835:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.955904:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759397.955975:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218459136 00000100:00100000:3.0:1782759397.955986:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218459136 00000100:00100000:3.0:1782759397.956046:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 384 00000100:00100000:3.0:1782759397.956056:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218459136:12345-192.168.202.31@tcp:103:rmdir.0 00010000:00010000:3.0:1782759397.956071:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759397.956095:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60bf28 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27218 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.956114:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34fdd00) 00010000:00010000:3.0:1782759397.956124:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759397.956195:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218459136:12345-192.168.202.31@tcp:103:rmdir.0 Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.956203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 384 00000100:00100000:2.0:1782759397.956473:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218459392 00000100:00100000:2.0:1782759397.956478:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218459392 00000100:00100000:2.0:1782759397.956612:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2659 00000100:00100000:2.0:1782759397.956623:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103123:x1869355218459392:12345-192.168.202.31@tcp:36:rmdir.0 00010000:00010000:2.0:1782759397.956667:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759397.956678:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bf36 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2721f expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.956687:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:2.0:1782759397.956689:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759397.956724:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.956730:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.956737:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.956751:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818560:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1782759397.956778:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.956794:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759397.956917:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818560 00000100:00100000:1.0:1782759397.956921:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818560 00000100:00100000:1.0:1782759397.956964:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:1.0:1782759397.956969:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8593:x1869355232818560:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1782759397.956979:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.956990:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bf44 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bf3d expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.957005:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bf44 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf3d expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.957014:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bf44 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf3d expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.957021:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf400) 00010000:00010000:1.0:1782759397.957023:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.957026:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759397.957074:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:8593:x1869355232818560:12345-0@lo:101:mdt00_003.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.957080:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:2.0:1782759397.957258:0:8593:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967667 gen 2 00000004:00080000:2.0:1782759397.957264:0:8593:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967667 committed transno 4294967667 00000100:00100000:2.0:1782759397.957287:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818560:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759397.957300:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.957316:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759397.957330:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:2.0:1782759397.957349:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.957356:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.957363:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759397.957375:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818688:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1782759397.957397:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.957419:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759397.957464:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818688 00000100:00100000:1.0:1782759397.957468:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818688 00000100:00100000:1.0:1782759397.957500:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:1.0:1782759397.957506:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:8593:x1869355232818688:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1782759397.957514:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.957535:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bf52 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bf4b expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.957550:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bf52 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf4b expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.957560:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bf52 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf4b expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.957737:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cded88bf500) 00010000:00010000:1.0:1782759397.957740:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.957743:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759397.957777:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232818688:12345-0@lo:101:mdt00_003.0 Request processed in 271us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759397.957784:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:2.0:1782759397.957840:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818688:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759397.957850:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.957857:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759397.957865:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00000100:00100000:2.0:1782759397.957886:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818816:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759397.957905:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.957953:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759397.958013:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818816 00000100:00100000:3.0:1782759397.958017:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818816 00000100:00100000:3.0:1782759397.958074:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:3.0:1782759397.958079:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232818816:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782759397.958129:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232818816:12345-0@lo:1000:mdt00_003.0 Request processed in 50us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.958133:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:1.0:1782759397.958178:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818816:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759397.958203:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818944:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759397.958220:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759397.958298:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759397.958346:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232818944 00000100:00100000:2.0:1782759397.958349:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232818944 00000100:00100000:2.0:1782759397.958365:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:2.0:1782759397.958368:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232818944:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759397.958424:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232818944:12345-0@lo:1000:mdt00_003.0 Request processed in 55us (203us total) trans 0 rc 1/1 00000100:00100000:2.0:1782759397.958428:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:1.0:1782759397.958480:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232818944:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1782759397.958513:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.958528:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.958536:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.958547:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232819072:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1782759397.958600:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759397.958612:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759397.958657:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819072 00000100:00100000:2.0:1782759397.958660:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819072 00000100:00100000:2.0:1782759397.958674:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:2.0:1782759397.958677:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:8593:x1869355232819072:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759397.958683:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759397.958691:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf60 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bf59 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.958701:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf60 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf59 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.958708:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf60 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf59 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.958712:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759397.958714:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759397.958715:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759397.958732:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:8593:x1869355232819072:12345-0@lo:101:mdt00_003.0 Request processed in 54us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.958735:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:1.0:1782759397.958776:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8593:1869355232819072:0@lo:101:mdt00_003.0 00010000:00010000:1.0:1782759397.958783:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.958789:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.958802:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.958808:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.958813:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759397.959068:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x2:0x0].19, 432 off52944 00000040:00080000:1.0:1782759397.959128:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x2:0x0].19, 512 off55176 00000004:00080000:1.0:1782759397.959134:0:8593:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cded1803840 with version 36 00000004:00080000:2.0:1782759397.959230:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 36 rpc_version 36 00000020:00100000:2.0:1782759397.959253:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759397.959260:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc542c700 x1869355232819328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1504/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759397.959274:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232819328:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759397.959301:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759397.959324:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759397.959422:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819328 00000100:00100000:1.0:1782759397.959426:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819328 00000100:00100000:1.0:1782759397.959451:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:1.0:1782759397.959457:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:7666:x1869355232819328:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759397.959894:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+11:7666:x1869355232819328:12345-0@lo:1000:osp_up1-0.0 Request processed in 436us (591us total) trans 4294967668 rc 0/0 00000100:00100000:1.0:1782759397.959901:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:2.0:1782759397.960126:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232819328:0@lo:1000:osp_up1-0.0 00000004:00200000:1.0:1782759397.960213:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x15:0x0]: returning size 4096 00010000:00010000:1.0:1782759397.960233:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960242:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960249:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960255:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759397.960260:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960268:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960280:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:1.0:1782759397.960283:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759397.960287:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960306:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60bf67 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960318:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960325:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 4/0,1 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960333:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960389:0:8593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782759397.960399:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759397.960404:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960411:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960418:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.960447:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782759397.960454:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.960461:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759397.960464:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759397.960471:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.960494:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.960500:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759397.960547:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232819456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759397.960608:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.960681:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819456 00000100:00100000:3.0:1782759397.960686:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819456 00000100:00100000:3.0:1782759397.960721:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782759397.960729:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+11:3664:x1869355232819456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759397.960746:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759397.960760:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60bf60 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf59 expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.960769:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:3.0:1782759397.960776:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759397.960831:0:8593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782759397.960837:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000405:0x1:0x0] 00010000:00010000:1.0:1782759397.960842:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960861:0:8593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.960919:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103123:x1869355218459392:12345-192.168.202.31@tcp:36:rmdir.0 Request processed in 4296us (5089us total) trans 4294967956 rc 0/0 00000100:00100000:1.0:1782759397.960927:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2659 00010000:00010000:1.0:1782759397.960947:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759397.960951:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 2/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960959:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759397.960963:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759397.960970:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960988:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.960994:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759397.961038:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 1/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.961047:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cddc5428800/0xd5b45c7f5c60bf59 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf60 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.961070:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.961072:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.961074:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759397.961174:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+10:3664:x1869355232819456:12345-0@lo:103:ldlm_bl.0 Request processed in 446us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.961181:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1782759397.961199:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232819584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759397.961223:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.961253:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819584 00000100:00100000:3.0:1782759397.961256:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819584 00000100:00100000:3.0:1782759397.961273:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1782759397.961277:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3665:x1869355232819584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759397.961282:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759397.961289:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60bf44 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf3d expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.961296:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded88bf400) 00010000:00010000:3.0:1782759397.961301:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759397.961316:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+9:3665:x1869355232819584:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.961320:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1782759397.961336:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232819584:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759397.961679:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.961687:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf648200/0xd5b45c7f5c60bf3d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf44 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.961710:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759397.961712:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759397.961714:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759397.961827:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232819456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759397.969944:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759397.970000:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218459648 00000100:00100000:3.0:1782759397.970019:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218459648 00000100:00100000:3.0:1782759397.970130:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2660 00000100:00100000:3.0:1782759397.970141:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103124:x1869355218459648:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759397.970178:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759397.970199:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bf6e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27226 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970267:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970279:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970291:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970302:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970309:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970315:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970368:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970379:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970387:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 4/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.970423:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759397.970438:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232819712:0@lo:104: 00000100:00100000:3.0:1782759397.970480:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759397.970515:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759397.970539:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819712 00000100:00100000:1.0:1782759397.970543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819712 00000100:00100000:2.0:1782759397.970623:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1782759397.970634:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6533:x1869355232819712:12345-0@lo:104: 00010000:00010000:2.0:1782759397.970646:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759397.970710:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759397.970717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6533:x1869355232819712:12345-0@lo:104: Request processed in 86us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759397.970724:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:3.0:1782759397.970736:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232819712:0@lo:104: 00010000:00010000:3.0:1782759397.970757:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.970806:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759397.970813:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.970821:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649000 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759397.970826:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759397.970835:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.970860:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 2/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.970867:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759397.970907:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1782759397.970925:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 1/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.970934:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649000/0xd5b45c7f5c60be4f lrc: 0/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x1 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60be56 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.970950:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.970951:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759397.970952:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759397.970977:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232819840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759397.971003:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759397.971046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819840 00000100:00100000:1.0:1782759397.971051:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819840 00010000:00010000:1.0:1782759397.971082:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.971109:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1782759397.971117:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+9:3663:x1869355232819840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759397.971127:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1782759397.972597:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967668 is committed 00010000:00010000:1.0:1782759397.972945:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60be56 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60be4f expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.972961:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:1.0:1782759397.972966:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.972975:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.972981:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 4/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.973006:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759397.973031:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973038:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973052:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973057:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973061:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973065:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973074:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759397.973077:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759397.973080:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3663:x1869355232819840:12345-0@lo:103:ldlm_bl.0 Request processed in 1956us (2067us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759397.973083:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973097:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3be00) 00000100:00100000:1.0:1782759397.973097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00010000:00010000:3.0:1782759397.973101:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759397.973104:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973108:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60bf75 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973118:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973121:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973125:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973129:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759397.973130:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973133:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973144:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cded3a3bc00) 00010000:00010000:3.0:1782759397.973145:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759397.973147:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973150:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60bf7c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973178:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60bf6e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27226 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973187:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27226 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.973191:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759397.973193:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759397.973194:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759397.973229:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103124:x1869355218459648:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 3092us (3294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759397.973234:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2660 00000100:00100000:0.0:1782759397.973288:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232819840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759397.974670:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.974712:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218459904 00000100:00100000:1.0:1782759397.974721:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218459904 00000100:00100000:1.0:1782759397.974764:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2661 00000100:00100000:1.0:1782759397.974774:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:103124:x1869355218459904:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759397.974796:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759397.974811:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bf8a lrc: 2/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2722d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759397.974947:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x13:0x0]: returning size 4096 00010000:00010000:1.0:1782759397.975037:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bf8a lrc: 1/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2722d expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.975050:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:1.0:1782759397.975053:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759397.975058:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429600/0xd5b45c7f5c60bf8a lrc: 0/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2722d expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759397.975068:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429600, rc 0) 00000100:00100000:1.0:1782759397.975120:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103124:x1869355218459904:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 347us (452us total) trans 4294967957 rc 301/301 00000100:00100000:1.0:1782759397.975128:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2661 00000100:00100000:1.0:1782759397.976507:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.976614:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218460032 00000100:00100000:0.0:1782759397.976620:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218460032 00000100:00100000:0.0:1782759397.976670:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2662 00000100:00100000:0.0:1782759397.976682:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:103124:x1869355218460032:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759397.976697:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.976710:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60bf98 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27234 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.976768:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bf9f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.976900:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bf9f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.976910:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bf9f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759397.976939:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000400:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1782759397.976943:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1782759397.976963:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60bf98 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27234 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.976975:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bf9f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27234 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.976983:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:0.0:1782759397.976984:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759397.976987:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc600, rc 0) 00000100:00100000:0.0:1782759397.977045:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103124:x1869355218460032:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 367us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.977055:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2662 00000100:00100000:0.0:1782759397.979494:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759397.979566:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218460288 00000100:00100000:2.0:1782759397.979574:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218460288 00000100:00100000:2.0:1782759397.979652:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 314 00000100:00100000:2.0:1782759397.979661:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9347050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:103124:x1869355218460288:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1782759397.980115:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9347050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:103124:x1869355218460288:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 453us (668us total) trans 4294967958 rc 0/0 00000100:00100000:2.0:1782759397.980136:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 314 00000100:00100000:3.0:1782759397.981325:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.981369:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218460544 00000100:00100000:0.0:1782759397.981376:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218460544 00000100:00100000:0.0:1782759397.981420:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:0.0:1782759397.981426:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103124:x1869355218460544:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759397.981458:0:6546:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759397.981484:0:6546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60bf83 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27226 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.981502:0:6546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:0.0:1782759397.981511:0:6546:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759397.981567:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103124:x1869355218460544:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 139us (242us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759397.981573:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 9 00000100:00100000:1.0:1782759397.982961:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759397.983002:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218460800 00000100:00100000:0.0:1782759397.983007:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218460800 00000100:00100000:0.0:1782759397.983051:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2663 00000100:00100000:0.0:1782759397.983060:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103124:x1869355218460800:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759397.983073:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759397.983090:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60bfa6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2723b expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983135:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983144:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983163:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983175:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983182:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983189:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983238:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bfbb lrc: 3/1,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983251:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bfbb lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983257:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bfbb lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983271:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983278:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983283:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983289:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983305:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759397.983309:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983317:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983327:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759397.983330:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.983335:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983341:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983352:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983358:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983364:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983369:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759397.983372:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983378:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983400:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0xc53459e9 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759397.983402:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759397.983404:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983408:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60bfb4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0xc53459e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983440:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60bfa6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2723b expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983468:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bfbb lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2723b expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759397.983475:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759397.983477:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759397.983479:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd200, rc 0) 00000100:00100000:0.0:1782759397.983534:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:103124:x1869355218460800:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 466us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759397.983541:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2663 00000100:00100000:1.0:1782759397.984703:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759397.984751:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461056 00000100:00100000:3.0:1782759397.984758:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461056 00000100:00100000:3.0:1782759397.984801:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2664 00000100:00100000:3.0:1782759397.984811:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:103124:x1869355218461056:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759397.984827:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759397.984848:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bfc2 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27242 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759397.984973:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x13:0x0]: returning size 4096 00010000:00010000:3.0:1782759397.985064:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bfc2 lrc: 1/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27242 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.985079:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759397.985082:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759397.985086:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60bfc2 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27242 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759397.985093:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759397.985126:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:103124:x1869355218461056:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 319us (427us total) trans 4294967959 rc 301/301 00000100:00100000:3.0:1782759397.985132:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2664 00000100:00100000:3.0:1782759397.986284:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759397.986397:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461312 00000100:00100000:1.0:1782759397.986413:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461312 00000100:00100000:1.0:1782759397.986460:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 315 00000100:00100000:1.0:1782759397.986470:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:103124:x1869355218461312:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759397.986678:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:103124:x1869355218461312:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 208us (394us total) trans 4294967960 rc 0/0 00000100:00100000:1.0:1782759397.986686:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 315 10000000:01000000:2.0:1782759398.026707:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759398.026715:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759398.026720:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759398.026763:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759398.026776:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759398.026797:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759398.026821:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232819968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759398.026886:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759398.026955:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759398.027108:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232819968 00000100:00100000:3.0:1782759398.027114:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232819968 00000100:00100000:3.0:1782759398.027167:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1782759398.027177:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232819968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759398.027189:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759398.027199:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bfd0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.027217:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.027226:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759398.027249:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759398.027290:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232819968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759398.027294:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:2.0:1782759398.027461:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232819968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759398.027475:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759398.027483:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759398.027500:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759398.027506:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759398.027512:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759398.285885:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759398.285907:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232820096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759398.285971:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759398.286130:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820096 00000100:00100000:2.0:1782759398.286138:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820096 00000100:00100000:2.0:1782759398.286198:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00100000:2.0:1782759398.286207:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232820096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759398.286240:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:2.0:1782759398.286309:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232820096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759398.286331:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:1.0:1782759398.286342:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967668 gen 2 00000004:00080000:1.0:1782759398.286349:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967668 committed transno 4294967668 00000100:00100000:1.0:1782759398.286375:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232820096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759398.624829:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759398.624875:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759398.624915:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759398.624977:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461696 00000100:00100000:0.0:1782759398.624987:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461696 00000100:00100000:0.0:1782759398.625052:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461568 00000100:00100000:0.0:1782759398.625056:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461568 00000100:00100000:0.0:1782759398.625080:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2789 00000100:00100000:0.0:1782759398.625090:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218461696:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759398.625162:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218461696:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 75us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759398.625177:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2789 00000100:00100000:0.0:1782759398.625195:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2790 00000100:00100000:0.0:1782759398.625202:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218461568:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759398.625232:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218461568:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759398.625239:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2790 00000100:00080000:1.0:1782759398.625302:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759398.625307:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759398.625362:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461440 00000100:00100000:3.0:1782759398.625367:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461440 00000100:00100000:3.0:1782759398.625405:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2970 00000100:00100000:3.0:1782759398.625414:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218461440:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759398.625444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218461440:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759398.625463:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2970 00010000:00010000:0.0:1782759398.733019:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759398.795129:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759398.795437:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759398.796769:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759398.796889:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820224 00000100:00100000:1.0:1782759398.796897:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820224 00000100:00100000:1.0:1782759398.796963:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:1.0:1782759398.796974:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232820224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759398.797006:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759398.797012:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759398.797026:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232820352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759398.797056:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232820224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759398.797064:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1782759398.797071:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759398.797133:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232820224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759398.798411:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820352 00000100:00100000:1.0:1782759398.798421:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820352 00000100:00100000:1.0:1782759398.798470:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:1.0:1782759398.798478:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232820352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759398.798500:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759398.798599:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232820352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759398.798607:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1782759398.798763:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232820352:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1782759399.754763:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759400.778864:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759400.811775:0:139035:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd36c8ced0 20000000:00000080:3.0:1782759400.811789:0:139035:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3f3e800 uarg=0000000000000000 00010000:00010000:3.0:1782759400.811930:0:139035:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759400.811957:0:139035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:3.0:1782759400.811959:0:139035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759400.811969:0:139035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60bfbb lrc: 0/0,0 mode: --/PR res: [0x200000421:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2723b expref: 5 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.811987:0:139035:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759400.812001:0:139035:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759400.812011:0:139035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:3.0:1782759400.812013:0:139035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759400.812016:0:139035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc600/0xd5b45c7f5c60bf9f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27234 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.812032:0:139035:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782759400.812048:0:139035:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759400.812058:0:139035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.812066:0:139035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.812072:0:139035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.812099:0:139035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.812108:0:139035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 23 pid: 6526 timeout: 3591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759400.812118:0:139035:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139035:1869355232820480:0@lo:104: 00000100:00100000:3.0:1782759400.812173:0:139035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759400.812222:0:139035:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ba0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759400.812359:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820480 00000100:00100000:0.0:1782759400.812365:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820480 00000100:00100000:0.0:1782759400.812400:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1782759400.812406:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:139035:x1869355232820480:12345-0@lo:104: 00010000:00010000:0.0:1782759400.812416:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812459:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759400.812463:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:139035:x1869355232820480:12345-0@lo:104: Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759400.812468:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00010000:00010000:1.0:1782759400.812481:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759400.812489:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759400.812508:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759400.812512:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759400.812522:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759400.812529:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759400.812535:0:139035:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139035:1869355232820480:0@lo:104: 10000000:01000000:1.0:1782759400.812535:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759400.812555:0:139035:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759400.812604:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759400.812612:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759400.812650:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232820608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759400.812670:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759400.812819:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820608 00000100:00100000:0.0:1782759400.812822:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820608 00010000:00010000:0.0:1782759400.812836:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 24 pid: 6526 timeout: 3591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759400.812856:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1782759400.812874:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232820608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759400.812884:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759400.812889:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 24 pid: 6526 timeout: 3591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812899:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 24 pid: 6526 timeout: 3591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812910:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60bfd7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfd0 expref: 24 pid: 6526 timeout: 3591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812921:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812926:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812935:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812939:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812944:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812947:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812950:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759400.812953:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812962:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812975:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759400.812984:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759400.812992:0:139035:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.813009:0:139035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759400.813016:0:139035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bfde lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759400.813058:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232820608:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (386us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759400.813065:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759400.813066:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00010000:00010000:1.0:1782759400.813076:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60bfd0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bfd7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759400.813096:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759400.813099:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759400.813101:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759400.813134:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232820608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759401.356818:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232820736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759401.356894:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759401.357053:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820736 00000100:00100000:0.0:1782759401.357060:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820736 00000100:00100000:0.0:1782759401.357118:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:0.0:1782759401.357125:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232820736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759401.357163:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445941248 avail 1299701760 00000100:00100000:0.0:1782759401.357206:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232820736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759401.357212:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:2.0:1782759401.357283:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232820736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759401.803771:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759401.870426:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967403 is committed 00000001:00080000:3.0:1782759401.870439:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967402 is committed 00010000:00010000:0.0:1782759401.870896:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759401.870913:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.870952:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.870970:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759401.870993:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649400/0xd5b45c7f5c60bf4b lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60bf52 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.871011:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759401.871019:0:6509:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.871033:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 2/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.871040:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759401.871046:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8cdedf649a00/0xd5b45c7f5c60be6b lrc: 0/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60be72 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759401.871057:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967960 is committed 00000020:00080000:0.0:1782759401.871074:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cded1803600 refcount 2 committed 0 result 0 batchid 19 00000020:00080000:0.0:1782759401.871079:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc47e7e00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cded1803840 00000020:00080000:0.0:1782759401.871082:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].19 00000020:00080000:0.0:1782759401.871085:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc47e7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4875c00 00000020:00080000:0.0:1782759401.871087:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].19 00000020:00080000:0.0:1782759401.871101:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc4beb780 refcount 2 committed 0 result 0 batchid 18 00000020:00080000:0.0:1782759401.871104:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cded2022600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4f37000 00000020:00080000:0.0:1782759401.871107:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].18 00000020:00080000:0.0:1782759401.871115:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec4c49000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc37bbe00 00000020:00080000:0.0:1782759401.871118:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].18 00000001:00080000:0.0:1782759401.871124:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967954 is committed 00000020:00080000:0.0:1782759401.871132:0:6509:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cddc45c3300 refcount 2 committed 0 result 0 batchid 17 00000020:00080000:0.0:1782759401.871134:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61fa00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3b40 00000020:00080000:0.0:1782759401.871138:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000401:0x2:0x0].17 00000020:00080000:0.0:1782759401.871140:0:6509:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61f100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc5602000 00000020:00080000:0.0:1782759401.871143:0:6509:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000400:0x2:0x0].17 00000020:00080000:0.0:1782759401.871151:0:6509:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 16 batchid updated 00000020:00080000:0.0:1782759401.871155:0:6509:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 15 batchid updated 00000100:00100000:0.0:1782759401.871175:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232820864:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1782759401.871289:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871299:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871306:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871313:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759401.871317:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871324:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871336:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x13:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759401.871339:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3e 00010000:00010000:3.0:1782759401.871343:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871350:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60be5d lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x13:0x0].0x0 bits 0x3e/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871374:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871380:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871387:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871393:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759401.871396:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871402:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871410:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:3.0:1782759401.871412:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3f 00010000:00010000:3.0:1782759401.871426:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871433:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60be64 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x3f/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871448:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871454:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871461:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871472:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759401.871475:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871482:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871499:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x15:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:3.0:1782759401.871501:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759401.871504:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759401.871510:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60bf0c lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759401.871748:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759401.871882:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759401.871888:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232820992:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1782759401.871910:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1782759401.871981:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 19 committed batchid 16 00000004:00080000:0.0:1782759401.872086:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cdedf79bb40 with version 37 00000020:00080000:0.0:1782759401.872097:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 15 cancel update log [0x240000401:0x2:0x0].15: rc = 0 00000020:00080000:0.0:1782759401.872138:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 15 cancel update log [0x200000400:0x2:0x0].15: rc = 0 00000004:00080000:0.0:1782759401.872175:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cdecb3c63c0 with version 38 00000020:00080000:0.0:1782759401.872178:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 16 cancel update log [0x240000401:0x2:0x0].16: rc = 0 00000020:00080000:0.0:1782759401.872212:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 16 cancel update log [0x200000400:0x2:0x0].16: rc = 0 00000020:00080000:0.0:1782759401.872219:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 16 00000100:00100000:3.0:1782759401.873172:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820864 00000100:00100000:3.0:1782759401.873180:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820864 00000100:00100000:3.0:1782759401.873344:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232820992 00000100:00100000:3.0:1782759401.873348:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232820992 00000100:00100000:0.0:1782759401.873384:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782759401.873395:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+8:3664:x1869355232820864:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1782759401.873408:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759401.873442:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60bf52 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1:0x0].0x4fdc6bf8 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60bf4b expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.873456:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x4fdc6bf8 (ffff8cded88bf500) 00010000:00010000:0.0:1782759401.873465:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759401.873521:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232820864:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 128us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759401.873528:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1782759401.873544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782759401.873550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232820992:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1782759401.873557:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759401.873567:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60be72 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x5:0x0].0x0 bits 0x3f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60be6b expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759401.873730:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:0.0:1782759401.873739:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759401.873851:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232820992:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 301us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759401.873858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782759401.873892:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232820992:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:0.0:1782759401.873901:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232820864:0@lo:103:jbd2/dm-0-8.0 00000004:00080000:2.0:1782759401.874912:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 37 rpc_version 37 00000020:00100000:2.0:1782759401.874940:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759401.874948:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc542dc00 x1869355232821248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759401.874968:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232821248:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759401.875015:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759401.875048:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759401.875352:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232821248 00000100:00100000:3.0:1782759401.875357:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232821248 00000100:00100000:3.0:1782759401.875402:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110 00000100:00100000:3.0:1782759401.875409:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7666:x1869355232821248:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782759401.875568:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7666:x1869355232821248:12345-0@lo:1000:osp_up1-0.0 Request processed in 159us (552us total) trans 4294967669 rc 0/0 00000100:00100000:3.0:1782759401.875597:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110 00000100:00100000:2.0:1782759401.875722:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542dc00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232821248:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1782759401.875733:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 38 rpc_version 38 00000020:00100000:2.0:1782759401.875748:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759401.875811:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc542ea00 x1869355232821504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759401.875827:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232821504:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759401.875858:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759401.875921:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb609600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759401.876030:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232821504 00000100:00100000:0.0:1782759401.876034:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232821504 00000100:00100000:0.0:1782759401.876096:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111 00000100:00100000:0.0:1782759401.876105:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7666:x1869355232821504:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782759401.876193:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7666:x1869355232821504:12345-0@lo:1000:osp_up1-0.0 Request processed in 90us (333us total) trans 4294967670 rc 0/0 00000100:00100000:0.0:1782759401.876207:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111 00000100:00100000:2.0:1782759401.876265:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232821504:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759402.378772:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232821760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.378836:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759402.378861:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232821760 00000100:00100000:1.0:1782759402.378869:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232821760 00000100:00100000:2.0:1782759402.378878:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232822272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.378899:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759402.378977:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232821888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759402.379009:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759402.379027:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232822400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759402.379047:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759402.379062:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232822912:0@lo:400:kworker.0 00000100:00100000:0.0:1782759402.379081:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759402.379097:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759402.379102:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232822016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.379204:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232822784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.379225:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759402.379281:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232821632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759402.379310:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759402.379338:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232822144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759402.380331:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822272 00000100:00100000:1.0:1782759402.380339:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822272 00000100:00100000:1.0:1782759402.380377:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822784 00000100:00100000:1.0:1782759402.380380:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822784 00000100:00100000:2.0:1782759402.380389:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822400 00000100:00100000:2.0:1782759402.380392:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822400 00000100:00100000:1.0:1782759402.380400:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4876 00000100:00100000:1.0:1782759402.380409:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232821760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759402.380470:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232821760:12345-0@lo:400:kworker.0 Request processed in 61us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759402.380477:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4876 00000100:00100000:2.0:1782759402.380507:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822912 00000100:00100000:2.0:1782759402.380511:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822912 00000100:00100000:2.0:1782759402.380538:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:2.0:1782759402.380545:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232822400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.380592:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232822400:12345-0@lo:400:kworker.0 Request processed in 48us (1544us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.380608:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:2.0:1782759402.380620:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:2.0:1782759402.380626:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232822912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.380654:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232822912:12345-0@lo:400:kworker.0 Request processed in 28us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.380659:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:2.0:1782759402.380678:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759402.380693:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232822528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.380715:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759402.380730:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232823040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.380747:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759402.380774:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232822400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.380784:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967403 gen 2 00000004:00080000:2.0:1782759402.380788:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967403 committed transno 4294967403 00000100:00100000:2.0:1782759402.380805:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232822912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.380825:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822016 00000100:00100000:2.0:1782759402.380828:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822016 00000100:00100000:3.0:1782759402.380901:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4877 00000100:00100000:3.0:1782759402.380910:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232822272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759402.380941:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232822272:12345-0@lo:400:kworker.0 Request processed in 34us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.380947:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4877 00000100:00100000:3.0:1782759402.380959:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878 00000100:00100000:3.0:1782759402.380964:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232822784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759402.380985:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232822784:12345-0@lo:400:kworker.0 Request processed in 21us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.380990:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878 00000100:00100000:3.0:1782759402.381009:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232821632 00000100:00100000:3.0:1782759402.381012:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232821632 00000100:00100000:3.0:1782759402.381034:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:3.0:1782759402.381039:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232821632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759402.381064:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232821632:12345-0@lo:400:kworker.0 Request processed in 25us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.381069:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:3.0:1782759402.381123:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759402.381140:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232822656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759402.381161:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759402.381178:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232821632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759402.382538:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822144 00000100:00100000:1.0:1782759402.382548:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822144 00000100:00100000:3.0:1782759402.382552:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822656 00000100:00100000:3.0:1782759402.382555:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822656 00000100:00100000:1.0:1782759402.382588:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4879 00000100:00100000:1.0:1782759402.382597:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232822144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.382618:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880 00000100:00100000:2.0:1782759402.382625:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232822656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759402.382685:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881 00000100:00100000:3.0:1782759402.382694:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232822016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.382740:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232822656:12345-0@lo:400:kworker.0 Request processed in 114us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.382747:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880 00000100:00100000:2.0:1782759402.382769:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232822528 00000100:00100000:2.0:1782759402.382773:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232822528 00000100:00100000:2.0:1782759402.382792:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823040 00000100:00100000:2.0:1782759402.382800:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823040 00000100:00100000:2.0:1782759402.382817:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:2.0:1782759402.382823:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232822528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.382859:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232822528:12345-0@lo:400:kworker.0 Request processed in 36us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.382866:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:2.0:1782759402.382876:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:2.0:1782759402.382882:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232823040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.382908:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232823040:12345-0@lo:400:kworker.0 Request processed in 27us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.382914:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00100000:2.0:1782759402.382952:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232822528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.382961:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967402 gen 2 00000004:00080000:2.0:1782759402.382965:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967402 committed transno 4294967402 00000100:00100000:2.0:1782759402.382980:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232823040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383031:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232821760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383041:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232822272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383050:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232822784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383079:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232822144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383089:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232822656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383124:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232821888 00000100:00100000:2.0:1782759402.383127:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232821888 00000100:00100000:2.0:1782759402.383162:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:2.0:1782759402.383174:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232821888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.383209:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232821888:12345-0@lo:400:kworker.0 Request processed in 35us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.383215:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 10000000:01000000:2.0:1782759402.383233:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759402.383236:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759402.383240:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759402.383269:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759402.383280:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759402.383289:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759402.383306:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232823168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759402.383336:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759402.383359:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc207d180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759402.383378:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967954 gen 2 00000004:00080000:2.0:1782759402.383382:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967951 committed transno 4294967954 00000020:00080000:2.0:1782759402.383387:0:3664:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc27000c0 refcount 2 committed 0 result 0 batchid 28 00000020:00080000:2.0:1782759402.383391:0:3664:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd61fc00 obd lustre-OST0001-osc-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3540 00000020:00080000:2.0:1782759402.383394:0:3664:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc49d7c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc2700780 00000020:00080000:2.0:1782759402.383396:0:3664:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].28 00000020:00080000:2.0:1782759402.383399:0:3664:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc49d7e00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4641000 00000020:00080000:2.0:1782759402.383401:0:3664:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].28 00000100:00100000:3.0:1782759402.383502:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232822016:12345-0@lo:400:kworker.0 Request processed in 809us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.383509:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881 00000004:00080000:2.0:1782759402.384854:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967954 committed transno 4294967954 00000100:00100000:2.0:1782759402.384872:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232821888:0@lo:400:kworker.0 00000100:00100000:2.0:1782759402.384900:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232822016:0@lo:400:kworker.0 00000020:00080000:2.0:1782759402.384919:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 28 committed batchid 27 00000020:00080000:2.0:1782759402.384974:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 27 00000100:00080000:2.0:1782759402.385006:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759402.385011:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759402.385014:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759402.385016:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759402.385056:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232823296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759402.385095:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759402.385140:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823296 00000100:00100000:2.0:1782759402.385146:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823296 00000100:00100000:2.0:1782759402.385178:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1782759402.385186:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232823296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759402.385210:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759402.385245:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232823296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759402.385251:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:2.0:1782759402.385281:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232823296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759402.385536:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232822144:12345-0@lo:400:kworker.0 Request processed in 2940us (4410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759402.385541:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823168 00000100:00100000:1.0:1782759402.385544:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1782759402.385545:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823168 00000100:00100000:0.0:1782759402.385572:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:0.0:1782759402.385594:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232823168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759402.385604:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759402.385619:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60bfe5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.385640:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.385650:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759402.385659:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759402.385701:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232823168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759402.385720:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1782759402.386302:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232823168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759402.386316:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.386325:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759402.386351:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759402.386356:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759402.386363:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759402.826940:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759402.890775:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232823424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759402.890840:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759402.890962:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823424 00000100:00100000:3.0:1782759402.890970:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823424 00000100:00100000:3.0:1782759402.891023:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1782759402.891033:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232823424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759402.891054:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759402.891103:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232823424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759402.891110:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:3.0:1782759402.891155:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232823424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759403.403019:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232823552:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759403.403093:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759403.403187:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823552 00000100:00100000:1.0:1782759403.403194:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823552 00000100:00100000:1.0:1782759403.403261:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:1.0:1782759403.403272:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232823552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759403.403310:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:1.0:1782759403.403788:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232823552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 517us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759403.403797:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:0.0:1782759403.403888:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232823552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759403.742155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759403.742239:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759403.742442:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462208 00000100:00100000:3.0:1782759403.742452:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462208 00000100:00100000:3.0:1782759403.742539:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2795 00000100:00100000:3.0:1782759403.742548:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218462208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759403.742628:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218462208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759403.742633:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2795 00000100:00080000:2.0:1782759403.742691:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759403.742882:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461952 00000100:00100000:0.0:1782759403.742885:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461952 00000100:00100000:0.0:1782759403.742988:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4882 00000100:00100000:0.0:1782759403.742993:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218461952:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759403.743031:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218461952:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759403.743036:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4882 00000100:00080000:2.0:1782759403.743347:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759403.743511:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759403.743543:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759403.743545:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218461824 00000100:00100000:3.0:1782759403.743549:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218461824 00000100:00100000:2.0:1782759403.743613:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759403.743633:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462336 00000100:00100000:2.0:1782759403.743636:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462336 00000100:00100000:2.0:1782759403.743669:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2796 00000100:00100000:2.0:1782759403.743676:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218462336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759403.743685:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2973 00000100:00100000:3.0:1782759403.743692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218461824:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759403.743707:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218462336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759403.743714:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218461824:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759403.743728:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2796 00000100:00100000:3.0:1782759403.743730:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2973 00000100:00080000:2.0:1782759403.743746:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759403.743780:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462080 00000100:00100000:1.0:1782759403.743785:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462080 00000100:00100000:1.0:1782759403.743818:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4883 00000100:00100000:1.0:1782759403.743825:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218462080:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:2.0:1782759403.743848:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759403.743855:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218462080:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759403.743862:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4883 00010000:00010000:1.0:1782759403.851662:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759403.917945:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759403.917967:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232823808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759403.918039:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759403.918132:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759403.918145:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232823680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759403.918179:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759403.918216:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823808 00000100:00100000:0.0:1782759403.918224:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823808 00000100:00100000:0.0:1782759403.918264:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823680 00000100:00100000:0.0:1782759403.918267:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823680 00000100:00100000:0.0:1782759403.918282:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:0.0:1782759403.918290:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232823808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759403.918320:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759403.918368:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232823808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759403.918385:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:2.0:1782759403.918504:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1782759403.918515:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232823680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759403.918527:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759403.918562:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232823680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759403.918568:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:3.0:1782759403.919012:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232823680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759403.919349:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232823808:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1782759403.968302:0:139326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0da11260 20000000:00000080:3.0:1782759403.968316:0:139326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3f3f800 uarg=0000000000000000 00010000:00010000:3.0:1782759403.968543:0:139326:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759403.968554:0:139326:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759403.968567:0:139326:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759403.968574:0:139326:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759403.968662:0:139326:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759403.968680:0:139326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.968697:0:139326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.968705:0:139326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.968742:0:139326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.968756:0:139326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 23 pid: 6524 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759403.968771:0:139326:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139326:1869355232823936:0@lo:104: 00000100:00100000:3.0:1782759403.968829:0:139326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759403.968876:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232823936 00000100:00100000:2.0:1782759403.968883:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232823936 00000100:00100000:3.0:1782759403.968922:0:139326:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759403.968981:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:2.0:1782759403.968989:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:139326:x1869355232823936:12345-0@lo:104: 00010000:00010000:2.0:1782759403.968999:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759403.969050:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759403.969056:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:139326:x1869355232823936:12345-0@lo:104: Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759403.969062:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:3.0:1782759403.969072:0:139326:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139326:1869355232823936:0@lo:104: 00010000:00010000:3.0:1782759403.969089:0:139326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759403.969132:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759403.969138:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759403.969143:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759403.969145:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759403.969151:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759403.969155:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759403.969159:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759403.969184:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759403.969191:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759403.969228:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232824064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759403.969251:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759403.969285:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232824064 00000100:00100000:1.0:1782759403.969289:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232824064 00010000:00010000:0.0:1782759403.969292:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759403.969299:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60bfe5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60bfec expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969306:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 24 pid: 6524 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759403.969313:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759403.969315:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759403.969321:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759403.969341:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1782759403.969382:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232824064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759403.969392:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759403.969397:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 24 pid: 6524 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969416:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 24 pid: 6524 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969427:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60bfec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60bfe5 expref: 24 pid: 6524 timeout: 3594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969439:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969447:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969459:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969464:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969469:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969483:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969498:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759403.969502:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969509:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969529:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759403.969538:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759403.969553:0:139326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.969561:0:139326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759403.969567:0:139326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60bff3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759403.969731:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232824064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759403.969800:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232824064:12345-0@lo:103:ldlm_bl.0 Request processed in 452us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759403.969806:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000020:00000080:1.0:1782759404.387399:0:139374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe25988da0 20000000:00000080:1.0:1782759404.387415:0:139374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3ecf400 uarg=0000000000000000 00010000:00010000:1.0:1782759404.387669:0:139374:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759404.387683:0:139374:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759404.387700:0:139374:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759404.387710:0:139374:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759404.387728:0:139374:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759404.387746:0:139374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387762:0:139374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387773:0:139374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387786:0:139374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387793:0:139374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387800:0:139374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387807:0:139374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759404.387811:0:139374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387820:0:139374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387833:0:139374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387841:0:139374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759404.387847:0:139374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60bffa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759404.874838:0:139422:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1f81be00 20000000:00000080:2.0:1782759404.874854:0:139422:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec77d5800 uarg=0000000000000000 00010000:00010000:3.0:1782759404.874967:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759404.875034:0:139422:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759404.875049:0:139422:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759404.875068:0:139422:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759404.875078:0:139422:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759404.875095:0:139422:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759404.875113:0:139422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875128:0:139422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875139:0:139422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875146:0:139422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875153:0:139422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875160:0:139422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875166:0:139422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759404.875171:0:139422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875178:0:139422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875203:0:139422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875210:0:139422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759404.875216:0:139422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c001 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759405.707717:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759405.707726:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759405.707732:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759405.707780:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.707807:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.707820:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759405.707843:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232824192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759405.707912:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759405.707997:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bf4840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759405.708614:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232824192 00000100:00100000:3.0:1782759405.708621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232824192 00000100:00100000:3.0:1782759405.708672:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1782759405.708682:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232824192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759405.708697:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759405.708712:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c008 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.708736:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.708747:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759405.708764:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759405.708815:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232824192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759405.708821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:0.0:1782759405.709658:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232824192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759405.709677:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759405.709687:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759405.709707:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759405.709712:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759405.709719:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759405.899927:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759406.474798:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759406.474823:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232824320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759406.474887:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759406.475306:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232824320 00000100:00100000:0.0:1782759406.475313:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232824320 00000100:00100000:0.0:1782759406.475374:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114 00000100:00100000:0.0:1782759406.475383:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232824320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759406.475417:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445941248 avail 1299701760 00000100:00100000:0.0:1782759406.475492:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232824320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759406.475500:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114 00000100:00100000:1.0:1782759406.475528:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232824320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759406.922753:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782759407.144359:0:139618:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64c: Nodemap enforces quota related RBAC roles ========================================================== 14:56:47 (1782759407) 00000100:00100000:2.0:1782759407.219199:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759407.219252:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462592 00000100:00100000:0.0:1782759407.219262:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462592 00000100:00080000:2.0:1782759407.219319:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759407.219337:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2665 00000100:00100000:0.0:1782759407.219356:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:103921:x1869355218462592:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759407.219401:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759407.219405:0:6532:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60a796) 00010000:00010000:0.0:1782759407.219407:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759407.219478:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.219495:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.219506:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.219557:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.219566:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.219574:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220209:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220219:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220227:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759407.220242:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ca55505 reply state 0000000021456ee7 transno 4294967961 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220261:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220268:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x16:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:0.0:1782759407.220271:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759407.220275:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759407.220280:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x16:0x0]: returning size 4096 00010000:00010000:0.0:1782759407.220288:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220295:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220301:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220307:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220313:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759407.220317:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220325:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220335:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759407.220337:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759407.220341:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220357:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c016 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759407.220368:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ca55505 reply state 0000000021456ee7 transno 4294967961 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220376:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.220382:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f98a5d6 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759407.220384:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759407.220386:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1782759407.220463:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:103921:x1869355218462592:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 1111us (1273us total) trans 4294967961 rc 0/0 00000100:00100000:0.0:1782759407.220470:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2665 00000001:00080000:3.0:1782759407.222475:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967961 is committed 00000020:00080000:3.0:1782759407.222500:0:6509:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 19 batchid updated 00010000:00010000:0.0:1782759407.222505:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222515:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222522:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222526:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759407.222529:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222535:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222556:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f98a5d6 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759407.222558:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759407.222561:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222566:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c01d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222607:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222614:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222620:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222626:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759407.222630:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222636:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222657:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x16:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:0.0:1782759407.222661:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759407.222664:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759407.222669:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c024 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759407.222712:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00000004:00080000:0.0:1782759407.222771:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc35133c0 with version 39 00000020:00080000:0.0:1782759407.222788:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 17 cancel update log [0x240000401:0x2:0x0].17: rc = 0 00000020:00080000:0.0:1782759407.222864:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 17 cancel update log [0x200000400:0x2:0x0].17: rc = 0 00000004:00080000:3.0:1782759407.222871:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 39 rpc_version 39 00000004:00080000:0.0:1782759407.222902:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc3513780 with version 40 00000020:00100000:3.0:1782759407.222906:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:0.0:1782759407.222907:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 18 cancel update log [0x240000401:0x2:0x0].18: rc = 0 00000100:00100000:3.0:1782759407.222921:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc542e680 x1869355232824576/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759407.222948:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232824576:0@lo:1000:osp_up1-0.0 00000020:00080000:0.0:1782759407.222959:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 18 cancel update log [0x200000400:0x2:0x0].18: rc = 0 00000004:00080000:0.0:1782759407.222994:0:6563:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8cddc3513c00 with version 41 00000020:00080000:0.0:1782759407.222998:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 19 cancel update log [0x240000401:0x2:0x0].19: rc = 0 00000100:00100000:3.0:1782759407.223016:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1782759407.223030:0:6563:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 19 cancel update log [0x200000400:0x2:0x0].19: rc = 0 00000020:00080000:0.0:1782759407.223042:0:6563:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 19 00000100:00100000:1.0:1782759407.223063:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232824576 00000100:00100000:3.0:1782759407.223071:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759407.223072:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232824576 00000100:00100000:1.0:1782759407.223131:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:1.0:1782759407.223139:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7666:x1869355232824576:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759407.223291:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7666:x1869355232824576:12345-0@lo:1000:osp_up1-0.0 Request processed in 153us (278us total) trans 4294967671 rc 0/0 00000100:00100000:1.0:1782759407.223299:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1782759407.223353:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232824576:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1782759407.223368:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 40 rpc_version 40 00000020:00100000:3.0:1782759407.223381:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759407.223387:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc542c380 x1869355232824832/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759407.223403:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232824832:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1782759407.223440:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759407.223477:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759407.225017:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232824832 00000100:00100000:0.0:1782759407.225024:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232824832 00000100:00100000:0.0:1782759407.225077:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116 00000100:00100000:0.0:1782759407.225087:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:7666:x1869355232824832:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1782759407.225203:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:7666:x1869355232824832:12345-0@lo:1000:osp_up1-0.0 Request processed in 117us (1762us total) trans 4294967672 rc 0/0 00000100:00100000:0.0:1782759407.225208:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116 00000100:00100000:2.0:1782759407.225239:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232824832:0@lo:1000:osp_up1-0.0 00000004:00080000:2.0:1782759407.225250:0:7666:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cded24a53c0 version 41 rpc_version 41 00000020:00100000:2.0:1782759407.225265:0:7666:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759407.225272:0:7666:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4bd7480 x1869355232825088/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759407.225288:0:7666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232825088:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1782759407.225312:0:7666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759407.225339:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825088 00000100:00100000:2.0:1782759407.225342:0:7666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759407.225344:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825088 00000100:00100000:1.0:1782759407.225380:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117 00000100:00100000:1.0:1782759407.225452:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7666:x1869355232825088:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1782759407.225540:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7666:x1869355232825088:12345-0@lo:1000:osp_up1-0.0 Request processed in 99us (226us total) trans 4294967673 rc 0/0 00000100:00100000:1.0:1782759407.225551:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117 00000100:00100000:2.0:1782759407.225654:0:7666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7666:1869355232825088:0@lo:1000:osp_up1-0.0 00000001:00080000:0.0:1782759407.225670:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967671 is committed 00000020:00080000:0.0:1782759407.225678:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 28 batchid updated 00000020:00080000:2.0:1782759407.225697:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 28 00000004:00080000:2.0:1782759407.225798:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc686cf00 with version 59 00000020:00080000:2.0:1782759407.225813:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 28 cancel update log [0x200000401:0x2:0x0].28: rc = 0 00000004:00080000:3.0:1782759407.225836:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 59 rpc_version 59 00000020:00100000:3.0:1782759407.225851:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759407.225856:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4d05f80 x1869355232825344/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:2.0:1782759407.225858:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 28 cancel update log [0x240000400:0x2:0x0].28: rc = 0 00000100:00100000:3.0:1782759407.225878:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232825344:0@lo:1000:osp_up0-1.0 00000020:00080000:2.0:1782759407.225881:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 28 00000100:00100000:3.0:1782759407.225901:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759407.225923:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759407.225939:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825344 00000100:00100000:0.0:1782759407.225945:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825344 00000100:00100000:0.0:1782759407.225974:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:0.0:1782759407.225979:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355232825344:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759407.226058:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232825344:12345-0@lo:1000:osp_up0-1.0 Request processed in 78us (156us total) trans 4294967962 rc 0/0 00000100:00100000:0.0:1782759407.226073:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:3.0:1782759407.226103:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232825344:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759407.498792:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759407.498815:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232825856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.498879:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232825728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.498890:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759407.498962:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232825600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759407.498967:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232825984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.499017:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759407.499039:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759407.499046:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232826240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499078:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759407.499086:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759407.499107:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232826368:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.499113:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232826752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499142:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759407.499166:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825856 00000100:00100000:2.0:1782759407.499172:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232826880:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.499174:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825856 00000100:00100000:2.0:1782759407.499202:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759407.499224:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825728 00000100:00100000:0.0:1782759407.499229:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825728 00000100:00100000:2.0:1782759407.499238:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825472 00000100:00100000:2.0:1782759407.499244:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825472 00000100:00100000:0.0:1782759407.499273:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884 00000100:00100000:0.0:1782759407.499283:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499298:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1782759407.499313:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232825472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759407.499336:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759407.499348:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232825856:12345-0@lo:400:kworker.0 Request processed in 65us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759407.499356:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884 00000100:00100000:0.0:1782759407.499377:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4885 00000100:00100000:2.0:1782759407.499384:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232825472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759407.499388:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499396:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:0.0:1782759407.499423:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232825728:12345-0@lo:400:kworker.0 Request processed in 38us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759407.499430:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4885 00000100:00100000:2.0:1782759407.499440:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826240 00000100:00100000:2.0:1782759407.499456:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826240 00000100:00100000:0.0:1782759407.499476:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759407.499520:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232825728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499670:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826368 00000100:00100000:2.0:1782759407.499675:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826368 00000100:00100000:2.0:1782759407.499698:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826880 00000100:00100000:2.0:1782759407.499703:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826880 00000100:00100000:3.0:1782759407.499704:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759407.499734:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232826112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.499760:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759407.499773:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826752 00000100:00100000:3.0:1782759407.499777:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232826624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499780:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826752 00000100:00100000:3.0:1782759407.499805:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759407.499810:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:2.0:1782759407.499819:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232826240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.499836:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826112 00000100:00100000:3.0:1782759407.499841:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826112 00000100:00100000:3.0:1782759407.499870:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826624 00000100:00100000:3.0:1782759407.499874:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826624 00000100:00100000:2.0:1782759407.499881:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232826240:12345-0@lo:400:kworker.0 Request processed in 64us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759407.499889:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:3.0:1782759407.499893:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4886 00000100:00100000:3.0:1782759407.499902:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232826112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499906:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:2.0:1782759407.499915:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232826368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.499949:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232826112:12345-0@lo:400:kworker.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759407.499956:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232826368:12345-0@lo:400:kworker.0 Request processed in 41us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.499957:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4886 00000100:00100000:2.0:1782759407.499967:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:3.0:1782759407.499975:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887 00000100:00100000:3.0:1782759407.499985:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232826624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.499986:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759407.500000:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.500025:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232826624:12345-0@lo:400:kworker.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.500032:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887 00000100:00100000:2.0:1782759407.500039:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232826880:12345-0@lo:400:kworker.0 Request processed in 42us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759407.500048:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759407.500064:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:3.0:1782759407.500065:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825600 00000100:00100000:3.0:1782759407.500070:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825600 00000100:00100000:2.0:1782759407.500074:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.500101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:2.0:1782759407.500107:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232826752:12345-0@lo:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.500112:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232825600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.500118:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00080000:2.0:1782759407.500145:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759407.500150:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759407.500154:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759407.500156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232825600:12345-0@lo:400:kworker.0 Request processed in 47us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759407.500165:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00100000:2.0:1782759407.500182:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232826240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.500195:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232826752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.500218:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232825600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.500231:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232826112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759407.500242:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232826624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.500260:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232826368:0@lo:400:kworker.0 00000100:00100000:1.0:1782759407.500376:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759407.500467:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232826496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.500476:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232825984 00000100:00100000:0.0:1782759407.500482:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232825984 00000100:00100000:1.0:1782759407.500496:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759407.500521:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232826496 00000100:00100000:0.0:1782759407.500532:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232826496 00000100:00080000:1.0:1782759407.500537:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759407.500559:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4888 00000100:00100000:0.0:1782759407.500565:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.500611:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232826880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759407.500627:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232825856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.500633:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232825984:12345-0@lo:400:kworker.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759407.500640:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4888 00000100:00100000:2.0:1782759407.500647:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759407.500658:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4889 00000100:00100000:0.0:1782759407.500667:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232826496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.500697:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232826496:12345-0@lo:400:kworker.0 Request processed in 32us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759407.500703:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4889 00000100:00100000:0.0:1782759407.500738:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232825984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759407.500746:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232826496:0@lo:400:kworker.0 00010000:00010000:2.0:1782759407.946776:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759408.010826:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759408.010849:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232827008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759408.010916:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759408.010957:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827008 00000100:00100000:3.0:1782759408.010965:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827008 00000100:00100000:3.0:1782759408.011012:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:3.0:1782759408.011021:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232827008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759408.011042:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759408.011089:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232827008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759408.011096:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1782759408.011131:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232827008:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759408.523752:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232827136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759408.523827:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759408.523875:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827136 00000100:00100000:0.0:1782759408.523884:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827136 00000100:00100000:0.0:1782759408.523950:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:0.0:1782759408.523962:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232827136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759408.523999:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:0.0:1782759408.524065:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3662:x1869355232827136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759408.524072:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:1.0:1782759408.524130:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967671 gen 2 00000004:00080000:1.0:1782759408.524136:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967669 committed transno 4294967671 00000004:00080000:1.0:1782759408.524151:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967670 committed transno 4294967671 00000004:00080000:1.0:1782759408.524160:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967671 committed transno 4294967671 00000100:00100000:1.0:1782759408.524172:0:3662:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8cddc542c380 x1869355232824832/t4294967672(4294967672) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1782759423 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782759408.524188:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232827136:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1782759408.782027:0:139813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcadc5fb10 20000000:00000080:2.0:1782759408.782046:0:139813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4791800 uarg=0000000000000000 10000000:01000000:2.0:1782759408.782208:0:139813:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759408.782229:0:139813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.782247:0:139813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.782269:0:139813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.782310:0:139813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.782325:0:139813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 23 pid: 6526 timeout: 3599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.782339:0:139813:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139813:1869355232827264:0@lo:104: 00000100:00100000:2.0:1782759408.782410:0:139813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759408.782473:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827264 00000100:00100000:0.0:1782759408.782481:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827264 00000100:00100000:2.0:1782759408.782533:0:139813:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759408.782543:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1782759408.782555:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:139813:x1869355232827264:12345-0@lo:104: 00010000:00010000:0.0:1782759408.782567:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759408.782661:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759408.782669:0:139813:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:139813:1869355232827264:0@lo:104: 00000100:00100000:0.0:1782759408.782670:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:139813:x1869355232827264:12345-0@lo:104: Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759408.782681:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00010000:00010000:1.0:1782759408.782683:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759408.782691:0:139813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.782692:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.782711:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759408.782716:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.782735:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759408.782743:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759408.782761:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759408.782792:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.782799:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759408.782829:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.782837:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c008 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c00f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759408.782843:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232827392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759408.782863:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759408.782867:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759408.782869:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759408.782876:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759408.782997:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827392 00000100:00100000:1.0:1782759408.783001:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827392 00010000:00010000:1.0:1782759408.783019:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 24 pid: 6526 timeout: 3599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759408.783080:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1782759408.783088:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232827392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759408.783098:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759408.783103:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 24 pid: 6526 timeout: 3599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783113:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 24 pid: 6526 timeout: 3599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783126:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c00f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c008 expref: 24 pid: 6526 timeout: 3599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783142:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783149:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783160:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783167:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783174:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783180:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783184:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759408.783188:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783194:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783207:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759408.783217:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759408.783220:0:139813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.783229:0:139813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759408.783237:0:139813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c02b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759408.783261:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232827392:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759408.783275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:0.0:1782759408.783295:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232827392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759408.862065:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759408.862107:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759408.862342:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759408.862426:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759408.862471:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759408.862510:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463232 00000100:00100000:2.0:1782759408.862510:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463104 00000100:00100000:3.0:1782759408.862521:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463232 00000100:00100000:2.0:1782759408.862522:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463104 00000100:00100000:3.0:1782759408.862605:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2801 00000100:00100000:1.0:1782759408.862605:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462848 00000100:00100000:1.0:1782759408.862611:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462848 00000100:00100000:3.0:1782759408.862620:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218463232:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759408.862651:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462976 00000100:00100000:1.0:1782759408.862655:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462976 00000100:00100000:3.0:1782759408.862687:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218463232:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759408.862696:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2801 00000100:00100000:3.0:1782759408.862718:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218462720 00000100:00100000:3.0:1782759408.862721:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218462720 00000100:00100000:3.0:1782759408.862743:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2976 00000100:00100000:3.0:1782759408.862749:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218462720:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759408.862773:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218462720:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759408.862779:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2976 00000100:00100000:3.0:1782759408.862804:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4890 00000100:00100000:3.0:1782759408.862810:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218462848:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759408.862838:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218462848:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759408.862845:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4890 00000100:00080000:3.0:1782759408.862863:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759408.862868:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759408.862870:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759408.862902:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2802 00000100:00100000:2.0:1782759408.862912:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218463104:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759408.862948:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218463104:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759408.862955:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2802 00000100:00100000:1.0:1782759408.865918:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4891 00000100:00100000:1.0:1782759408.865932:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218462976:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759408.866001:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218462976:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (3574us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759408.866007:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4891 00010000:00010000:0.0:1782759408.970872:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759409.034855:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232827520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759409.034929:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759409.035053:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827520 00000100:00100000:3.0:1782759409.035061:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827520 00000100:00100000:3.0:1782759409.035130:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:3.0:1782759409.035141:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232827520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759409.035180:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759409.035232:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232827520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759409.035240:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:3.0:1782759409.035291:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232827520:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782759409.035418:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759409.036696:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232827648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759409.036759:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759409.036898:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827648 00000100:00100000:0.0:1782759409.036904:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827648 00000100:00100000:0.0:1782759409.036998:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:0.0:1782759409.037007:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232827648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759409.037023:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759409.037067:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232827648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759409.037074:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00000100:00080000:2.0:1782759409.037113:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759409.037137:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232827648:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782759409.190397:0:139861:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfb2f5fe0 20000000:00000080:1.0:1782759409.190412:0:139861:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd8a1000 uarg=0000000000000000 10000000:01000000:1.0:1782759409.190627:0:139861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759409.190649:0:139861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190666:0:139861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190676:0:139861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190683:0:139861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190690:0:139861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190697:0:139861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190708:0:139861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759409.190713:0:139861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190720:0:139861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190732:0:139861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190740:0:139861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759409.190747:0:139861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60c032 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 139861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759409.994828:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759410.593161:0:140008:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffbc4c0260 20000000:00000080:0.0:1782759410.593180:0:140008:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12eb400 uarg=0000000000000000 10000000:01000000:0.0:1782759410.593787:0:140008:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759410.593807:0:140008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593823:0:140008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593834:0:140008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593842:0:140008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593854:0:140008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593862:0:140008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593868:0:140008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759410.593873:0:140008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593882:0:140008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593894:0:140008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593903:0:140008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.593910:0:140008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c039 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759410.765891:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759410.765900:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759410.765905:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759410.765952:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.765964:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.765995:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759410.766018:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232827776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759410.766081:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759410.766144:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827776 00000100:00100000:0.0:1782759410.766145:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759410.766152:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827776 00000100:00100000:3.0:1782759410.766216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:3.0:1782759410.766225:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232827776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759410.766239:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759410.766252:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c040 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759410.766273:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759410.766283:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759410.766291:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5000, rc 0) 00000100:00100000:3.0:1782759410.766340:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232827776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759410.766345:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:0.0:1782759410.766384:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232827776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759410.766399:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.766409:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759410.766437:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759410.766441:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759410.766448:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759411.002372:0:140056:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff07241530 20000000:00000080:1.0:1782759411.002389:0:140056:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3ecf400 uarg=0000000000000000 10000000:01000000:1.0:1782759411.003143:0:140056:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759411.003162:0:140056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.003179:0:140056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.003188:0:140056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.003298:0:140056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.003327:0:140056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 23 pid: 6526 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759411.003343:0:140056:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140056:1869355232827904:0@lo:104: 00000100:00100000:1.0:1782759411.003404:0:140056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759411.003462:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232827904 00000100:00100000:2.0:1782759411.003470:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232827904 00000100:00100000:2.0:1782759411.003523:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1782759411.003528:0:140056:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759411.003536:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:140056:x1869355232827904:12345-0@lo:104: 00010000:00010000:2.0:1782759411.003550:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.003631:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759411.003638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:140056:x1869355232827904:12345-0@lo:104: Request processed in 106us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759411.003645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:1.0:1782759411.003719:0:140056:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140056:1869355232827904:0@lo:104: 00010000:00010000:0.0:1782759411.003719:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759411.003726:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.003734:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759411.003737:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.003738:0:140056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.003757:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759411.003764:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759411.003770:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759411.003805:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.003812:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759411.003836:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759411.003843:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c040 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c047 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759411.003844:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232828032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759411.003861:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759411.003863:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759411.003865:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759411.003875:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759411.003917:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828032 00000100:00100000:2.0:1782759411.003921:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828032 00010000:00010000:2.0:1782759411.003937:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 24 pid: 6526 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759411.003991:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1782759411.003996:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232828032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759411.004005:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759411.004009:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 24 pid: 6526 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004016:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 24 pid: 6526 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004025:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c047 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c040 expref: 24 pid: 6526 timeout: 3601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004039:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004044:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004052:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004056:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004060:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004064:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004067:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759411.004070:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004074:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004085:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759411.004090:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759411.004112:0:140056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759411.004118:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232828032:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759411.004124:0:140056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759411.004130:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00010000:00010000:1.0:1782759411.004139:0:140056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60c04e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759411.004189:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232828032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759411.019756:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759411.458100:0:140104:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0b1f0510 20000000:00000080:3.0:1782759411.458119:0:140104:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc457b400 uarg=0000000000000000 10000000:01000000:3.0:1782759411.458264:0:140104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759411.458285:0:140104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458300:0:140104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458310:0:140104:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458316:0:140104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458323:0:140104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458331:0:140104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458337:0:140104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759411.458341:0:140104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458349:0:140104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458361:0:140104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458380:0:140104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759411.458387:0:140104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c055 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759411.595748:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232828160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759411.595818:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759411.595858:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828160 00000100:00100000:3.0:1782759411.595865:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828160 00000100:00100000:3.0:1782759411.595924:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:3.0:1782759411.595935:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232828160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759411.595973:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445937152 avail 1299697664 00000100:00100000:3.0:1782759411.596017:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232828160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759411.596022:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:0.0:1782759411.596059:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232828160:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759411.908671:0:140152:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec7c25b90 20000000:00000080:1.0:1782759411.908688:0:140152:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3ece800 uarg=0000000000000000 10000000:01000000:1.0:1782759411.908853:0:140152:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759411.908879:0:140152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.908893:0:140152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909240:0:140152:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909252:0:140152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909257:0:140152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909261:0:140152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909265:0:140152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759411.909268:0:140152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909273:0:140152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909282:0:140152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909286:0:140152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759411.909291:0:140152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c05c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.042693:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759412.363658:0:140201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca6a09110 20000000:00000080:3.0:1782759412.363676:0:140201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4578400 uarg=0000000000000000 00010000:00010000:3.0:1782759412.364101:0:140201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759412.364118:0:140201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759412.364140:0:140201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759412.364153:0:140201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759412.364166:0:140201:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759412.364184:0:140201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364199:0:140201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364209:0:140201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364222:0:140201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364228:0:140201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364236:0:140201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364242:0:140201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759412.364247:0:140201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364255:0:140201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364267:0:140201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364275:0:140201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.364281:0:140201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c063 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759412.368465:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967962 is committed 10000000:01000000:2.0:1782759412.491473:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759412.491481:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759412.491486:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759412.491529:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.491541:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.491552:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759412.491607:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232828288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759412.491674:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759412.491737:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759412.491872:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828288 00000100:00100000:3.0:1782759412.491880:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828288 00000100:00100000:3.0:1782759412.491926:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:3.0:1782759412.491936:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232828288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759412.491957:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759412.491971:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c06a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.491993:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.492003:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759412.492013:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759412.492059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232828288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.492066:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:2.0:1782759412.492162:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232828288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759412.492177:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.492186:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759412.492204:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759412.492209:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759412.492228:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759412.618738:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759412.618762:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759412.618835:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759412.619160:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828416 00000100:00100000:1.0:1782759412.619169:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828416 00000100:00100000:1.0:1782759412.619239:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1782759412.619251:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232828416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759412.619290:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759412.619346:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232828416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759412.619352:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:1.0:1782759412.619377:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232828928:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.619424:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759412.619452:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232829440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.619553:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759412.619596:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759412.619605:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232828544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.619608:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232828672:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.619643:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759412.619651:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759412.619675:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232829184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.619697:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759412.619713:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232829696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.619733:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759412.619756:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759412.619762:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232828800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.619782:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759412.619799:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232829312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.619831:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828544 00000100:00100000:3.0:1782759412.619837:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828544 00000100:00100000:3.0:1782759412.619873:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829184 00000100:00100000:3.0:1782759412.619877:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829184 00000100:00100000:3.0:1782759412.619902:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829696 00000100:00100000:3.0:1782759412.619905:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829696 00000100:00100000:3.0:1782759412.619927:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828800 00000100:00100000:3.0:1782759412.619930:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828800 00000100:00100000:2.0:1782759412.619935:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759412.619950:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:2.0:1782759412.619959:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232829824:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.619960:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232828544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.619989:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759412.620084:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759412.620089:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759412.620884:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828928 00000100:00100000:0.0:1782759412.620889:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828928 00000100:00100000:0.0:1782759412.620925:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232828672 00000100:00100000:0.0:1782759412.620931:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232828672 00000100:00100000:0.0:1782759412.620943:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:2.0:1782759412.620984:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829440 00000100:00100000:2.0:1782759412.620986:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829440 00000100:00100000:2.0:1782759412.621010:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829312 00000100:00100000:2.0:1782759412.621012:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829312 00000100:00100000:2.0:1782759412.621022:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829824 00000100:00100000:2.0:1782759412.621023:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829824 00000100:00100000:2.0:1782759412.621038:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1782759412.621042:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232829440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.621076:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232829440:12345-0@lo:400:kworker.0 Request processed in 35us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759412.621081:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:2.0:1782759412.621090:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:2.0:1782759412.621093:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232829312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759412.621108:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232828928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759412.621133:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3664:x1869355232828928:12345-0@lo:400:kworker.0 Request processed in 187us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759412.621137:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:0.0:1782759412.621147:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122 00000100:00100000:0.0:1782759412.621150:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232828672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759412.621168:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232828672:12345-0@lo:400:kworker.0 Request processed in 17us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759412.621171:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122 00000100:00100000:3.0:1782759412.621267:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232828544:12345-0@lo:400:kworker.0 Request processed in 1308us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.621275:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00000100:00100000:3.0:1782759412.621291:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893 00000100:00100000:3.0:1782759412.621298:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232829184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.621334:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232829184:12345-0@lo:400:kworker.0 Request processed in 37us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.621341:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893 00000100:00100000:3.0:1782759412.621352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4894 00000100:00100000:3.0:1782759412.621358:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232829696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.621383:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232829696:12345-0@lo:400:kworker.0 Request processed in 25us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.621388:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4894 00000100:00100000:3.0:1782759412.621411:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4895 00000100:00100000:3.0:1782759412.621419:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232828800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.621446:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232828800:12345-0@lo:400:kworker.0 Request processed in 28us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.621452:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4895 00000100:00100000:2.0:1782759412.621617:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232829312:12345-0@lo:400:kworker.0 Request processed in 521us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759412.621624:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00100000:2.0:1782759412.621636:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1782759412.621644:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232829824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759412.621673:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232829824:12345-0@lo:400:kworker.0 Request processed in 31us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759412.621679:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00080000:2.0:1782759412.621710:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759412.621713:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759412.622697:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232828544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.622708:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232829056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.622742:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759412.622764:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232829568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.622783:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759412.622938:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759412.623004:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232828928:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.623016:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232829440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623119:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829056 00000100:00100000:3.0:1782759412.623125:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829056 00000100:00100000:3.0:1782759412.623158:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829568 00000100:00100000:3.0:1782759412.623162:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829568 00000100:00100000:3.0:1782759412.623177:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896 00000100:00100000:3.0:1782759412.623184:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232829056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623223:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232829056:12345-0@lo:400:kworker.0 Request processed in 39us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.623229:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896 00000100:00100000:3.0:1782759412.623242:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4897 00000100:00100000:3.0:1782759412.623248:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232829568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623285:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232829568:12345-0@lo:400:kworker.0 Request processed in 37us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759412.623291:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4897 00000100:00080000:3.0:1782759412.623307:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759412.623327:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232828800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623338:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232829312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623349:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232829824:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623358:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967962 gen 2 00000004:00080000:3.0:1782759412.623363:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967962 committed transno 4294967962 00000100:00100000:3.0:1782759412.623379:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232828672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623390:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232829184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759412.623411:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232829696:0@lo:400:kworker.0 00000001:00080000:3.0:1782759412.623523:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967673 is committed 00000100:00100000:1.0:1782759412.624256:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232829056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759412.624267:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232829568:0@lo:400:kworker.0 00010000:00010000:2.0:1782759413.069795:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759413.130741:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232829952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759413.130808:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759413.130875:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232829952 00000100:00100000:2.0:1782759413.130882:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232829952 00000100:00100000:2.0:1782759413.130931:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1782759413.130941:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232829952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759413.130966:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759413.131066:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232829952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759413.131072:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:1.0:1782759413.131114:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232829952:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759413.645005:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232830080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759413.645061:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759413.645222:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232830080 00000100:00100000:1.0:1782759413.645228:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232830080 00000100:00100000:1.0:1782759413.645280:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123 00000100:00100000:1.0:1782759413.645288:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232830080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759413.645315:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:1.0:1782759413.645355:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232830080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759413.645361:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123 00000100:00100000:2.0:1782759413.645378:0:3665:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967673 gen 2 00000004:00080000:2.0:1782759413.645383:0:3665:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967672 committed transno 4294967673 00000004:00080000:2.0:1782759413.645410:0:3665:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967673 committed transno 4294967673 00000100:00100000:2.0:1782759413.645422:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232830080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759413.981955:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759413.981992:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759413.982018:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759413.982042:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463616 00000100:00100000:3.0:1782759413.982043:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759413.982055:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463616 00000100:00100000:3.0:1782759413.982073:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759413.982117:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463488 00000100:00100000:1.0:1782759413.982121:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463488 00000100:00100000:0.0:1782759413.982139:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463360 00000100:00100000:0.0:1782759413.982144:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463360 00000100:00100000:2.0:1782759413.982156:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463872 00000100:00100000:2.0:1782759413.982164:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463872 00000100:00100000:0.0:1782759413.982182:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2979 00000100:00100000:0.0:1782759413.982190:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218463360:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759413.982243:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218463360:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 56us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759413.982248:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2979 00000100:00100000:2.0:1782759413.982307:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218463744 00000100:00100000:2.0:1782759413.982311:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218463744 00000100:00100000:2.0:1782759413.982351:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2806 00000100:00100000:0.0:1782759413.982358:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2807 00000100:00100000:2.0:1782759413.982364:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218463872:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759413.982371:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218463744:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759413.982427:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218463872:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 64us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759413.982428:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218463744:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759413.982443:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2807 00000100:00100000:1.0:1782759413.982480:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4898 00000100:00100000:1.0:1782759413.982490:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218463616:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759413.982511:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4899 00000100:00100000:3.0:1782759413.982519:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218463488:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759413.982529:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218463616:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759413.982537:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4898 00000100:00080000:1.0:1782759413.982565:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759413.982570:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759413.982572:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759413.982574:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759413.982842:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218463488:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759413.982850:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4899 00000100:00100000:2.0:1782759413.985501:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2806 00010000:00010000:2.0:1782759414.090755:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759414.155419:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232830208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759414.155486:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759414.156903:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232830336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759414.156959:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759414.157034:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232830208 00000100:00100000:1.0:1782759414.157043:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232830208 00000100:00100000:1.0:1782759414.157104:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232830336 00000100:00100000:1.0:1782759414.157108:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232830336 00000100:00100000:1.0:1782759414.157128:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1782759414.157136:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232830208:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759414.157166:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1782759414.157176:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759414.157198:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:0.0:1782759414.157209:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232830336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759414.157223:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759414.157227:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232830208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759414.157235:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1782759414.157266:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232830336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759414.157274:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1782759414.157297:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232830336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759414.157351:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232830208:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782759414.196069:0:140397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca9ba6860 20000000:00000080:3.0:1782759414.196085:0:140397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e80c00 uarg=0000000000000000 00010000:00010000:3.0:1782759414.196263:0:140397:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759414.196280:0:140397:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759414.196301:0:140397:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759414.196312:0:140397:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759414.196323:0:140397:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759414.196337:0:140397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759414.196351:0:140397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759414.196357:0:140397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759414.196400:0:140397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759414.196410:0:140397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 23 pid: 6525 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759414.196420:0:140397:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140397:1869355232830464:0@lo:104: 00000100:00100000:3.0:1782759414.196468:0:140397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759414.196553:0:140397:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759414.196559:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232830464 00000100:00100000:0.0:1782759414.196566:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232830464 00000100:00100000:0.0:1782759414.196648:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1782759414.196658:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:140397:x1869355232830464:12345-0@lo:104: 00010000:00010000:0.0:1782759414.196671:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759414.196735:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759414.196742:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:140397:x1869355232830464:12345-0@lo:104: Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759414.196750:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:3.0:1782759414.196751:0:140397:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140397:1869355232830464:0@lo:104: 00010000:00010000:2.0:1782759414.196773:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759414.196778:0:140397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.196782:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.196793:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759414.196797:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.196807:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759414.196815:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759414.196827:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759414.196859:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.196867:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759414.196896:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759414.196903:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c06a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c071 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759414.196907:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232830592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759414.196923:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759414.196927:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759414.196929:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759414.196943:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759414.196985:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232830592 00000100:00100000:1.0:1782759414.196990:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232830592 00010000:00010000:1.0:1782759414.197010:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 24 pid: 6525 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759414.197035:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1782759414.197043:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232830592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759414.197054:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759414.197059:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 24 pid: 6525 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197071:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 24 pid: 6525 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197084:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c071 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c06a expref: 24 pid: 6525 timeout: 3604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197096:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197104:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197116:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197129:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197135:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197141:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197146:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759414.197150:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197156:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197171:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759414.197179:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759414.197198:0:140397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759414.197209:0:140397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759414.197215:0:140397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c078 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759414.197230:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232830592:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759414.197239:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1782759414.197259:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232830592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759415.114726:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759415.508662:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759415.513552:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464000 00000100:00100000:1.0:1782759415.513568:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464000 00000100:00080000:2.0:1782759415.513678:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759415.513694:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2666 00000100:00100000:1.0:1782759415.513706:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104227:x1869355218464000:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759415.513729:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759415.513750:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c07f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27249 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.513818:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c086 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.513829:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c086 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.513837:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c086 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759415.513874:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759415.513877:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759415.513896:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c086 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.513913:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c07f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27249 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.513923:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c086 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27249 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.513929:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759415.513931:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759415.513934:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759415.513986:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104227:x1869355218464000:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 283us (5421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759415.513992:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2666 00000100:00100000:1.0:1782759415.517736:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759415.518033:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464128 00000100:00100000:2.0:1782759415.518042:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464128 00000100:00100000:2.0:1782759415.518098:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2667 00000100:00100000:2.0:1782759415.518108:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104227:x1869355218464128:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759415.524699:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104227:x1869355218464128:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 6584us (6964us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759415.524713:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2667 00000100:00100000:3.0:1782759415.539683:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759415.540483:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464256 00000100:00100000:1.0:1782759415.540499:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464256 00000100:00100000:1.0:1782759415.540559:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2668 00000100:00100000:1.0:1782759415.540570:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104228:x1869355218464256:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759415.544973:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104228:x1869355218464256:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4397us (5290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759415.544989:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2668 00000100:00100000:2.0:1782759415.555119:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759415.555178:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464384 00000100:00100000:3.0:1782759415.555187:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464384 00000100:00100000:3.0:1782759415.555248:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2669 00000100:00100000:3.0:1782759415.555260:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104229:x1869355218464384:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759415.564353:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104229:x1869355218464384:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 9087us (9236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759415.564364:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2669 00000100:00100000:0.0:1782759415.583669:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759415.583744:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464512 00000100:00100000:1.0:1782759415.583754:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464512 00000100:00100000:1.0:1782759415.583812:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2670 00000100:00100000:1.0:1782759415.583821:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104230:x1869355218464512:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759415.590457:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104230:x1869355218464512:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 6628us (6787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759415.590477:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2670 00000100:00100000:0.0:1782759415.601497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759415.601564:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464640 00000100:00100000:3.0:1782759415.601616:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464640 00000100:00100000:3.0:1782759415.601698:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2671 00000100:00100000:3.0:1782759415.601710:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104231:x1869355218464640:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759415.610748:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104231:x1869355218464640:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 9033us (9258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759415.610761:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2671 00000100:00100000:2.0:1782759415.618451:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759415.618528:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464768 00000100:00100000:1.0:1782759415.618540:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464768 00000100:00100000:1.0:1782759415.618646:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2672 00000100:00100000:1.0:1782759415.618658:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104232:x1869355218464768:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759415.625369:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104232:x1869355218464768:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 6699us (6922us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759415.625394:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2672 10000000:01000000:2.0:1782759415.626719:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759415.626725:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759415.626729:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759415.626772:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759415.626798:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759415.626808:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759415.626826:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232830720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759415.626873:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759415.626941:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759415.626986:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232830720 00000100:00100000:1.0:1782759415.626993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232830720 00000100:00100000:1.0:1782759415.627038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:1.0:1782759415.627048:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232830720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759415.627059:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759415.627071:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c08d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.627091:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.627108:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759415.627118:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759415.627156:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232830720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759415.627160:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:2.0:1782759415.627206:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232830720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759415.627224:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759415.627234:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759415.627251:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759415.627255:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759415.627260:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759416.041679:0:140592:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc99476a20 20000000:00000080:1.0:1782759416.041697:0:140592:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8cddc4c6f800 uarg=0000000000000000 00000040:00100000:1.0:1782759416.042196:0:140592:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 00000040:00100000:1.0:1782759416.042204:0:140592:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 00000040:00080000:1.0:1782759416.042282:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:1.0:1782759416.042307:0:140592:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool64c (null) (null) 00000040:00080000:1.0:1782759416.042322:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 104 off17280 00000040:00080000:1.0:1782759416.042339:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17504 00000040:00080000:1.0:1782759416.042405:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:1.0:1782759416.042413:0:140592:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool64c (null) (null) 00000040:00080000:1.0:1782759416.042422:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 112 off16320 00000040:00080000:1.0:1782759416.042544:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:1.0:1782759416.042614:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:1.0:1782759416.042622:0:140592:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool64c (null) (null) 00000040:00080000:1.0:1782759416.042630:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 112 off16352 00000040:00080000:1.0:1782759416.042686:0:140592:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:1.0:1782759416.042698:0:140592:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782759416.042712:0:140592:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042726:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042737:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042742:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042745:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042751:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042758:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042764:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042771:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042777:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042787:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042794:0:140592:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042811:0:140592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042848:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042861:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 9 pid: 6524 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.042875:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232830848:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759416.042962:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042968:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 9 pid: 6526 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.042974:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232830976:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759416.042992:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.042998:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043003:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831104:0@lo:104: 00000100:00100000:1.0:1782759416.043030:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759416.043052:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043065:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043072:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831232:0@lo:104: 00000100:00100000:2.0:1782759416.043081:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1782759416.043090:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043096:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043100:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831360:0@lo:104: 00000100:00100000:2.0:1782759416.043107:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759416.043136:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759416.043139:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831104 00000100:00100000:2.0:1782759416.043147:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831104 00000100:00100000:3.0:1782759416.043150:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831232 00000100:00100000:3.0:1782759416.043155:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831232 00010000:00010000:1.0:1782759416.043160:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043169:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 23 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043178:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831488:0@lo:104: 00000100:00100000:3.0:1782759416.043191:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831360 00000100:00100000:3.0:1782759416.043194:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831360 00000100:00100000:2.0:1782759416.043199:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1782759416.043205:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759416.043212:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831488 00000100:00100000:2.0:1782759416.043213:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+5:140592:x1869355232831232:12345-0@lo:104: 00000100:00100000:3.0:1782759416.043215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831488 00010000:00010000:2.0:1782759416.043230:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043230:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.043231:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:3.0:1782759416.043242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831104:12345-0@lo:104: 00010000:00010000:1.0:1782759416.043250:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.043255:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043263:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831616:0@lo:104: 00000100:00100000:1.0:1782759416.043301:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759416.043306:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759416.043314:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831232:12345-0@lo:104: Request processed in 106us (209us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759416.043316:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759416.043328:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831104:12345-0@lo:104: Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00010000:00010000:1.0:1782759416.043329:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043346:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.043347:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:2.0:1782759416.043351:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831616 00000100:00100000:2.0:1782759416.043357:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831616 00000100:00100000:1.0:1782759416.043359:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831744:0@lo:104: 00000100:00100000:2.0:1782759416.043395:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1782759416.043396:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759416.043408:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+5:140592:x1869355232831360:12345-0@lo:104: 00010000:00010000:2.0:1782759416.043417:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043418:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.043422:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831744 00000100:00100000:3.0:1782759416.043429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831744 00010000:00010000:1.0:1782759416.043439:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 23 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043451:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831872:0@lo:104: 00000100:00100000:3.0:1782759416.043455:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1782759416.043465:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831488:12345-0@lo:104: 00010000:00010000:2.0:1782759416.043473:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1782759416.043474:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.043484:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831360:12345-0@lo:104: Request processed in 78us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:1.0:1782759416.043500:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759416.043516:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232831872 00000100:00100000:2.0:1782759416.043520:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232831872 00010000:00010000:3.0:1782759416.043521:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1782759416.043530:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.043544:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00010000:00010000:1.0:1782759416.043544:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.043548:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831488:12345-0@lo:104: Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043556:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+6:140592:x1869355232831616:12345-0@lo:104: 00000100:00100000:1.0:1782759416.043566:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232832000:0@lo:104: 00010000:00010000:2.0:1782759416.043569:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.043572:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:3.0:1782759416.043629:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:1.0:1782759416.043630:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759416.043637:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782759416.043639:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:140592:x1869355232831744:12345-0@lo:104: 00010000:00010000:3.0:1782759416.043646:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.043653:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+5:140592:x1869355232831616:12345-0@lo:104: Request processed in 96us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00010000:00010000:1.0:1782759416.043667:0:140592:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.043678:0:140592:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 23 pid: 6526 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.043686:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1782759416.043689:0:140592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232832128:0@lo:104: 00000100:00100000:2.0:1782759416.043690:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759416.043690:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832000 00000100:00100000:3.0:1782759416.043693:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:140592:x1869355232831744:12345-0@lo:104: Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759416.043697:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832000 00000100:00100000:2.0:1782759416.043707:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:3.0:1782759416.043713:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:2.0:1782759416.043720:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+5:140592:x1869355232831872:12345-0@lo:104: 00010000:00010000:2.0:1782759416.043729:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.043735:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1782759416.043738:0:140592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759416.043747:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1782759416.043749:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc264f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140592:x1869355232832000:12345-0@lo:104: 00000100:00100000:1.0:1782759416.043756:0:140592:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79bc00 going to sleep for 11 seconds 00010000:00010000:0.0:1782759416.043758:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.043775:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1782759416.043781:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831104:0@lo:104: 00000100:00100000:2.0:1782759416.043783:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+4:140592:x1869355232831872:12345-0@lo:104: Request processed in 68us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043793:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00100000:1.0:1782759416.043802:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831232:0@lo:104: 00010000:00010000:0.0:1782759416.043802:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1782759416.043806:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:2.0:1782759416.043807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832128 00000100:00100000:0.0:1782759416.043811:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc264f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:140592:x1869355232832000:12345-0@lo:104: Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043813:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832128 00000100:00100000:1.0:1782759416.043819:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831360:0@lo:104: 00000100:00100000:0.0:1782759416.043822:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:1.0:1782759416.043838:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831488:0@lo:104: 00000100:00100000:2.0:1782759416.043841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1782759416.043853:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:140592:x1869355232832128:12345-0@lo:104: 00000100:00100000:1.0:1782759416.043857:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831616:0@lo:104: 00010000:00010000:2.0:1782759416.043862:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.043869:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831744:0@lo:104: 00000100:00100000:1.0:1782759416.043883:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232831872:0@lo:104: 00000100:00100000:1.0:1782759416.043895:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232832000:0@lo:104: 00010000:00010000:2.0:1782759416.043903:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1782759416.043909:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232832128:0@lo:104: 00000100:00100000:2.0:1782759416.043911:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:140592:x1869355232832128:12345-0@lo:104: Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.043921:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00010000:00010000:3.0:1782759416.043937:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1782759416.043940:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1782759416.043942:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.043947:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.043950:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759416.043955:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.043962:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759416.043977:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.043980:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc133cc20) 10000000:01000000:3.0:1782759416.043984:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1782759416.043986:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.043999:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759416.044007:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044009:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759416.044013:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759416.044023:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759416.044040:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044046:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044048:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759416.044056:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766a00/0xd5b45c7f5c600833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60083a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044067:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782759416.044069:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044074:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d000 already unused, calling callback (ffffffffc133cc20) 00010000:00010000:2.0:1782759416.044075:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.044077:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232832256:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1782759416.044078:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044098:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c600841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600848 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044099:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.044117:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1782759416.044120:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044122:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1782759416.044128:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759416.044133:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759416.044141:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759416.044145:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044157:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.044157:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832256 00000100:00100000:0.0:1782759416.044163:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832256 00010000:00010000:2.0:1782759416.044168:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044170:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1782759416.044182:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044183:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.044189:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 24 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759416.044198:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759416.044218:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044224:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759416.044238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00010000:00010000:2.0:1782759416.044239:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044250:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166d200/0xd5b45c7f5c600817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60081e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.044250:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232832256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759416.044266:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759416.044267:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782759416.044273:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044275:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166d000/0xd5b45c7f5c600825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60082c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.044276:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 24 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044289:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759416.044295:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.044304:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 24 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044306:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044308:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782759416.044313:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759416.044328:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044330:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdf021fc800 already unused, calling callback (ffffffffc133cc20) 00010000:00010000:0.0:1782759416.044332:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60083a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c600833 expref: 24 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759416.044335:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759416.044355:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759416.044358:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.044358:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:3.0:1782759416.044368:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759416.044385:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759416.044387:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044395:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759416.044405:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044406:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.044411:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232832256:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (295us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759416.044428:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759416.044429:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7200/0xd5b45c7f5c600809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600810 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.044429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00010000:00010000:3.0:1782759416.044438:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044444:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc800/0xd5b45c7f5c6007fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c600802 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044446:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782759416.044453:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044458:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759416.044463:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766800 already unused, calling callback (ffffffffc133cc20) 00010000:00010000:3.0:1782759416.044465:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759416.044468:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044479:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044496:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdf021fc600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759416.044497:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759416.044502:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759416.044509:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759416.044518:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759416.044529:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044529:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044547:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1782759416.044548:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759416.044561:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044566:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044569:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c6007ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007f4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.044599:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759416.044607:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044615:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759416.044616:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdf021fc600/0xd5b45c7f5c6007df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007e6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044621:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044631:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759416.044634:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044641:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759416.044647:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759416.044653:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759416.044667:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044673:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759416.044678:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044685:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c6007d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c6007d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.044698:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759416.044702:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759416.044709:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759416.044709:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759416.044711:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759416.044714:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759416.044720:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759416.044742:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232832384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759416.044748:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232832512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.044774:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232830848:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759416.044781:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759416.044792:0:140592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140592:1869355232830976:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759416.044801:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232832768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759416.044807:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832384 00000100:00100000:0.0:1782759416.044812:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832384 00010000:00010000:0.0:1782759416.044829:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 23 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.044835:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232832896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759416.044848:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759416.044862:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832768 00010000:00010000:1.0:1782759416.044866:0:140592:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.044866:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832768 00000100:00100000:2.0:1782759416.044882:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232833280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759416.044883:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759416.044884:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 24 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.044903:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832896 00000100:00100000:1.0:1782759416.044909:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832896 00000100:00100000:0.0:1782759416.044919:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1782759416.044920:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232832640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759416.044925:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759416.044928:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 25 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.044934:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+25:3662:x1869355232832384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759416.044947:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759416.044951:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 25 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.044954:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759416.044954:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833280 00000100:00100000:2.0:1782759416.044955:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232832256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.044960:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833280 00000100:00100000:3.0:1782759416.044968:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232833152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759416.044970:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 25 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.044982:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c600848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c600841 expref: 26 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.044985:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 26 pid: 6526 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.044992:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759416.044994:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759416.044997:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832640 00000100:00100000:2.0:1782759416.045002:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832640 00000100:00100000:1.0:1782759416.045013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833152 00000100:00100000:1.0:1782759416.045019:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833152 00000100:00100000:3.0:1782759416.045023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00010000:00010000:2.0:1782759416.045023:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 26 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.045029:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+27:3662:x1869355232832384:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759416.045037:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+27:3665:x1869355232832768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759416.045039:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 27 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.045044:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00010000:00010000:3.0:1782759416.045049:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759416.045056:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 26 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045064:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00010000:00010000:3.0:1782759416.045069:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 26 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.045073:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1782759416.045078:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+26:3662:x1869355232832896:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.045086:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:0.0:1782759416.045086:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+26:3665:x1869355232833280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759416.045092:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c600810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c600809 expref: 26 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.045092:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759416.045097:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759416.045102:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 26 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.045103:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+26:3664:x1869355232832640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759416.045105:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 26 pid: 6526 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.045109:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759416.045120:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759416.045127:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 25 pid: 6526 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.045130:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 25 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.045144:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355232832768:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759416.045155:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00010000:00010000:2.0:1782759416.045159:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 25 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.045170:0:6516:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 5 min 3 max 56 00010000:00010000:1.0:1782759416.045173:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 24 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.045179:0:6516:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_005' 00010000:00010000:0.0:1782759416.045192:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c6007d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c6007d1 expref: 24 pid: 6526 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.045198:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c600802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c6007fb expref: 24 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.045205:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759416.045208:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60081e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c600817 expref: 23 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.045213:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759416.045223:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759416.045238:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+21:3665:x1869355232833280:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759416.045247:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1782759416.045256:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+21:3662:x1869355232832896:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759416.045269:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1782759416.045271:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+20:3664:x1869355232832640:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759416.045280:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1782759416.045284:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+20:3664:x1869355232833152:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.045289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1782759416.045291:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232832640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759416.045301:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759416.045308:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045313:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759416.045324:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.045328:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232832384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.045344:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232832512 00010000:00010000:0.0:1782759416.045344:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c6007e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c6007df expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045346:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232833024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759416.045349:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232832896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.045351:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232832512 00010000:00010000:0.0:1782759416.045367:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759416.045384:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045397:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759416.045409:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833024 00000100:00100000:1.0:1782759416.045413:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833024 00000100:00100000:3.0:1782759416.045419:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:0.0:1782759416.045425:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+18:3664:x1869355232833152:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759416.045434:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+19:3663:x1869355232832512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759416.045436:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00010000:00010000:1.0:1782759416.045439:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 19 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045443:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232832768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759416.045450:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759416.045458:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759416.045464:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1782759416.045465:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232833280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759416.045475:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+18:3663:x1869355232833024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759416.045479:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.045484:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759416.045490:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 18 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.045494:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767200/0xd5b45c7f5c60082c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c600825 expref: 18 pid: 6524 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.045509:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 17 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.045516:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759416.045521:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdf021fc000/0xd5b45c7f5c6007f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c6007ed expref: 17 pid: 6525 timeout: 3606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759416.045528:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759416.045556:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+16:3663:x1869355232833024:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759416.045561:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:0.0:1782759416.045641:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232833152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759416.045650:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+15:3663:x1869355232832512:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759416.045659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:3.0:1782759416.045756:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759416.045770:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232832512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759416.045780:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232833024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759416.045796:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218464896 00000100:00100000:2.0:1782759416.045802:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218464896 00010000:00010000:2.0:1782759416.045820:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 10 pid: 6524 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045844:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 729 00000100:00100000:2.0:1782759416.045855:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218464896:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759416.045864:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759416.045869:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 10 pid: 6524 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759416.045879:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 10 pid: 6524 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759416.045885:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:2.0:1782759416.045899:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60a6cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d10 expref: 10 pid: 6524 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759416.045907:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465024 00010000:00010000:2.0:1782759416.045910:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759416.045912:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465024 00010000:00010000:1.0:1782759416.045931:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 10 pid: 6526 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759416.045949:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218464896:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759416.045957:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 730 00000100:00100000:1.0:1782759416.045968:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218465024:12345-192.168.202.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759416.045972:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 729 00010000:00010000:1.0:1782759416.045980:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759416.045987:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 9 pid: 6526 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.045997:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 9 pid: 6526 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046009:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60a6c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d09 expref: 9 pid: 6526 timeout: 3556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046019:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046028:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046040:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046053:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046059:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046065:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046070:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759416.046074:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046082:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046097:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759416.046107:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759416.046136:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2403:x1869355218465024:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 170us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759416.046143:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 730 00010000:00010000:3.0:1782759416.046166:0:140592:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.046175:0:140592:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.046179:0:140592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c09b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140592 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759416.138776:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759416.714930:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759416.714955:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232833408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759416.715024:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759416.715105:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833408 00000100:00100000:0.0:1782759416.715113:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833408 00000100:00100000:0.0:1782759416.715174:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:0.0:1782759416.715181:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232833408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759416.715210:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445904384 avail 1299664896 00000100:00100000:0.0:1782759416.715252:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232833408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759416.715257:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:1.0:1782759416.715301:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232833408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759417.163001:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759417.226947:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759417.226954:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 52 10000000:01000000:2.0:1782759417.226960:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759417.227006:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.227018:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.227030:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.227053:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232833536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.227123:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.227179:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833536 00000100:00100000:2.0:1782759417.227183:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.227187:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833536 00000100:00100000:3.0:1782759417.227255:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:3.0:1782759417.227277:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355232833536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759417.227289:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759417.227300:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0a2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.227320:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.227331:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.227340:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5e00, rc 0) 00000100:00100000:3.0:1782759417.227408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232833536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.227415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:0.0:1782759417.227478:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232833536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759417.227493:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.227503:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759417.227649:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232833664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.227679:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.227748:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.227862:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833664 00000100:00100000:1.0:1782759417.227873:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833664 00000100:00100000:1.0:1782759417.227961:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2982 00000100:00100000:1.0:1782759417.227969:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232833664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.228087:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232833664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.228094:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2982 00000100:00100000:2.0:1782759417.228162:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232833664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.228195:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232833792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.228236:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.228395:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.228399:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833792 00000100:00100000:0.0:1782759417.228405:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833792 00000100:00100000:0.0:1782759417.228426:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2983 00000100:00100000:0.0:1782759417.228433:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232833792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.228516:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232833792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.228523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2983 00000100:00100000:2.0:1782759417.229199:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232833792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.229592:0:140595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140595:1869355232833920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.229637:0:140595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759417.229790:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232833920 00000100:00100000:3.0:1782759417.229797:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232833920 00000100:00100000:1.0:1782759417.229807:0:140595:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec3932840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.229882:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:3.0:1782759417.229890:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:140595:x1869355232833920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759417.229991:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:140595:x1869355232833920:12345-0@lo:502:llog_process_th.0 Request processed in 100us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.229998:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:1.0:1782759417.230841:0:140595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140595:1869355232833920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.230894:0:140595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140595:1869355232834048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.230937:0:140595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.230966:0:140595:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded2ab2300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.230989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834048 00000100:00100000:0.0:1782759417.230995:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834048 00000100:00100000:0.0:1782759417.231032:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:0.0:1782759417.231040:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:140595:x1869355232834048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.231129:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:140595:x1869355232834048:12345-0@lo:502:llog_process_th.0 Request processed in 89us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.231136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:1.0:1782759417.231169:0:140595:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140595:1869355232834048:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759417.231196:0:140595:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1782759417.231291:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1782759417.231328:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759417.231339:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.231370:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.231381:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782759417.231383:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1782759417.231386:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782759417.231409:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.231417:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.231432:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.231446:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.231485:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.231553:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec39583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.231952:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834176 00000100:00100000:3.0:1782759417.231958:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834176 00000100:00100000:3.0:1782759417.231995:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:3.0:1782759417.232002:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232834176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759417.232011:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759417.232029:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0b0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.232050:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.232061:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.232069:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5800, rc 0) 00000100:00100000:3.0:1782759417.232161:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232834176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.232168:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:2.0:1782759417.232487:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.232500:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.232510:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.232563:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.232611:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.232686:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec39583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.232828:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834304 00000100:00100000:3.0:1782759417.232834:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834304 00000100:00100000:3.0:1782759417.232906:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:3.0:1782759417.232914:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232834304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.233029:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232834304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.233035:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:2.0:1782759417.233068:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.233096:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.233136:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.233462:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec39583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.233537:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834432 00000100:00100000:0.0:1782759417.233543:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834432 00000100:00100000:0.0:1782759417.233566:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2988 00000100:00100000:0.0:1782759417.233574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232834432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.233697:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232834432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.233704:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2988 00000100:00100000:2.0:1782759417.233799:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759417.234932:0:140596:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1782759417.235541:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1782759417.235562:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782759417.235574:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.235610:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.235619:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759417.235622:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 52 10000000:01000000:2.0:1782759417.235625:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759417.235656:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.235665:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.235675:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.235696:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.235747:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.235826:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.236150:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834560 00000100:00100000:1.0:1782759417.236155:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834560 00000100:00100000:1.0:1782759417.236187:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2989 00000100:00100000:1.0:1782759417.236193:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232834560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759417.236204:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759417.236214:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0be expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.236230:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.236245:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.236251:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429400, rc 0) 00000100:00100000:1.0:1782759417.236382:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232834560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.236389:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2989 00000100:00100000:2.0:1782759417.236455:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.236466:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.236519:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.236561:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.236704:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.236865:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.236939:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834688 00000100:00100000:3.0:1782759417.236945:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834688 00000100:00100000:3.0:1782759417.236983:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:3.0:1782759417.236991:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232834688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.237113:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232834688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.237120:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:2.0:1782759417.237202:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.237221:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.237251:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.237291:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.237317:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834816 00000100:00100000:1.0:1782759417.237320:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834816 00000100:00100000:1.0:1782759417.237376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:1.0:1782759417.237382:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232834816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.237458:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232834816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.237465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:2.0:1782759417.237528:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232834816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.238285:0:140597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140597:1869355232834944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.238312:0:140597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.238332:0:140597:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb66d480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.238368:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232834944 00000100:00100000:3.0:1782759417.238379:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232834944 00000100:00100000:3.0:1782759417.238406:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:3.0:1782759417.238412:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:140597:x1869355232834944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759417.238493:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:140597:x1869355232834944:12345-0@lo:502:llog_process_th.0 Request processed in 80us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.238500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:1.0:1782759417.238543:0:140597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140597:1869355232834944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.238599:0:140597:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140597:1869355232835072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.238632:0:140597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.238657:0:140597:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.238704:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835072 00000100:00100000:0.0:1782759417.238709:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835072 00000100:00100000:0.0:1782759417.238748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:0.0:1782759417.238755:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:140597:x1869355232835072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.238930:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:140597:x1869355232835072:12345-0@lo:502:llog_process_th.0 Request processed in 176us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.238935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:1.0:1782759417.238982:0:140597:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140597:1869355232835072:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759417.238996:0:140597:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1782759417.239077:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1782759417.239097:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759417.239106:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.239116:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.239125:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759417.239127:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1782759417.239130:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759417.239168:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.239177:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.239186:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.239198:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.239226:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.239251:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec39583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.239273:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835200 00000100:00100000:3.0:1782759417.239279:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835200 00000100:00100000:3.0:1782759417.239313:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2994 00000100:00100000:3.0:1782759417.239322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232835200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759417.239330:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759417.239342:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0cc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.239375:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.239385:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.239393:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759417.239424:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232835200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.239430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2994 00000100:00100000:2.0:1782759417.239470:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.239483:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.239503:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.239547:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.239573:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.239645:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec39583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.239656:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835328 00000100:00100000:0.0:1782759417.239662:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835328 00000100:00100000:0.0:1782759417.239685:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2995 00000100:00100000:0.0:1782759417.239692:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232835328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.239798:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232835328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.239805:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2995 00000100:00100000:2.0:1782759417.239925:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.239950:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.239990:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.240013:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec39583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.240034:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835456 00000100:00100000:3.0:1782759417.240039:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835456 00000100:00100000:3.0:1782759417.240069:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:3.0:1782759417.240076:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232835456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.240170:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232835456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.240176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:2.0:1782759417.240205:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759417.241074:0:140598:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1782759417.241154:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1782759417.241177:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782759417.241185:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.241195:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.241204:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759417.241206:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 52 10000000:01000000:2.0:1782759417.241209:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759417.241229:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.241237:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.241246:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.241262:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.241294:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.241328:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.241347:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835584 00000100:00100000:0.0:1782759417.241353:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835584 00000100:00100000:0.0:1782759417.241394:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:0.0:1782759417.241401:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232835584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759417.241409:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759417.241421:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0da expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.241438:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.241447:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.241467:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd600, rc 0) 00000100:00100000:0.0:1782759417.241503:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232835584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.241510:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:2.0:1782759417.241532:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.241542:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.241549:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.241625:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.241650:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.241686:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.241727:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835712 00000100:00100000:3.0:1782759417.241732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835712 00000100:00100000:3.0:1782759417.241767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:3.0:1782759417.241777:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232835712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.241865:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232835712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.241872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:2.0:1782759417.241902:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.241927:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.241972:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.241989:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.242007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835840 00000100:00100000:0.0:1782759417.242013:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835840 00000100:00100000:0.0:1782759417.242039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:0.0:1782759417.242046:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232835840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.242117:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232835840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.242123:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:2.0:1782759417.242153:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232835840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.242482:0:140599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140599:1869355232835968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.242516:0:140599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.242534:0:140599:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.242562:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232835968 00000100:00100000:3.0:1782759417.242568:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232835968 00000100:00100000:3.0:1782759417.242615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3000 00000100:00100000:3.0:1782759417.242623:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:140599:x1869355232835968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759417.242710:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:140599:x1869355232835968:12345-0@lo:502:llog_process_th.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.242717:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3000 00000100:00100000:0.0:1782759417.242736:0:140599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140599:1869355232835968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.242779:0:140599:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140599:1869355232836096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.242811:0:140599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.242834:0:140599:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec11ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.242848:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836096 00000100:00100000:1.0:1782759417.242859:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836096 00000100:00100000:1.0:1782759417.242887:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3001 00000100:00100000:1.0:1782759417.242896:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:140599:x1869355232836096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.242975:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:140599:x1869355232836096:12345-0@lo:502:llog_process_th.0 Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.242984:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3001 00000100:00100000:0.0:1782759417.242986:0:140599:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140599:1869355232836096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759417.243011:0:140599:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1782759417.243077:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1782759417.243098:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759417.243106:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.243114:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.243122:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1782759417.243124:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1782759417.243126:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782759417.243143:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.243152:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.243159:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.243177:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.243201:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.243224:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.243250:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836224 00000100:00100000:3.0:1782759417.243255:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836224 00000100:00100000:3.0:1782759417.243281:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:3.0:1782759417.243293:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232836224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759417.243308:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759417.243315:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0e8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.243328:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.243343:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.243350:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5a00, rc 0) 00000100:00100000:3.0:1782759417.243394:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232836224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.243400:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00100000:2.0:1782759417.243430:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.243439:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.243445:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.243481:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.243505:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.243521:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.243544:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836352 00000100:00100000:1.0:1782759417.243549:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836352 00000100:00100000:1.0:1782759417.243598:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:1.0:1782759417.243606:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232836352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.243691:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232836352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.243699:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00000100:00100000:2.0:1782759417.243705:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.243727:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.243752:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.243771:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.243793:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836480 00000100:00100000:3.0:1782759417.243798:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836480 00000100:00100000:3.0:1782759417.243831:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:3.0:1782759417.243837:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232836480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.243911:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232836480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.243916:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00100000:2.0:1782759417.243977:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.244212:0:140600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140600:1869355232836608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.244249:0:140600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.244271:0:140600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec11ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.244305:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836608 00000100:00100000:1.0:1782759417.244308:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836608 00000100:00100000:1.0:1782759417.244329:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:1.0:1782759417.244339:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:140600:x1869355232836608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.244458:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:140600:x1869355232836608:12345-0@lo:502:llog_process_th.0 Request processed in 114us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.244465:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00100000:0.0:1782759417.244522:0:140600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140600:1869355232836608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759417.244543:0:140600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759417.244552:0:140600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759417.244555:0:140600:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m new lustre.pool64c 00000020:00000080:0.0:1782759417.244560:0:140600:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1782759417.244638:0:140600:0:(lod_pool.c:475:lod_pool_new()) pool64c is pool #1 00000100:00100000:0.0:1782759417.244658:0:140600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140600:1869355232836736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.244690:0:140600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.244715:0:140600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec657be40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.244913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836736 00000100:00100000:3.0:1782759417.244917:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836736 00000100:00100000:3.0:1782759417.244940:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:3.0:1782759417.244946:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:140600:x1869355232836736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759417.245013:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:140600:x1869355232836736:12345-0@lo:502:llog_process_th.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.245019:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1782759417.245022:0:140600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140600:1869355232836736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.245049:0:140600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140600:1869355232836864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.245078:0:140600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.245093:0:140600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec11ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.245106:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836864 00000100:00100000:1.0:1782759417.245110:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836864 00000100:00100000:1.0:1782759417.245132:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:1.0:1782759417.245138:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:140600:x1869355232836864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.245195:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:140600:x1869355232836864:12345-0@lo:502:llog_process_th.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.245203:0:140600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140600:1869355232836864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.245209:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000020:01000000:0.0:1782759417.245219:0:140600:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759417.245223:0:140600:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759417.245225:0:140600:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m new lustre.pool64c 00000040:00080000:0.0:1782759417.245228:0:140600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1782759417.245299:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1782759417.245319:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782759417.245327:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.245336:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.245352:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759417.245354:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 52 10000000:01000000:2.0:1782759417.245356:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759417.245382:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.245387:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.245392:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.245401:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.245428:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.245447:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.245474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232836992 00000100:00100000:3.0:1782759417.245479:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232836992 00000100:00100000:3.0:1782759417.245502:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1782759417.245512:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232836992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759417.245527:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759417.245538:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c0f6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.245556:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.245564:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759417.245571:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:3.0:1782759417.245631:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232836992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.245638:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:2.0:1782759417.245654:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232836992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.245668:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.245678:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.245725:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.245744:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.245764:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.245774:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837120 00000100:00100000:1.0:1782759417.245778:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837120 00000100:00100000:1.0:1782759417.245806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:1.0:1782759417.245812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232837120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.245902:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232837120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.245909:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:2.0:1782759417.245916:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.245938:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.245977:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.245998:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.246026:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837248 00000100:00100000:3.0:1782759417.246031:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837248 00000100:00100000:3.0:1782759417.246057:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1782759417.246063:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232837248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.246133:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232837248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.246140:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:2.0:1782759417.246158:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.246468:0:140601:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140601:1869355232837376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.246502:0:140601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.246527:0:140601:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec11ca000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.246567:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837376 00000100:00100000:1.0:1782759417.246570:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837376 00000100:00100000:1.0:1782759417.246630:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3011 00000100:00100000:1.0:1782759417.246637:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:140601:x1869355232837376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.246702:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:140601:x1869355232837376:12345-0@lo:502:llog_process_th.0 Request processed in 65us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.246709:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3011 00000100:00100000:0.0:1782759417.246785:0:140601:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140601:1869355232837376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.246823:0:140601:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140601:1869355232837504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.246853:0:140601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.246883:0:140601:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759417.247075:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837504 00000100:00100000:3.0:1782759417.247079:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837504 00000100:00100000:3.0:1782759417.247109:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:3.0:1782759417.247115:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:140601:x1869355232837504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759417.247184:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:140601:x1869355232837504:12345-0@lo:502:llog_process_th.0 Request processed in 69us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.247198:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1782759417.247295:0:140601:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140601:1869355232837504:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1782759417.247316:0:140601:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1782759417.247459:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1782759417.247478:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759417.247484:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.247494:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.247503:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782759417.247505:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:2.0:1782759417.247507:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759417.247526:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.247534:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.247541:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.247554:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.247658:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.247683:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.247701:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837632 00000100:00100000:1.0:1782759417.247707:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837632 00000100:00100000:1.0:1782759417.247736:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:1.0:1782759417.247744:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232837632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759417.247751:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759417.247762:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c104 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.247780:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.247792:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.247797:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429600, rc 0) 00000100:00100000:1.0:1782759417.247986:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232837632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.247993:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.247995:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00010000:00010000:2.0:1782759417.248012:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.248028:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.248069:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.248093:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.248113:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.248132:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837760 00000100:00100000:0.0:1782759417.248136:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837760 00000100:00100000:0.0:1782759417.248161:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:0.0:1782759417.248166:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232837760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.248238:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232837760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.248243:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00000100:00100000:2.0:1782759417.248261:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.248286:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.248318:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.248341:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759417.248399:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232837888 00000100:00100000:1.0:1782759417.248403:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232837888 00000100:00100000:1.0:1782759417.248505:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:1.0:1782759417.248514:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232837888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.248608:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232837888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.248616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:2.0:1782759417.248701:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232837888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759417.249060:0:140602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140602:1869355232838016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.249093:0:140602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.249116:0:140602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.249122:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838016 00000100:00100000:0.0:1782759417.249126:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838016 00000100:00100000:0.0:1782759417.249148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3016 00000100:00100000:0.0:1782759417.249152:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:140602:x1869355232838016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.249212:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:140602:x1869355232838016:12345-0@lo:502:llog_process_th.0 Request processed in 59us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.249217:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3016 00000100:00100000:1.0:1782759417.249247:0:140602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140602:1869355232838016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759417.249271:0:140602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759417.249280:0:140602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759417.249282:0:140602:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool64c 00000020:00000080:1.0:1782759417.249288:0:140602:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1782759417.249342:0:140602:0:(lod_pool.c:475:lod_pool_new()) pool64c is pool #1 00080000:10000000:1.0:1782759417.250143:0:140602:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00080000:10000000:1.0:1782759417.252057:0:140602:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/32) registered 00080000:10000000:1.0:1782759417.253215:0:140602:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/32) registered 00000100:00100000:1.0:1782759417.255797:0:140602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140602:1869355232838144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.255879:0:140602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.255958:0:140602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec3932840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.256043:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838144 00000100:00100000:0.0:1782759417.256050:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838144 00000100:00100000:0.0:1782759417.256098:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1782759417.256107:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:140602:x1869355232838144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.256224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:140602:x1869355232838144:12345-0@lo:502:llog_process_th.0 Request processed in 117us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.256233:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:1.0:1782759417.256257:0:140602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140602:1869355232838144:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.256300:0:140602:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140602:1869355232838272:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759417.256325:0:140602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.256339:0:140602:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb66d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.256357:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838272 00000100:00100000:0.0:1782759417.256372:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838272 00000100:00100000:0.0:1782759417.256403:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:0.0:1782759417.256411:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:140602:x1869355232838272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759417.256482:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:140602:x1869355232838272:12345-0@lo:502:llog_process_th.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.256496:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:1.0:1782759417.256513:0:140602:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140602:1869355232838272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759417.256538:0:140602:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759417.256545:0:140602:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759417.256547:0:140602:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool64c 00000040:00080000:1.0:1782759417.256551:0:140602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:2.0:1782759417.256647:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:2.0:1782759417.256673:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782759417.256684:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.256696:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759417.256706:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782759417.256709:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759417.256712:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782759417.256733:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.256741:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.256756:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.256771:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232838400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.256798:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.256821:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.256867:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838400 00000100:00100000:0.0:1782759417.256871:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838400 00000100:00100000:0.0:1782759417.256904:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:0.0:1782759417.256911:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232838400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759417.256919:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759417.256930:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c112 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.256950:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.256960:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.256969:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc600, rc 0) 00000100:00100000:0.0:1782759417.257007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232838400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.257013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:2.0:1782759417.257042:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232838400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759417.257056:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.257070:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759417.257117:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232838528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759417.257140:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759417.257156:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759417.257175:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838528 00000100:00100000:0.0:1782759417.257180:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838528 00000100:00100000:0.0:1782759417.257345:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:0.0:1782759417.257353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232838528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.257432:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232838528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759417.257439:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00100000:2.0:1782759417.257511:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232838528:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1782759417.257533:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782759417.257538:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759417.257545:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759417.738838:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759417.738924:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.738939:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232838784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.738998:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232839168:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.738999:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.739030:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232839296:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.739041:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.739063:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232839680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.739071:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.739095:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.739100:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232839808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.739116:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232840192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.739132:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.739159:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232840320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.739160:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.739185:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759417.739192:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.739195:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232839040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.739263:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839680 00000100:00100000:3.0:1782759417.739271:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839680 00000100:00100000:2.0:1782759417.739276:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839808 00000100:00100000:2.0:1782759417.739282:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839808 00000100:00100000:2.0:1782759417.739329:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232840192 00000100:00100000:2.0:1782759417.739332:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232840192 00000100:00100000:3.0:1782759417.739606:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232840320 00000100:00100000:3.0:1782759417.739611:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232840320 00000100:00100000:3.0:1782759417.739634:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:3.0:1782759417.739642:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232839808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759417.739672:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:2.0:1782759417.739682:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232839680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.739951:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759417.739959:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232838912:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740023:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759417.740045:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232839552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.740077:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232839808:12345-0@lo:400:kworker.0 Request processed in 434us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.740088:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000100:00100000:1.0:1782759417.740090:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759417.740113:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:1.0:1782759417.740115:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232840064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.740125:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232840192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740164:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759417.740169:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232840192:12345-0@lo:400:kworker.0 Request processed in 46us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.740176:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:3.0:1782759417.740194:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:3.0:1782759417.740202:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232840320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740204:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232840192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740253:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838656 00000100:00100000:1.0:1782759417.740256:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838656 00000100:00100000:1.0:1782759417.740286:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:1.0:1782759417.740293:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232838656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759417.740313:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759417.740350:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232838656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.740370:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:1.0:1782759417.740390:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839296 00000100:00100000:1.0:1782759417.740394:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839296 00000100:00100000:1.0:1782759417.740428:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839040 00000100:00100000:1.0:1782759417.740431:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839040 00000100:00100000:1.0:1782759417.740444:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1782759417.740449:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232839296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740488:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232839296:12345-0@lo:400:kworker.0 Request processed in 39us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.740494:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:1.0:1782759417.740504:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:1.0:1782759417.740510:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232839040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740532:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232839040:12345-0@lo:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.740537:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00100000:1.0:1782759417.740562:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839168 00000100:00100000:1.0:1782759417.740566:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839168 00000100:00100000:1.0:1782759417.740606:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839552 00000100:00100000:1.0:1782759417.740609:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839552 00000100:00100000:1.0:1782759417.740632:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232840064 00000100:00100000:1.0:1782759417.740635:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232840064 00000100:00100000:3.0:1782759417.740647:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232840320:12345-0@lo:400:kworker.0 Request processed in 443us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.740657:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00100000:1.0:1782759417.740658:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4900 00000100:00100000:1.0:1782759417.740667:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232839168:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759417.740686:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759417.740692:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759417.740695:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759417.740702:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232839168:12345-0@lo:400:kworker.0 Request processed in 35us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.740709:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4901 00000100:00100000:3.0:1782759417.740718:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232839552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.740752:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232839552:12345-0@lo:400:kworker.0 Request processed in 35us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.740789:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4900 00000100:00100000:3.0:1782759417.740796:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4901 00000100:00100000:1.0:1782759417.740806:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4902 00000100:00100000:1.0:1782759417.740815:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232840064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.740829:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838784 00000100:00100000:3.0:1782759417.740835:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838784 00000100:00100000:1.0:1782759417.740847:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232840064:12345-0@lo:400:kworker.0 Request processed in 34us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.740853:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4902 00000100:00100000:3.0:1782759417.740870:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3021 00000100:00100000:3.0:1782759417.740880:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232838784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740891:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232839040:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740905:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232839552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.740919:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232840064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.740929:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232838784:12345-0@lo:400:kworker.0 Request processed in 50us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.740934:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232839168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.740938:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3021 00000100:00100000:1.0:1782759417.740970:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232838656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759417.741269:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759417.741306:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232839424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759417.741313:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232839680:12345-0@lo:400:kworker.0 Request processed in 1632us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.741320:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:3.0:1782759417.741327:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232838912 00000100:00100000:3.0:1782759417.741334:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232838912 00000100:00100000:0.0:1782759417.741340:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759417.741384:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839424 00000100:00100000:1.0:1782759417.741384:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232839680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.741386:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232839936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.741390:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839424 00000100:00100000:2.0:1782759417.741403:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4903 00000100:00100000:2.0:1782759417.741413:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232838912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.741423:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759417.741432:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759417.741452:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232839936 00000100:00100000:1.0:1782759417.741456:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232839936 00000100:00100000:0.0:1782759417.741466:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232838784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759417.741467:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232838912:12345-0@lo:400:kworker.0 Request processed in 55us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759417.741480:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4903 00000100:00100000:0.0:1782759417.741489:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232839296:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.741506:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232839808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.741516:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232840320:0@lo:400:kworker.0 00000100:00100000:0.0:1782759417.741549:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232838912:0@lo:400:kworker.0 00000100:00080000:2.0:1782759417.741567:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759417.741571:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4904 00000100:00100000:1.0:1782759417.741593:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232839936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.741630:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232839936:12345-0@lo:400:kworker.0 Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.741638:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4904 00000100:00100000:0.0:1782759417.741653:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232839936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.741656:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4905 00000100:00100000:1.0:1782759417.741669:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232839424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759417.741708:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232839424:12345-0@lo:400:kworker.0 Request processed in 42us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.741713:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4905 00000100:00100000:0.0:1782759417.741744:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232839424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759417.756741:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759417.756865:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465152 00000100:00100000:0.0:1782759417.756875:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465152 00000100:00100000:0.0:1782759417.756928:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3022 00000100:00100000:0.0:1782759417.756938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218465152:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759417.756957:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759417.756975:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27250 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.757005:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.757015:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759417.757024:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd200, rc 0) 00000100:00100000:0.0:1782759417.757088:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218465152:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.757096:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3022 00000100:00100000:0.0:1782759417.761154:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759417.761330:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465280 00000100:00100000:3.0:1782759417.761342:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465280 00000100:00100000:3.0:1782759417.761403:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3023 00000100:00100000:3.0:1782759417.761424:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218465280:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759417.761622:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218465280:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 199us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759417.761630:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3023 00000100:00100000:2.0:1782759417.763894:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759417.763998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465408 00000100:00100000:0.0:1782759417.764008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465408 00000100:00100000:0.0:1782759417.764104:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3024 00000100:00100000:0.0:1782759417.764115:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218465408:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.764257:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218465408:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.764265:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3024 00000100:00100000:0.0:1782759417.768789:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759417.771065:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465536 00000100:00100000:1.0:1782759417.771077:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465536 00000100:00100000:1.0:1782759417.771133:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3025 00000100:00100000:1.0:1782759417.771140:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104243:x1869355218465536:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759417.771293:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104243:x1869355218465536:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 151us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.771301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3025 00000100:00100000:2.0:1782759417.773694:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759417.773788:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465664 00000100:00100000:0.0:1782759417.773795:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465664 00000100:00100000:0.0:1782759417.773832:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3026 00000100:00100000:0.0:1782759417.773838:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104243:x1869355218465664:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759417.773952:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104243:x1869355218465664:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 112us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759417.773959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3026 00000100:00100000:2.0:1782759417.776439:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759417.779471:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465792 00000100:00100000:1.0:1782759417.779487:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465792 00000100:00100000:1.0:1782759417.779665:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3027 00000100:00100000:1.0:1782759417.779690:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218465792:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759417.779708:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759417.779726:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27257 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.779768:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.779793:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759417.779802:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759417.779874:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218465792:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 200us (3445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759417.779881:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3027 00000100:00100000:3.0:1782759417.782766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759417.782839:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218465920 00000100:00100000:0.0:1782759417.782850:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218465920 00000100:00100000:0.0:1782759417.782911:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3028 00000100:00100000:0.0:1782759417.782921:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218465920:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759417.783046:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218465920:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 125us (289us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759417.783054:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3028 00010000:00010000:3.0:1782759418.187384:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759418.250900:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232840448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759418.250976:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.251027:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232840448 00000100:00100000:1.0:1782759418.251036:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232840448 00000100:00100000:1.0:1782759418.251103:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1782759418.251113:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232840448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759418.251136:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759418.251183:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232840448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759418.251190:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:3.0:1782759418.251243:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232840448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759418.762791:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759418.762813:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232840576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759418.762879:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.762924:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232840576 00000100:00100000:1.0:1782759418.762934:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232840576 00000100:00100000:1.0:1782759418.763004:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:1.0:1782759418.763015:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232840576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759418.763047:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:1.0:1782759418.763115:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232840576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759418.763123:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:2.0:1782759418.763145:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232840576:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1782759418.944086:0:140699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffed6eb7ad0 20000000:00000080:1.0:1782759418.944103:0:140699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8cddc4ab0400 uarg=0000000000000000 00000040:00100000:1.0:1782759418.944784:0:140699:0:(llog.c:1067:llog_reverse_process()) index 54 : idx 49 20000000:01000000:1.0:1782759418.944797:0:140699:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool64c 00000040:00080000:1.0:1782759418.944886:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17728 20000000:01000000:1.0:1782759418.944918:0:140699:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1782759418.944936:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 128 off17856 00000040:00080000:1.0:1782759418.944955:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18080 00000040:00080000:1.0:1782759418.945017:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:1.0:1782759418.945028:0:140699:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1782759418.945045:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 136 off16968 00000040:00080000:1.0:1782759418.945065:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17192 00000040:00080000:1.0:1782759418.945122:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:1.0:1782759418.945133:0:140699:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1782759418.945147:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 136 off16968 00000040:00080000:1.0:1782759418.945157:0:140699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17192 10000000:01000000:1.0:1782759418.945165:0:140699:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782759418.945180:0:140699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945194:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945199:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945203:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945207:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945211:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945222:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945226:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945230:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945234:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945240:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945244:0:140699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945248:0:140699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945276:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945285:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 9 pid: 6524 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.945296:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232840704:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759418.945393:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945404:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 9 pid: 6526 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.945410:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232840832:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759418.945431:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945439:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 23 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.945448:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232840960:0@lo:104: 00000100:00100000:1.0:1782759418.945486:0:140699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759418.945525:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.945534:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 23 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.945542:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841088:0@lo:104: 00000100:00100000:0.0:1782759418.945544:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232840960 00000100:00100000:0.0:1782759418.945553:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232840960 00000100:00100000:1.0:1782759418.945566:0:140699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.945636:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841088 00000100:00100000:0.0:1782759418.945640:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841088 00000100:00100000:0.0:1782759418.945662:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:0.0:1782759418.945671:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232840960:12345-0@lo:104: 00010000:00010000:0.0:1782759418.945683:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.945762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00010000:00010000:1.0:1782759418.945777:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.945785:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232841088:12345-0@lo:104: 00010000:00010000:1.0:1782759418.945792:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 23 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759418.945798:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.945804:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841216:0@lo:104: 00010000:00010000:0.0:1782759418.945882:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759418.945889:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232840960:12345-0@lo:104: Request processed in 219us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.945895:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00010000:00010000:0.0:1782759418.945927:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759418.945932:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.945939:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759418.945942:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.945949:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759418.945956:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759418.945961:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759418.945985:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.945992:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759418.946009:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.946016:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c119 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.946027:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.946029:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.946031:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759418.946044:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232841344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.946074:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.946118:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841344 00000100:00100000:2.0:1782759418.946124:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841344 00010000:00010000:2.0:1782759418.946146:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.946217:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1782759418.946225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232841344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759418.946244:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759418.946250:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946259:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946281:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759418.946315:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232841344:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.946321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1782759418.946394:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232841344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.946510:0:140699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759418.946601:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1782759418.946602:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.946611:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:140699:x1869355232841088:12345-0@lo:104: Request processed in 833us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759418.946626:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00010000:00010000:1.0:1782759418.946631:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 23 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.946643:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841216 00000100:00100000:1.0:1782759418.946643:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841472:0@lo:104: 00000100:00100000:3.0:1782759418.946648:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841216 00000100:00100000:1.0:1782759418.946674:0:140699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759418.946709:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759418.946715:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946722:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759418.946725:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946732:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.946739:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.946744:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.946768:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946780:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759418.946810:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946821:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c10b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.946835:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.946837:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.946839:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759418.946857:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759418.946872:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232841600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759418.946901:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.946932:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841600 00000100:00100000:2.0:1782759418.946935:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841600 00010000:00010000:2.0:1782759418.946950:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.946983:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1782759418.946990:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232841600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759418.947002:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759418.947007:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947020:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947033:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759418.947065:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232841600:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.947075:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1782759418.947110:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232841600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.947382:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.947393:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 23 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.947402:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841728:0@lo:104: 00000100:00100000:1.0:1782759418.947429:0:140699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.947452:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841472 00000100:00100000:0.0:1782759418.947457:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841472 00000100:00100000:2.0:1782759418.947479:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1782759418.947487:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:2.0:1782759418.947492:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232841216:12345-0@lo:104: 00000100:00100000:0.0:1782759418.947500:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232841472:12345-0@lo:104: 00010000:00010000:2.0:1782759418.947503:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.947510:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947552:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759418.947558:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232841216:12345-0@lo:104: Request processed in 71us (1048us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759418.947561:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759418.947567:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1782759418.947572:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232841472:12345-0@lo:104: Request processed in 73us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.947601:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00010000:00010000:2.0:1782759418.947627:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759418.947633:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947640:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759418.947642:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947649:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759418.947655:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759418.947660:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.947681:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947687:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759418.947692:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759418.947699:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.947707:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759418.947710:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947712:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.947720:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947724:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60c0f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0fd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759418.947731:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759418.947739:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759418.947740:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.947744:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759418.947747:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.947758:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.947773:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232841856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.947781:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759418.947798:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.947805:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759418.947812:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0ef expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.947824:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.947827:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.947831:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759418.947842:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232841984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759418.947849:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841856 00000100:00100000:2.0:1782759418.947853:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841856 00010000:00010000:2.0:1782759418.947870:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 24 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.947878:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759418.947907:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841984 00000100:00100000:2.0:1782759418.947910:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841984 00000100:00100000:0.0:1782759418.947919:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00010000:00010000:2.0:1782759418.947922:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 25 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.947932:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355232841856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.947942:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759418.947946:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00010000:00010000:0.0:1782759418.947950:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 25 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759418.947957:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+25:3662:x1869355232841984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.947964:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 25 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.947968:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759418.947976:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 25 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.947979:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759418.947988:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 25 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759418.948000:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.948013:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355232841856:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.948021:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:2.0:1782759418.948039:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232841984:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.948046:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1782759418.948057:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232841984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.948090:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232841856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.948332:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.948341:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 23 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948360:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842112:0@lo:104: 00000100:00100000:1.0:1782759418.948382:0:140699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759418.948445:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.948454:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 23 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948462:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842240:0@lo:104: 00010000:00010000:1.0:1782759418.948497:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.948505:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 23 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948512:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842368:0@lo:104: 00010000:00010000:1.0:1782759418.948537:0:140699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.948544:0:140699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 23 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948551:0:140699:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842496:0@lo:104: 00000100:00100000:1.0:1782759418.948568:0:140699:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c323c0 going to sleep for 11 seconds 00010000:00010000:1.0:1782759418.948600:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c112 expref: 23 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948677:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232840960:0@lo:104: 00010000:00010000:1.0:1782759418.948692:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c10b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c104 expref: 22 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948700:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841088:0@lo:104: 00010000:00010000:1.0:1782759418.948709:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c0fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0f6 expref: 21 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948717:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841216:0@lo:104: 00010000:00010000:1.0:1782759418.948726:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c0ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0e8 expref: 20 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.948745:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841472:0@lo:104: 00000100:00100000:0.0:1782759418.948820:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759418.948837:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.948863:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.948872:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759418.948878:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232841728 00000100:00100000:0.0:1782759418.948882:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232841728 00000100:00100000:0.0:1782759418.948903:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842112 00000100:00100000:0.0:1782759418.948906:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842112 00000100:00100000:0.0:1782759418.948916:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842240 00000100:00100000:0.0:1782759418.948919:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842240 00000100:00100000:0.0:1782759418.948931:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842368 00000100:00100000:0.0:1782759418.948933:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842368 00000100:00100000:0.0:1782759418.948943:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842496 00000100:00100000:0.0:1782759418.948945:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842496 00000100:00100000:0.0:1782759418.948956:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1782759418.948964:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+7:140699:x1869355232841728:12345-0@lo:104: 00010000:00010000:0.0:1782759418.948973:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.949017:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759418.949024:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+7:140699:x1869355232841728:12345-0@lo:104: Request processed in 60us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759418.949030:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1782759418.949041:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4790c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+7:140699:x1869355232842112:12345-0@lo:104: 00010000:00010000:3.0:1782759418.949049:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759418.949090:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759418.949095:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4790c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+7:140699:x1869355232842112:12345-0@lo:104: Request processed in 58us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759418.949101:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1782759418.950124:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1782759418.950150:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1782759418.950160:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+6:140699:x1869355232842240:12345-0@lo:104: 00010000:00010000:0.0:1782759418.950170:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950216:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782759418.950222:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+6:140699:x1869355232842240:12345-0@lo:104: Request processed in 66us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.950237:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:0.0:1782759418.950249:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1782759418.950255:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+5:140699:x1869355232842368:12345-0@lo:104: 00010000:00010000:0.0:1782759418.950262:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950286:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782759418.950291:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+5:140699:x1869355232842368:12345-0@lo:104: Request processed in 37us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.950297:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:0.0:1782759418.950308:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1782759418.950314:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232842496:12345-0@lo:104: 00010000:00010000:0.0:1782759418.950320:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950358:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1782759418.950364:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:140699:x1869355232842496:12345-0@lo:104: Request processed in 50us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.950370:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00010000:00010000:0.0:1782759418.950387:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782759418.950392:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950400:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759418.950403:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950421:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759418.950428:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759418.950434:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759418.950463:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950469:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759418.950486:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950494:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c0da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950506:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782759418.950510:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950515:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759418.950518:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950525:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759418.950531:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759418.950542:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759418.950555:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.950561:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759418.950572:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.950738:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232841728:0@lo:104: 00000100:00100000:1.0:1782759418.950749:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842112:0@lo:104: 00000100:00100000:1.0:1782759418.950756:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842240:0@lo:104: 00000100:00100000:1.0:1782759418.950763:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842368:0@lo:104: 00000100:00100000:1.0:1782759418.950770:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232842496:0@lo:104: 00000100:00100000:1.0:1782759418.950798:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759418.950809:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232842624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.950841:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759418.950878:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782759418.950882:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950889:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759418.950892:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950899:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.950905:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759418.950910:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759418.950926:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950941:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759418.950948:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950955:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60c0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0c5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950965:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782759418.950968:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950973:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759418.950976:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.950983:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.950988:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759418.950993:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759418.951006:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951012:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759418.951022:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951029:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c0b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0b7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951044:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759418.951047:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951053:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759418.951056:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951062:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759418.951067:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759418.951072:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782759418.951087:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951092:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759418.951097:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951103:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c0a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0a9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951112:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759418.951113:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759418.951115:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759418.951123:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232843136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.951152:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.951183:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759418.951189:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232843008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.951213:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.951247:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232842752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.951282:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.951301:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759418.951307:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232842880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.951327:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759418.951372:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842624 00000100:00100000:1.0:1782759418.951377:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842624 00010000:00010000:1.0:1782759418.951399:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 20 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.951420:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843136 00000100:00100000:1.0:1782759418.951423:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843136 00010000:00010000:1.0:1782759418.951434:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 21 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.951444:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843008 00000100:00100000:1.0:1782759418.951446:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843008 00010000:00010000:1.0:1782759418.951455:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 22 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.951464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842752 00000100:00100000:1.0:1782759418.951466:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842752 00010000:00010000:1.0:1782759418.951475:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 23 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.951485:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232842880 00000100:00100000:1.0:1782759418.951493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232842880 00010000:00010000:1.0:1782759418.951514:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.951526:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1782759418.951533:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232842624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.951544:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759418.951549:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951558:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951571:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0da expref: 24 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.951601:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759418.951701:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60c0cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c0d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951714:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.951716:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759418.951718:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759418.951730:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1782759418.951736:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232843136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.951745:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.951749:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 23 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951757:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 23 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951767:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c0a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0a2 expref: 23 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951775:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.951805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+22:3663:x1869355232843136:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.951820:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1782759418.951835:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1782759418.951840:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+21:3663:x1869355232843008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.951849:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.951853:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 21 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951861:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 21 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951870:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5800/0xd5b45c7f5c60c0b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0b0 expref: 21 pid: 6526 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951878:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.951899:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+20:3663:x1869355232843008:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.951905:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1782759418.951917:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1782759418.951923:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+19:3664:x1869355232842752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.951930:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.951934:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 19 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951942:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 19 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951951:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c0d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0cc expref: 19 pid: 6525 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.951970:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.951997:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+18:3664:x1869355232842752:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.952002:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1782759418.952014:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1782759418.952020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+17:3664:x1869355232842880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.952027:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.952032:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 17 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.952039:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 17 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.952049:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c0c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c0be expref: 17 pid: 6524 timeout: 3609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.952056:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.952077:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+16:3664:x1869355232842880:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.952083:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1782759418.952111:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232842880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.952119:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232842752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.952146:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232843008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759418.952152:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232843136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759418.952259:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+15:3662:x1869355232842624:12345-0@lo:103:ldlm_bl.0 Request processed in 726us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759418.952265:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:1.0:1782759418.952310:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232842624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.952381:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759418.952471:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759418.952543:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759418.952560:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466176 00000100:00100000:1.0:1782759418.952564:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466176 00000100:00100000:0.0:1782759418.952790:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466048 00000100:00100000:0.0:1782759418.952798:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466048 00010000:00010000:0.0:1782759418.952811:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 11 pid: 6524 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759418.952828:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 740 00000100:00100000:0.0:1782759418.952832:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+11:2402:x1869355218466048:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759418.952838:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759418.952841:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 11 pid: 6524 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.952847:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 11 pid: 6524 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759418.952855:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759418.952883:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+11:2402:x1869355218466048:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 50us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759418.952889:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 740 00010000:00010000:1.0:1782759418.952999:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 10 pid: 6526 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.953020:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 741 00000100:00100000:1.0:1782759418.953029:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218466176:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759418.953035:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759418.953037:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 10 pid: 6526 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953043:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 10 pid: 6526 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953054:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953061:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953074:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953081:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953087:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953094:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953100:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759418.953104:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953110:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953120:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953128:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759418.953143:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218466176:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 114us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759418.953147:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 741 00010000:00010000:1.0:1782759418.953175:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27257 expref: 9 pid: 6524 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.953182:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232840704:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759418.953188:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27250 expref: 8 pid: 6526 timeout: 3559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759418.953193:0:140699:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140699:1869355232840832:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759418.953235:0:140699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953240:0:140699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953244:0:140699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759418.953248:0:140699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c12e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759418.953869:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1782759419.102616:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759419.102654:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759419.102674:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759419.102678:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466688 00000100:00100000:3.0:1782759419.102689:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466688 00000100:00100000:2.0:1782759419.102710:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759419.102722:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466432 00000100:00100000:0.0:1782759419.102734:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466304 00000100:00080000:2.0:1782759419.102736:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759419.102739:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466304 00000100:00100000:1.0:1782759419.102742:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466432 00000100:00080000:2.0:1782759419.102761:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759419.102767:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759419.102774:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466560 00000100:00100000:3.0:1782759419.102780:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466560 00000100:00100000:1.0:1782759419.102801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4906 00000100:00100000:2.0:1782759419.102802:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1029 00000100:00100000:0.0:1782759419.102812:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4907 00000100:00100000:1.0:1782759419.102822:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218466432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759419.102823:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218466688:12345-192.168.202.31@tcp:9:kworker.0 00000100:00100000:0.0:1782759419.102823:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218466304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759419.102830:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2812 00000100:00100000:3.0:1782759419.102845:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218466560:12345-192.168.202.31@tcp:400:kworker.0 00000020:00000080:2.0:1782759419.102858:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60a6f5 00000100:00080000:2.0:1782759419.102870:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cdedb934000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1782759419.102907:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218466432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759419.102910:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218466560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759419.102910:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218466304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (228us total) trans 0 rc 0/0 00000001:00000004:2.0:1782759419.102914:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967403 00000100:00100000:1.0:1782759419.102926:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4906 00000100:00100000:3.0:1782759419.102929:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2812 00000100:00100000:0.0:1782759419.102940:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4907 00000100:00080000:3.0:1782759419.102992:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759419.103001:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759419.103051:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+2:2401:x1869355218466688:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 236us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759419.103057:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1029 00010000:00010000:0.0:1782759419.211447:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759419.274781:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232843392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759419.274781:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232843264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759419.274863:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759419.274921:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843264 00000100:00100000:3.0:1782759419.274928:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843264 00000100:00100000:0.0:1782759419.274954:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759419.275002:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843392 00000100:00100000:3.0:1782759419.275007:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1782759419.275008:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843392 00000100:00100000:3.0:1782759419.275019:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232843264:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759419.275043:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1782759419.275050:0:10361:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16 00000100:00100000:1.0:1782759419.275052:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232843392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759419.275055:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759419.275064:0:10361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_003' 00002000:00000024:1.0:1782759419.275072:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1782759419.275087:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759419.275149:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232843392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.275157:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1782759419.275191:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232843264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 175us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759419.275198:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:0.0:1782759419.275198:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232843392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759419.275240:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232843264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759419.428032:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759419.428103:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466816 00000100:00100000:1.0:1782759419.428114:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466816 00000100:00100000:1.0:1782759419.428167:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3029 00000100:00100000:1.0:1782759419.428178:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218466816:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759419.428195:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759419.428213:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2725e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.428242:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.428253:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759419.428274:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429600, rc 0) 00000100:00100000:1.0:1782759419.428329:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218466816:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 153us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.428336:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3029 00000100:00100000:1.0:1782759419.429311:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759419.429403:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218466944 00000100:00100000:0.0:1782759419.429413:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218466944 00000100:00100000:0.0:1782759419.429465:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3030 00000100:00100000:0.0:1782759419.429475:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218466944:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759419.429640:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218466944:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 167us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759419.429660:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3030 00000100:00100000:2.0:1782759419.430727:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759419.430781:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467072 00000100:00100000:1.0:1782759419.430788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467072 00000100:00100000:1.0:1782759419.430824:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3031 00000100:00100000:1.0:1782759419.430832:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218467072:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759419.430917:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218467072:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.430921:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3031 00000100:00100000:3.0:1782759419.433816:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759419.433913:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467200 00000100:00100000:0.0:1782759419.433921:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467200 00000100:00100000:0.0:1782759419.433976:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3032 00000100:00100000:0.0:1782759419.433987:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104283:x1869355218467200:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759419.434142:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104283:x1869355218467200:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 156us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759419.434150:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3032 00000100:00100000:2.0:1782759419.435974:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759419.436026:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467328 00000100:00100000:1.0:1782759419.436032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467328 00000100:00100000:1.0:1782759419.436069:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3033 00000100:00100000:1.0:1782759419.436075:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104283:x1869355218467328:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759419.436268:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:104283:x1869355218467328:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 191us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759419.436276:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3033 00000100:00100000:2.0:1782759419.437836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759419.437899:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467456 00000100:00100000:0.0:1782759419.437907:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467456 00000100:00100000:0.0:1782759419.437969:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3034 00000100:00100000:0.0:1782759419.437979:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218467456:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759419.437992:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759419.438008:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27265 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759419.438037:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759419.438065:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759419.438074:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dcc00, rc 0) 00000100:00100000:0.0:1782759419.438135:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218467456:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 157us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759419.438143:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3034 00000100:00100000:3.0:1782759419.439108:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759419.439167:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467584 00000100:00100000:1.0:1782759419.439174:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467584 00000100:00100000:1.0:1782759419.439210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3035 00000100:00100000:1.0:1782759419.439220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218467584:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759419.439332:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218467584:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 112us (227us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759419.439361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3035 00010000:00010000:1.0:1782759420.235194:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759420.490873:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759420.490880:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 55 10000000:01000000:2.0:1782759420.490885:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759420.490930:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.490952:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.490961:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.490982:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232843520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.491059:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.491125:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843520 00000100:00100000:2.0:1782759420.491126:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.491134:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843520 00000100:00100000:0.0:1782759420.491186:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:0.0:1782759420.491195:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355232843520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759420.491208:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759420.491222:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c143 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.491249:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.491260:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.491269:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759420.491309:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232843520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.491316:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00100000:2.0:1782759420.494457:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232843520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.494484:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.494498:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.494617:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232843648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.494673:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.494720:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.494810:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843648 00000100:00100000:1.0:1782759420.494816:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843648 00000100:00100000:1.0:1782759420.494868:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:1.0:1782759420.494877:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232843648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.495007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232843648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.495014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00100000:2.0:1782759420.495093:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232843648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.495121:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232843776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.495165:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.495184:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.495218:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843776 00000100:00100000:0.0:1782759420.495224:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843776 00000100:00100000:0.0:1782759420.495666:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:0.0:1782759420.495673:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232843776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.495759:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232843776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.495766:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:2.0:1782759420.495788:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232843776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.496170:0:140702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140702:1869355232843904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.496202:0:140702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.496271:0:140702:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.496326:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232843904 00000100:00100000:3.0:1782759420.496331:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232843904 00000100:00100000:3.0:1782759420.496505:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3039 00000100:00100000:3.0:1782759420.496513:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:140702:x1869355232843904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.496606:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:140702:x1869355232843904:12345-0@lo:502:llog_process_th.0 Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.496612:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3039 00000100:00100000:0.0:1782759420.496668:0:140702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140702:1869355232843904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.496700:0:140702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140702:1869355232844032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.496725:0:140702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.496857:0:140702:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.496908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844032 00000100:00100000:1.0:1782759420.496912:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844032 00000100:00100000:1.0:1782759420.496929:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3040 00000100:00100000:1.0:1782759420.496934:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:140702:x1869355232844032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.497026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:140702:x1869355232844032:12345-0@lo:502:llog_process_th.0 Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.497033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3040 00000100:00100000:0.0:1782759420.497116:0:140702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140702:1869355232844032:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759420.497134:0:140702:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1782759420.497293:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1782759420.497313:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759420.497322:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.497342:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759420.497352:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1782759420.497354:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1782759420.497357:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782759420.497392:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.497401:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.497410:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.497423:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.497456:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.497626:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.497758:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844160 00000100:00100000:2.0:1782759420.497767:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844160 00000100:00100000:3.0:1782759420.497820:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:3.0:1782759420.497828:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232844160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.497836:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759420.497847:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c151 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.497867:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.497882:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.497890:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759420.497923:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232844160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.497929:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00000100:00100000:1.0:1782759420.497991:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.498002:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.498011:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.498051:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.498073:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.498092:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.498131:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844288 00000100:00100000:3.0:1782759420.498134:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844288 00000100:00100000:3.0:1782759420.498158:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:3.0:1782759420.498163:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232844288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.498254:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232844288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.498261:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1782759420.498395:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.498419:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.498458:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.498473:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.498542:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844416 00000100:00100000:3.0:1782759420.498545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844416 00000100:00100000:3.0:1782759420.498569:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:3.0:1782759420.498574:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232844416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.498695:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232844416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.498702:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1782759420.498845:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759420.500018:0:140703:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1782759420.506743:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1782759420.506777:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782759420.506788:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.506801:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759420.506829:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759420.506832:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 55 10000000:01000000:1.0:1782759420.506834:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759420.506867:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.506875:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.506885:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.506908:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.506964:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.507030:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.507219:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844544 00000100:00100000:3.0:1782759420.507265:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844544 00000100:00100000:3.0:1782759420.507367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:3.0:1782759420.507376:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232844544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.507406:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759420.507417:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c15f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.507438:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.507448:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.507456:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:3.0:1782759420.507496:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232844544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.507503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:1.0:1782759420.507567:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.507602:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.507611:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759420.507659:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.507681:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.509744:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.509852:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844672 00000100:00100000:2.0:1782759420.509860:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844672 00000100:00100000:2.0:1782759420.509900:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3045 00000100:00100000:2.0:1782759420.509908:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232844672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.510057:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232844672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.510064:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3045 00000100:00100000:1.0:1782759420.512092:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.512150:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.512217:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.512315:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.512502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844800 00000100:00100000:3.0:1782759420.512510:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844800 00000100:00100000:3.0:1782759420.512548:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:3.0:1782759420.512555:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232844800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.512662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232844800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.512669:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:1.0:1782759420.512793:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232844800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.513139:0:140704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140704:1869355232844928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.513171:0:140704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.513197:0:140704:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f71900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.513240:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232844928 00000100:00100000:3.0:1782759420.513244:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232844928 00000100:00100000:3.0:1782759420.513298:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:3.0:1782759420.513304:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:140704:x1869355232844928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.513388:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:140704:x1869355232844928:12345-0@lo:502:llog_process_th.0 Request processed in 83us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.513402:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:0.0:1782759420.513455:0:140704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140704:1869355232844928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.513487:0:140704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140704:1869355232845056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.513512:0:140704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.513572:0:140704:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f71900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.513625:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845056 00000100:00100000:2.0:1782759420.513629:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845056 00000100:00100000:2.0:1782759420.513664:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:2.0:1782759420.513671:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:140704:x1869355232845056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.513742:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:140704:x1869355232845056:12345-0@lo:502:llog_process_th.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.513749:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:0.0:1782759420.513812:0:140704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140704:1869355232845056:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759420.513828:0:140704:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1782759420.513911:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1782759420.513932:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759420.513941:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.513951:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759420.513960:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759420.513962:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1782759420.513965:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759420.513984:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.514002:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.514011:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.514022:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.514043:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.514059:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.514070:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845184 00000100:00100000:2.0:1782759420.514073:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845184 00000100:00100000:2.0:1782759420.514086:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:2.0:1782759420.514091:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232845184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.514098:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759420.514109:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c16d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.514128:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.514137:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.514146:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759420.514167:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232845184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.514173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00100000:2.0:1782759420.514202:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.514212:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.514220:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759420.514255:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.514275:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.514284:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.514294:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845312 00000100:00100000:2.0:1782759420.514296:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845312 00000100:00100000:2.0:1782759420.514308:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3050 00000100:00100000:2.0:1782759420.514313:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232845312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.514407:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232845312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.514414:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3050 00000100:00100000:2.0:1782759420.514436:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.514455:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.514480:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.514491:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.514500:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845440 00000100:00100000:2.0:1782759420.514502:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845440 00000100:00100000:2.0:1782759420.514515:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3051 00000100:00100000:2.0:1782759420.514519:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232845440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759420.514572:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232845440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.514599:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3051 00000100:00100000:2.0:1782759420.514734:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759420.515379:0:140705:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1782759420.515473:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1782759420.515490:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759420.515497:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.515506:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759420.515515:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759420.515517:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 55 10000000:01000000:3.0:1782759420.515520:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759420.515540:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.515546:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.515551:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.515561:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.515845:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.515873:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.515949:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845568 00000100:00100000:2.0:1782759420.515953:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845568 00000100:00100000:2.0:1782759420.515988:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052 00000100:00100000:2.0:1782759420.515995:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232845568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.516005:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759420.516015:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c17b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.516032:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.516040:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.516048:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759420.516091:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232845568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.516099:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052 00000100:00100000:0.0:1782759420.516114:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759420.516128:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.516138:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759420.516187:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.516214:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.516234:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.516253:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845696 00000100:00100000:1.0:1782759420.516259:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845696 00000100:00100000:1.0:1782759420.516289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:1.0:1782759420.516297:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232845696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.516404:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232845696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.516410:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00100000:0.0:1782759420.516502:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.516525:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.516564:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.516653:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.516684:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845824 00000100:00100000:3.0:1782759420.516688:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845824 00000100:00100000:3.0:1782759420.516719:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:3.0:1782759420.516726:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232845824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.516806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232845824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.516819:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:0.0:1782759420.516833:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232845824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.517161:0:140706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140706:1869355232845952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.517192:0:140706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.517222:0:140706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f71840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.517267:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232845952 00000100:00100000:2.0:1782759420.517272:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232845952 00000100:00100000:2.0:1782759420.517301:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:2.0:1782759420.517308:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:140706:x1869355232845952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759420.517398:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:140706:x1869355232845952:12345-0@lo:502:llog_process_th.0 Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.517412:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:0.0:1782759420.517480:0:140706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140706:1869355232845952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.517514:0:140706:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140706:1869355232846080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.517544:0:140706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.517563:0:140706:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f71840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.517657:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846080 00000100:00100000:1.0:1782759420.517661:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846080 00000100:00100000:1.0:1782759420.517686:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3056 00000100:00100000:1.0:1782759420.517690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:140706:x1869355232846080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.517752:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:140706:x1869355232846080:12345-0@lo:502:llog_process_th.0 Request processed in 60us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.517758:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3056 00000100:00100000:0.0:1782759420.517885:0:140706:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140706:1869355232846080:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759420.517902:0:140706:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1782759420.518044:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1782759420.518063:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759420.518071:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.518079:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759420.518087:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1782759420.518090:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:3.0:1782759420.518092:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759420.518113:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.518120:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.518128:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.518139:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.518164:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.518190:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.518241:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846208 00000100:00100000:1.0:1782759420.518245:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846208 00000100:00100000:1.0:1782759420.518273:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3057 00000100:00100000:1.0:1782759420.518280:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232846208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.518287:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759420.518298:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c189 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.518316:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.518346:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.518355:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759420.518389:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232846208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.518395:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3057 00000100:00100000:3.0:1782759420.518494:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.518506:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.518525:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.518567:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.518636:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.518675:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.518701:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846336 00000100:00100000:1.0:1782759420.518703:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846336 00000100:00100000:1.0:1782759420.518742:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:1.0:1782759420.518746:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232846336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.518853:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232846336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.518858:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:3.0:1782759420.518889:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.518906:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.518928:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.518973:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.518997:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846464 00000100:00100000:0.0:1782759420.518999:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846464 00000100:00100000:0.0:1782759420.519013:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:0.0:1782759420.519017:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232846464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.519071:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232846464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.519075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00100000:3.0:1782759420.519121:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.519345:0:140707:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140707:1869355232846592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.519375:0:140707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.519396:0:140707:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.519439:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846592 00000100:00100000:0.0:1782759420.519443:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846592 00000100:00100000:0.0:1782759420.519460:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:0.0:1782759420.519465:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:140707:x1869355232846592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.519537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:140707:x1869355232846592:12345-0@lo:502:llog_process_th.0 Request processed in 71us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.519543:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00100000:3.0:1782759420.519717:0:140707:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140707:1869355232846592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759420.519733:0:140707:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759420.519741:0:140707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759420.519743:0:140707:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m add lustre.pool64c.lustre-OST0000_UUID 00000020:00000080:3.0:1782759420.519747:0:140707:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1782759420.519759:0:140707:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to pool64c as member 1 00000100:00100000:3.0:1782759420.519772:0:140707:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140707:1869355232846720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.519801:0:140707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.519826:0:140707:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.519860:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846720 00000100:00100000:0.0:1782759420.519863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846720 00000100:00100000:0.0:1782759420.519890:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:0.0:1782759420.519896:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:140707:x1869355232846720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.519968:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:140707:x1869355232846720:12345-0@lo:502:llog_process_th.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.519974:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:3.0:1782759420.520049:0:140707:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140707:1869355232846720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759420.520064:0:140707:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759420.520067:0:140707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759420.520068:0:140707:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:3.0:1782759420.520071:0:140707:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:0.0:1782759420.520163:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:0.0:1782759420.520176:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1782759420.520182:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.520188:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759420.520194:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782759420.520196:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 55 10000000:01000000:0.0:1782759420.520197:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782759420.520212:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.520217:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.520222:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759420.520230:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.520247:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.520263:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded2ab2300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.520301:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846848 00000100:00100000:2.0:1782759420.520305:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846848 00000100:00100000:2.0:1782759420.520342:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3062 00000100:00100000:2.0:1782759420.520348:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232846848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759420.520355:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759420.520364:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c197 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.520378:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.520386:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759420.520394:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759420.520426:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232846848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759420.520430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3062 00000100:00100000:0.0:1782759420.520464:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759420.520489:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.520505:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759420.520543:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.520569:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759420.520608:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232846976 00000100:00100000:2.0:1782759420.520612:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232846976 00000100:00100000:0.0:1782759420.520625:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded2ab2300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.520650:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3063 00000100:00100000:3.0:1782759420.520659:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232846976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.520729:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232846976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.520738:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3063 00000100:00100000:0.0:1782759420.520740:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232846976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.520763:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.520860:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.520876:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded2ab2300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.520899:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847104 00000100:00100000:1.0:1782759420.520905:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847104 00000100:00100000:1.0:1782759420.520937:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:1.0:1782759420.520944:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232847104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.521017:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232847104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.521027:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:0.0:1782759420.521027:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.521312:0:140708:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140708:1869355232847232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.521347:0:140708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.521366:0:140708:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded2ab2300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.521381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847232 00000100:00100000:3.0:1782759420.521385:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847232 00000100:00100000:3.0:1782759420.521638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:3.0:1782759420.521646:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:140708:x1869355232847232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.521716:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:140708:x1869355232847232:12345-0@lo:502:llog_process_th.0 Request processed in 71us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.521723:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:0.0:1782759420.521734:0:140708:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140708:1869355232847232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.521770:0:140708:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140708:1869355232847360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.521863:0:140708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.521887:0:140708:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.521917:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847360 00000100:00100000:3.0:1782759420.521920:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847360 00000100:00100000:3.0:1782759420.521941:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:3.0:1782759420.521948:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:140708:x1869355232847360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.522005:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:140708:x1869355232847360:12345-0@lo:502:llog_process_th.0 Request processed in 57us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759420.522012:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:0.0:1782759420.522013:0:140708:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140708:1869355232847360:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759420.522030:0:140708:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1782759420.522090:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1782759420.522109:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759420.522116:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.522132:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759420.522141:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759420.522144:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:3.0:1782759420.522146:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759420.522170:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.522177:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.522185:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.522198:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.522219:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.522238:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.522257:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847488 00000100:00100000:1.0:1782759420.522261:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847488 00000100:00100000:1.0:1782759420.522291:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:1.0:1782759420.522298:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232847488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.522314:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759420.522322:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c1a5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.522344:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.522351:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.522356:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428a00, rc 0) 00000100:00100000:1.0:1782759420.522381:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232847488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.522387:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00100000:3.0:1782759420.522403:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759420.522414:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759420.522422:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759420.522460:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.522477:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.522500:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759420.522602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847616 00000100:00100000:2.0:1782759420.522607:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847616 00000100:00100000:1.0:1782759420.522677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3068 00000100:00100000:1.0:1782759420.522684:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232847616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759420.522754:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232847616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.522760:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3068 00000100:00100000:3.0:1782759420.522821:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.522843:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.522874:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.522902:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.522952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847744 00000100:00100000:0.0:1782759420.522956:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847744 00000100:00100000:0.0:1782759420.522990:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3069 00000100:00100000:0.0:1782759420.522996:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232847744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.523063:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232847744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.523070:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3069 00000100:00100000:3.0:1782759420.523129:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232847744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.523327:0:140709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140709:1869355232847872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759420.523367:0:140709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759420.523385:0:140709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.523400:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232847872 00000100:00100000:1.0:1782759420.523404:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232847872 00000100:00100000:1.0:1782759420.523426:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:1.0:1782759420.523431:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:140709:x1869355232847872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.523497:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:140709:x1869355232847872:12345-0@lo:502:llog_process_th.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.523503:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:3.0:1782759420.523508:0:140709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140709:1869355232847872:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759420.523526:0:140709:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759420.523535:0:140709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759420.523537:0:140709:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool64c.lustre-OST0000_UUID 00000020:00000080:3.0:1782759420.523544:0:140709:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1782759420.523556:0:140709:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to pool64c as member 1 00000020:01000004:3.0:1782759420.523957:0:140710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cdec77f6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782759420.523961:0:140710:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8cdec77f6000 4 00000100:00100000:1.0:1782759420.523962:0:140709:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140709:1869355232848000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759420.523996:0:140709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759420.524021:0:140709:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc489d300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759420.524058:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848000 00000100:00100000:0.0:1782759420.524062:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848000 00000100:00100000:0.0:1782759420.524087:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:0.0:1782759420.524095:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:140709:x1869355232848000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759420.524181:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:140709:x1869355232848000:12345-0@lo:502:llog_process_th.0 Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759420.524185:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000100:00100000:1.0:1782759420.524224:0:140709:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:140709:1869355232848000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759420.524237:0:140709:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759420.524240:0:140709:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759420.524241:0:140709:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:1.0:1782759420.524244:0:140709:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:0.0:1782759420.524330:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:0.0:1782759420.524356:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782759420.524362:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.524369:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759420.524375:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782759420.524376:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759420.524378:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782759420.524391:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.524396:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.524409:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759420.524418:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232848128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.524435:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.524473:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759420.524493:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848128 00000100:00100000:1.0:1782759420.524496:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848128 00000100:00100000:1.0:1782759420.524513:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:1.0:1782759420.524516:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232848128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759420.524523:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759420.524531:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c1b3 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.524542:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.524548:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759420.524553:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429400, rc 0) 00000100:00100000:1.0:1782759420.524714:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232848128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759420.524720:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1782759420.524785:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232848128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759420.524807:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.524816:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759420.524851:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232848256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759420.524874:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759420.524900:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759420.524982:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848256 00000100:00100000:3.0:1782759420.524986:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848256 00000100:00100000:3.0:1782759420.525016:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:3.0:1782759420.525022:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232848256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759420.525107:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232848256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (232us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759420.525111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00100000:0.0:1782759420.525145:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232848256:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782759420.525161:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782759420.525164:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759420.525169:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759421.259764:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759421.446718:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.446771:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467712 00000100:00100000:1.0:1782759421.446782:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467712 00000100:00080000:2.0:1782759421.446833:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759421.446893:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2673 00000100:00100000:3.0:1782759421.446907:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218467712:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.451378:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218467712:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4465us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.451405:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2673 00000100:00100000:2.0:1782759421.452768:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.452805:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467840 00000100:00100000:3.0:1782759421.452816:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467840 00000100:00080000:2.0:1782759421.452859:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759421.452882:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1030 00000100:00100000:3.0:1782759421.452894:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218467840:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.453558:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218467840:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 664us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.453566:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1030 00000100:00100000:3.0:1782759421.455412:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.455464:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218467968 00000100:00100000:1.0:1782759421.455483:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218467968 00000100:00100000:1.0:1782759421.455539:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2674 00000100:00100000:1.0:1782759421.455549:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218467968:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.455726:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218467968:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 178us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.455735:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2674 00000100:00100000:1.0:1782759421.456650:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.456687:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468096 00000100:00100000:0.0:1782759421.456700:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468096 00000100:00080000:2.0:1782759421.456739:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759421.456756:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2675 00000100:00100000:0.0:1782759421.456768:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104304:x1869355218468096:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.456960:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104304:x1869355218468096:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 195us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.456969:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2675 00000100:00100000:2.0:1782759421.458140:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.458197:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468224 00000100:00100000:1.0:1782759421.458205:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468224 00000100:00100000:1.0:1782759421.458265:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2676 00000100:00100000:1.0:1782759421.458276:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218468224:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.462813:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104304:x1869355218468224:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4529us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.462828:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2676 00000100:00100000:2.0:1782759421.473511:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.473563:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468352 00000100:00100000:1.0:1782759421.473573:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468352 00000100:00100000:0.0:1782759421.473673:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2677 00000100:00100000:0.0:1782759421.473685:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468352:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.473783:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468352:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.473791:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2677 00000100:00100000:1.0:1782759421.475999:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.476043:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468480 00000100:00100000:3.0:1782759421.476050:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468480 00000100:00100000:3.0:1782759421.476089:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1031 00000100:00100000:3.0:1782759421.476096:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468480:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.476268:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468480:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 171us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.476275:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1031 00000100:00100000:3.0:1782759421.477044:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.477105:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468608 00000100:00100000:0.0:1782759421.477111:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468608 00000100:00100000:0.0:1782759421.477148:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2678 00000100:00100000:0.0:1782759421.477171:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468608:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.477265:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468608:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 109us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.477272:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2678 00000100:00100000:2.0:1782759421.478572:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.478965:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468736 00000100:00100000:3.0:1782759421.478974:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468736 00000100:00100000:3.0:1782759421.479024:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2679 00000100:00100000:3.0:1782759421.479035:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec7794050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104305:x1869355218468736:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.479211:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec7794050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104305:x1869355218468736:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 177us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.479235:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2679 00000100:00100000:1.0:1782759421.480655:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.480692:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468864 00000100:00100000:3.0:1782759421.480699:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468864 00000100:00100000:3.0:1782759421.480788:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2680 00000100:00100000:3.0:1782759421.480798:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468864:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.484448:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104305:x1869355218468864:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3642us (3790us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.484470:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2680 00000100:00100000:2.0:1782759421.495787:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.495838:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218468992 00000100:00100000:1.0:1782759421.495857:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218468992 00000100:00100000:1.0:1782759421.495924:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2681 00000100:00100000:1.0:1782759421.495935:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218468992:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.500713:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218468992:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4769us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.500727:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2681 00000100:00100000:2.0:1782759421.503567:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.506428:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469120 00000100:00100000:3.0:1782759421.506443:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469120 00000100:00100000:3.0:1782759421.506516:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1032 00000100:00100000:3.0:1782759421.506527:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218469120:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.506761:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218469120:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 230us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.506770:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1032 00000100:00100000:2.0:1782759421.508150:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.508399:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469248 00000100:00100000:1.0:1782759421.508417:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469248 00000100:00100000:1.0:1782759421.508472:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2682 00000100:00100000:1.0:1782759421.508483:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218469248:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.508667:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218469248:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 186us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.508675:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2682 00000100:00100000:2.0:1782759421.510153:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.510264:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469376 00000100:00100000:0.0:1782759421.510273:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469376 00000100:00100000:0.0:1782759421.510319:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2683 00000100:00100000:0.0:1782759421.510339:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104306:x1869355218469376:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.510456:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104306:x1869355218469376:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.510464:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2683 00000100:00100000:3.0:1782759421.514561:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.514686:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469504 00000100:00100000:0.0:1782759421.514697:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469504 00000100:00100000:0.0:1782759421.514746:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2684 00000100:00100000:0.0:1782759421.514755:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218469504:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.518064:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104306:x1869355218469504:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3300us (3501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.518078:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2684 00000100:00100000:2.0:1782759421.530121:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.530476:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469632 00000100:00100000:1.0:1782759421.530487:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469632 00000100:00100000:1.0:1782759421.530546:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2685 00000100:00100000:1.0:1782759421.530558:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218469632:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.530696:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218469632:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 140us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.530704:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2685 00000100:00100000:2.0:1782759421.531975:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.532068:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469760 00000100:00100000:3.0:1782759421.532074:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469760 00000100:00100000:3.0:1782759421.532157:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1033 00000100:00100000:3.0:1782759421.532166:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218469760:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.532336:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218469760:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 160us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.532344:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1033 00000100:00100000:3.0:1782759421.535731:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.537912:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218469888 00000100:00100000:0.0:1782759421.537925:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218469888 00000100:00100000:0.0:1782759421.538054:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2686 00000100:00100000:0.0:1782759421.538065:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218469888:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.538210:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218469888:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 147us (2485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.538217:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2686 00000100:00100000:2.0:1782759421.543980:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.544189:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470016 00000100:00100000:1.0:1782759421.544200:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470016 00000100:00100000:1.0:1782759421.544263:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2687 00000100:00100000:1.0:1782759421.544273:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104307:x1869355218470016:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.544424:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104307:x1869355218470016:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.544430:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2687 00000100:00100000:2.0:1782759421.546519:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.546688:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470144 00000100:00100000:0.0:1782759421.546697:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470144 00000100:00100000:0.0:1782759421.546753:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2688 00000100:00100000:0.0:1782759421.546764:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218470144:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.550370:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104307:x1869355218470144:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3598us (3847us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.550386:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2688 00000100:00100000:3.0:1782759421.560181:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.560278:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470272 00000100:00100000:2.0:1782759421.560288:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470272 00000100:00100000:2.0:1782759421.560352:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2689 00000100:00100000:2.0:1782759421.560363:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470272:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.565062:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470272:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4686us (4875us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.565077:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2689 00000100:00100000:2.0:1782759421.569339:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.569450:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470400 00000100:00100000:3.0:1782759421.569461:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470400 00000100:00100000:3.0:1782759421.569527:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1034 00000100:00100000:3.0:1782759421.569538:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470400:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.569808:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470400:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 273us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.569814:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1034 00000100:00100000:3.0:1782759421.571638:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.575447:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470528 00000100:00100000:0.0:1782759421.575459:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470528 00000100:00100000:0.0:1782759421.575518:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2690 00000100:00100000:0.0:1782759421.575526:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470528:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.575732:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470528:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 207us (4102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.575750:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2690 00000100:00100000:2.0:1782759421.577133:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.577220:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470656 00000100:00100000:1.0:1782759421.577229:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470656 00000100:00100000:1.0:1782759421.577291:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2691 00000100:00100000:1.0:1782759421.577300:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104308:x1869355218470656:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.577776:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104308:x1869355218470656:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 476us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.577798:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2691 00000100:00100000:2.0:1782759421.579451:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.579679:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470784 00000100:00100000:0.0:1782759421.579686:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470784 00000100:00100000:0.0:1782759421.579736:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2692 00000100:00100000:0.0:1782759421.579747:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470784:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.582080:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104308:x1869355218470784:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 2327us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.582093:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2692 00000100:00100000:3.0:1782759421.599124:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.599396:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218470912 00000100:00100000:1.0:1782759421.599407:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218470912 00000100:00100000:1.0:1782759421.599461:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2693 00000100:00100000:1.0:1782759421.599472:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218470912:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.599615:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218470912:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 99us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.599623:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2693 00000100:00100000:2.0:1782759421.601099:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.601397:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471040 00000100:00100000:3.0:1782759421.601406:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471040 00000100:00100000:3.0:1782759421.601623:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1035 00000100:00100000:3.0:1782759421.601634:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218471040:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.601854:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218471040:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 222us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.601862:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1035 00000100:00100000:2.0:1782759421.605063:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.605790:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471168 00000100:00100000:0.0:1782759421.605802:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471168 00000100:00100000:0.0:1782759421.605865:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2694 00000100:00100000:0.0:1782759421.605877:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218471168:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.606035:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218471168:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 160us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.606040:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2694 00000100:00100000:2.0:1782759421.608004:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.608356:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471296 00000100:00100000:3.0:1782759421.608365:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471296 00000100:00100000:3.0:1782759421.608424:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2695 00000100:00100000:3.0:1782759421.608496:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104309:x1869355218471296:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.608768:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104309:x1869355218471296:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 334us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.608776:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2695 00000100:00100000:2.0:1782759421.611401:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.611505:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471424 00000100:00100000:0.0:1782759421.611516:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471424 00000100:00100000:0.0:1782759421.611574:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2696 00000100:00100000:0.0:1782759421.611604:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218471424:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.614170:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104309:x1869355218471424:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 2558us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.614185:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2696 00000100:00100000:2.0:1782759421.624814:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.624930:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471552 00000100:00100000:0.0:1782759421.624941:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471552 00000100:00100000:0.0:1782759421.625049:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2697 00000100:00100000:0.0:1782759421.625073:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104310:x1869355218471552:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.630828:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104310:x1869355218471552:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 5746us (6013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.630844:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2697 00000100:00100000:3.0:1782759421.639795:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.639865:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471680 00000100:00100000:0.0:1782759421.639876:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471680 00000100:00100000:0.0:1782759421.639934:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2698 00000100:00100000:0.0:1782759421.639944:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104311:x1869355218471680:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.644141:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104311:x1869355218471680:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4187us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.644156:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2698 00000100:00100000:2.0:1782759421.656321:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.656506:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471808 00000100:00100000:1.0:1782759421.656516:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471808 00000100:00100000:1.0:1782759421.656599:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2699 00000100:00100000:1.0:1782759421.656611:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104312:x1869355218471808:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.661288:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104312:x1869355218471808:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4671us (4969us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.661298:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2699 00000100:00100000:2.0:1782759421.677365:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.677542:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218471936 00000100:00100000:1.0:1782759421.677553:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218471936 00000100:00100000:1.0:1782759421.677683:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2700 00000100:00100000:1.0:1782759421.677694:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104313:x1869355218471936:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.681487:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104313:x1869355218471936:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3784us (4122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.681504:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2700 00000100:00100000:3.0:1782759421.693348:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.693416:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472064 00000100:00100000:2.0:1782759421.693426:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472064 00000100:00100000:2.0:1782759421.693488:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2701 00000100:00100000:2.0:1782759421.693499:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104314:x1869355218472064:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.696818:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104314:x1869355218472064:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3313us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.696830:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2701 00000100:00100000:2.0:1782759421.705269:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.705352:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472192 00000100:00100000:0.0:1782759421.705363:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472192 00000100:00100000:0.0:1782759421.705441:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2702 00000100:00100000:0.0:1782759421.705451:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104315:x1869355218472192:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.711284:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104315:x1869355218472192:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 5823us (6014us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.711299:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2702 00000100:00100000:1.0:1782759421.722061:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.722134:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472320 00000100:00100000:0.0:1782759421.722144:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472320 00000100:00100000:0.0:1782759421.722199:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2703 00000100:00100000:0.0:1782759421.722211:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104316:x1869355218472320:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.726340:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104316:x1869355218472320:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4113us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.726355:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2703 00000100:00100000:3.0:1782759421.738543:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.738636:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472448 00000100:00100000:0.0:1782759421.738647:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472448 00000100:00100000:0.0:1782759421.738707:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2704 00000100:00100000:0.0:1782759421.738719:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104317:x1869355218472448:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.743669:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104317:x1869355218472448:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4928us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.743684:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2704 00000100:00100000:2.0:1782759421.754912:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.754974:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472576 00000100:00100000:1.0:1782759421.754982:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472576 00000100:00100000:1.0:1782759421.755045:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2705 00000100:00100000:1.0:1782759421.755055:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104318:x1869355218472576:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.759832:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104318:x1869355218472576:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4756us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.759847:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2705 00000100:00100000:1.0:1782759421.775766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.775838:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472704 00000100:00100000:2.0:1782759421.775849:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472704 00000100:00100000:2.0:1782759421.775910:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2706 00000100:00100000:2.0:1782759421.775922:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104319:x1869355218472704:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.786725:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104319:x1869355218472704:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 10796us (10958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.786740:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2706 00000100:00100000:3.0:1782759421.794699:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.794797:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472832 00000100:00100000:2.0:1782759421.794807:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472832 00000100:00100000:2.0:1782759421.794870:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2707 00000100:00100000:2.0:1782759421.794881:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104320:x1869355218472832:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.803828:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104320:x1869355218472832:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 8939us (9129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.803843:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2707 00000100:00100000:2.0:1782759421.815333:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.815484:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218472960 00000100:00100000:0.0:1782759421.815494:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218472960 00000100:00100000:0.0:1782759421.815562:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2708 00000100:00100000:0.0:1782759421.815612:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104321:x1869355218472960:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.822412:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104321:x1869355218472960:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 6833us (7090us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.822424:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2708 00000100:00100000:1.0:1782759421.833669:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.833932:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473088 00000100:00100000:0.0:1782759421.833943:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473088 00000100:00100000:0.0:1782759421.834006:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2709 00000100:00100000:0.0:1782759421.834016:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473088:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.834109:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473088:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 93us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.834117:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2709 00000100:00100000:1.0:1782759421.836542:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759421.837675:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232848384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759421.837762:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759421.837912:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848384 00000100:00100000:0.0:1782759421.837921:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848384 00000100:00100000:0.0:1782759421.837989:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3128 00000100:00100000:0.0:1782759421.837998:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232848384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759421.838036:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:3.0:1782759421.838454:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.838646:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473216 00000100:00100000:2.0:1782759421.838651:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473216 00000100:00100000:2.0:1782759421.838693:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1036 00000100:00100000:2.0:1782759421.838702:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473216:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759421.838817:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473216:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 116us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.838831:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1036 00000100:00100000:0.0:1782759421.839411:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232848384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1411us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.839420:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3128 00000100:00100000:1.0:1782759421.839637:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232848384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759421.844721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.844820:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473344 00000100:00100000:0.0:1782759421.844829:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473344 00000100:00100000:0.0:1782759421.844898:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1037 00000100:00100000:0.0:1782759421.844904:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1869355218473344:12345-192.168.202.31@tcp:8:lfs.0 00010000:00080000:0.0:1782759421.844932:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp t0 exp 0000000000000000 cur 3462 last 0 00000020:00000080:0.0:1782759421.844957:0:8445:0:(genops.c:1406:class_connect()) connect: client e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0, cookie 0xd5b45c7f5c60c1c1 00002000:00100000:0.0:1782759421.844971:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0/ffff8cddc44c3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759421.844985:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782759421.845036:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782759421.845060:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cddc44c1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759421.845108:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2401:x1869355218473344:12345-192.168.202.31@tcp:8:lfs.0 Request processed in 204us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.845119:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1037 00000100:00100000:2.0:1782759421.851453:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.851517:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473472 00000100:00100000:3.0:1782759421.851527:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473472 00000100:00100000:3.0:1782759421.851626:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1038 00000100:00100000:3.0:1782759421.851638:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473472:12345-192.168.202.31@tcp:19:lfs.0 00000100:00080000:2.0:1782759421.851758:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759421.851881:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473472:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 246us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.851887:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1038 00000100:00100000:2.0:1782759421.854380:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.854458:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473600 00000100:00100000:0.0:1782759421.854469:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473600 00000100:00100000:0.0:1782759421.854542:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2710 00000100:00100000:0.0:1782759421.854550:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473600:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.854681:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473600:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.854686:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2710 00000100:00100000:2.0:1782759421.855834:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.855910:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473728 00000100:00100000:1.0:1782759421.855915:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473728 00000100:00100000:1.0:1782759421.855947:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2711 00000100:00100000:1.0:1782759421.855953:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104322:x1869355218473728:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.856052:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104322:x1869355218473728:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.856057:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2711 00000100:00100000:3.0:1782759421.857143:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.857189:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473856 00000100:00100000:0.0:1782759421.857196:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473856 00000100:00100000:0.0:1782759421.857235:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2712 00000100:00100000:0.0:1782759421.857256:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473856:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.862771:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104322:x1869355218473856:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 5508us (5622us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.862782:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2712 00000100:00100000:2.0:1782759421.872011:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.872126:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218473984 00000100:00100000:3.0:1782759421.872138:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218473984 00000100:00100000:3.0:1782759421.872206:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2713 00000100:00100000:3.0:1782759421.872217:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218473984:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.872356:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218473984:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.872364:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2713 00000100:00100000:3.0:1782759421.873716:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.874001:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474112 00000100:00100000:1.0:1782759421.874009:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474112 00000100:00100000:1.0:1782759421.874103:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1039 00000100:00100000:1.0:1782759421.874115:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474112:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759421.874263:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474112:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 150us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.874270:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1039 00000100:00100000:2.0:1782759421.877400:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.877526:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474240 00000100:00100000:0.0:1782759421.877536:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474240 00000100:00100000:0.0:1782759421.877633:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1040 00000100:00100000:0.0:1782759421.877643:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474240:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759421.877789:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474240:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 147us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.877797:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1040 00000100:00100000:3.0:1782759421.879854:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.879998:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474368 00000100:00100000:0.0:1782759421.880008:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474368 00000100:00100000:0.0:1782759421.880068:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2714 00000100:00100000:0.0:1782759421.880077:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474368:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.880300:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474368:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 223us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.880309:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2714 00000100:00100000:3.0:1782759421.881928:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.882027:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474496 00000100:00100000:2.0:1782759421.882034:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474496 00000100:00100000:2.0:1782759421.882119:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2715 00000100:00100000:2.0:1782759421.882129:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104323:x1869355218474496:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.882239:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104323:x1869355218474496:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 111us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.883427:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2715 00000100:00100000:2.0:1782759421.884489:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.884612:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474624 00000100:00100000:3.0:1782759421.884620:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474624 00000100:00100000:3.0:1782759421.884663:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2716 00000100:00100000:3.0:1782759421.884673:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474624:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.889788:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104323:x1869355218474624:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 5105us (5348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.889802:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2716 00000100:00100000:3.0:1782759421.901514:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.901621:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474752 00000100:00100000:1.0:1782759421.901632:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474752 00000100:00100000:1.0:1782759421.901705:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2717 00000100:00100000:1.0:1782759421.901717:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218474752:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.901821:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218474752:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 106us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.901828:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2717 00000100:00100000:2.0:1782759421.905155:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.905315:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218474880 00000100:00100000:3.0:1782759421.905334:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218474880 00000100:00100000:3.0:1782759421.905433:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1041 00000100:00100000:3.0:1782759421.905444:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218474880:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.905626:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218474880:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 183us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.905634:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1041 00000100:00100000:2.0:1782759421.912142:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.912225:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475008 00000100:00100000:3.0:1782759421.912235:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475008 00000100:00100000:3.0:1782759421.912293:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1042 00000100:00100000:3.0:1782759421.912301:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218475008:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.912494:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218475008:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 192us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.912502:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1042 00000100:00100000:0.0:1782759421.915386:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.915453:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475136 00000100:00100000:2.0:1782759421.915462:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475136 00000100:00100000:2.0:1782759421.915527:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2718 00000100:00100000:2.0:1782759421.915536:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218475136:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.915691:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218475136:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 156us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.915713:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2718 00000100:00100000:2.0:1782759421.917181:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.917240:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475264 00000100:00100000:0.0:1782759421.917256:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475264 00000100:00100000:0.0:1782759421.917304:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2719 00000100:00100000:0.0:1782759421.917313:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104324:x1869355218475264:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.917431:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104324:x1869355218475264:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 119us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.917439:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2719 00000100:00100000:0.0:1782759421.921050:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.921122:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475392 00000100:00100000:1.0:1782759421.921133:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475392 00000100:00100000:1.0:1782759421.921194:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2720 00000100:00100000:1.0:1782759421.921204:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218475392:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.928220:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104324:x1869355218475392:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 7009us (7169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.928232:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2720 00000100:00100000:1.0:1782759421.940862:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.940963:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475520 00000100:00100000:2.0:1782759421.940973:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475520 00000100:00100000:2.0:1782759421.941037:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2721 00000100:00100000:2.0:1782759421.941047:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475520:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.941149:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475520:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.941156:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2721 00000100:00100000:2.0:1782759421.943066:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.943189:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475648 00000100:00100000:1.0:1782759421.943198:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475648 00000100:00100000:1.0:1782759421.943291:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1043 00000100:00100000:1.0:1782759421.943301:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475648:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759421.943452:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475648:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 153us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.943461:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1043 00000100:00100000:0.0:1782759421.944767:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.944821:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475776 00000100:00100000:3.0:1782759421.944828:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475776 00000100:00100000:3.0:1782759421.944877:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1044 00000100:00100000:3.0:1782759421.944885:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475776:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759421.944967:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475776:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.944973:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1044 00000100:00100000:0.0:1782759421.945990:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.946033:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218475904 00000100:00100000:2.0:1782759421.946038:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218475904 00000100:00100000:2.0:1782759421.946076:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2722 00000100:00100000:2.0:1782759421.946085:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475904:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.946180:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218475904:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.946187:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2722 00000100:00100000:2.0:1782759421.947143:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.947206:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476032 00000100:00100000:0.0:1782759421.947212:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476032 00000100:00100000:0.0:1782759421.947257:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2723 00000100:00100000:0.0:1782759421.947266:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104325:x1869355218476032:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.947372:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104325:x1869355218476032:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 107us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.947377:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2723 00000100:00100000:0.0:1782759421.951179:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759421.951293:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476160 00000100:00100000:2.0:1782759421.951302:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476160 00000100:00100000:2.0:1782759421.951371:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2724 00000100:00100000:2.0:1782759421.951393:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218476160:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759421.955833:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104325:x1869355218476160:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4442us (4655us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759421.955846:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2724 00000100:00100000:2.0:1782759421.971096:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759421.971376:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476288 00000100:00100000:0.0:1782759421.971386:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476288 00000100:00100000:0.0:1782759421.971454:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2725 00000100:00100000:0.0:1782759421.971475:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476288:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759421.971567:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476288:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 104us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759421.971608:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2725 00000100:00100000:3.0:1782759421.975680:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.976065:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476416 00000100:00100000:1.0:1782759421.976082:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476416 00000100:00100000:1.0:1782759421.976145:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1045 00000100:00100000:1.0:1782759421.976155:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476416:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759421.976307:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476416:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 153us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.976316:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1045 00000100:00100000:2.0:1782759421.978175:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.978271:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476544 00000100:00100000:1.0:1782759421.978280:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476544 00000100:00100000:1.0:1782759421.978362:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1046 00000100:00100000:1.0:1782759421.978372:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476544:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759421.980421:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476544:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 2041us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.980434:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1046 00000100:00100000:0.0:1782759421.983746:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759421.983806:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476672 00000100:00100000:1.0:1782759421.983816:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476672 00000100:00100000:1.0:1782759421.983919:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2726 00000100:00100000:1.0:1782759421.983930:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476672:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759421.984104:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476672:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 175us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759421.984112:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2726 00000100:00100000:2.0:1782759421.985702:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.985781:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476800 00000100:00100000:3.0:1782759421.985791:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476800 00000100:00100000:3.0:1782759421.985841:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2727 00000100:00100000:3.0:1782759421.985850:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104326:x1869355218476800:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.985962:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104326:x1869355218476800:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.985970:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2727 00000100:00100000:2.0:1782759421.989346:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759421.989574:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218476928 00000100:00100000:3.0:1782759421.989618:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218476928 00000100:00100000:3.0:1782759421.989666:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2728 00000100:00100000:3.0:1782759421.989676:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476928:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759421.993670:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104326:x1869355218476928:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3987us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759421.993688:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2728 00000100:00100000:0.0:1782759422.004568:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759422.004635:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477056 00000100:00100000:1.0:1782759422.004645:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477056 00000100:00100000:1.0:1782759422.004695:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2729 00000100:00100000:1.0:1782759422.004706:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477056:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759422.004797:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477056:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.004805:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2729 00000100:00100000:2.0:1782759422.006282:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.006824:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477184 00000100:00100000:0.0:1782759422.006833:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477184 00000100:00100000:0.0:1782759422.006880:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1047 00000100:00100000:0.0:1782759422.006889:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477184:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759422.007009:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477184:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 121us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.007016:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1047 00000100:00100000:2.0:1782759422.011615:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.011710:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477312 00000100:00100000:0.0:1782759422.011728:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477312 00000100:00100000:0.0:1782759422.011778:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1048 00000100:00100000:0.0:1782759422.011785:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477312:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759422.011898:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477312:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 113us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.011903:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1048 00000100:00100000:2.0:1782759422.015188:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759422.015354:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477440 00000100:00100000:3.0:1782759422.015364:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477440 00000100:00100000:3.0:1782759422.015457:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2730 00000100:00100000:3.0:1782759422.015467:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477440:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759422.015645:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477440:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 178us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.015653:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2730 00000100:00100000:2.0:1782759422.017202:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.017386:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477568 00000100:00100000:0.0:1782759422.017394:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477568 00000100:00100000:0.0:1782759422.017457:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2731 00000100:00100000:0.0:1782759422.017467:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104327:x1869355218477568:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759422.017601:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104327:x1869355218477568:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 135us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.017610:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2731 00000100:00100000:0.0:1782759422.022007:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759422.022069:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477696 00000100:00100000:1.0:1782759422.022092:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477696 00000100:00100000:1.0:1782759422.022151:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2732 00000100:00100000:1.0:1782759422.022160:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477696:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759422.025888:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104327:x1869355218477696:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3719us (3880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.025904:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2732 00010000:00010000:2.0:1782759422.284202:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759422.414992:0:140810:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c24066a2 len=0 uarg=00007ffc854f7f20 00040000:00000080:0.0:1782759422.415010:0:140810:0:(qmt_handler.c:1453:qmt_iocontrol()) lustre-QMT0000: cmd=c24066a2 len=584 karg=ffff8cddc3374c00 uarg=0000000000000000 00080000:10000000:0.0:1782759422.415719:0:140810:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/32) registered 00080000:10000000:0.0:1782759422.420002:0:140810:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/32) registered 00080000:10000000:0.0:1782759422.422430:0:140810:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3c:0x0] (8/32) registered 00080000:10000000:0.0:1782759422.424976:0:140810:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3e:0x0] (8/32) registered 00080000:10000000:0.0:1782759422.427885:0:140810:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3f:0x0] (8/32) registered 00080000:10000000:0.0:1782759422.430824:0:140810:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x40:0x0] (8/32) registered 00000100:00100000:1.0:1782759422.859100:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232848512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759422.859171:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859390:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232848640:0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859399:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232849024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859423:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859447:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232849152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859467:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859482:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759422.859485:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232849536:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859498:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232849664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859509:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859523:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232848768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859530:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232850048:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859549:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759422.859550:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859566:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232849280:0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859567:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759422.859572:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232848896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859607:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859624:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232849792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859641:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859642:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759422.859655:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232849408:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859669:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849024 00000100:00100000:2.0:1782759422.859676:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849024 00000100:00100000:1.0:1782759422.859683:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759422.859699:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232849920:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859718:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848768 00000100:00100000:1.0:1782759422.859718:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.859721:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848768 00000100:00100000:2.0:1782759422.859732:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849280 00000100:00100000:2.0:1782759422.859735:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849280 00000100:00100000:1.0:1782759422.859736:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848640 00000100:00100000:1.0:1782759422.859738:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848640 00000100:00100000:2.0:1782759422.859760:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849792 00000100:00100000:2.0:1782759422.859763:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849792 00000100:00100000:1.0:1782759422.859763:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3074 00000100:00100000:1.0:1782759422.859771:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232848640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.859775:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849408 00000100:00100000:2.0:1782759422.859778:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849408 00000100:00100000:2.0:1782759422.859791:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849920 00000100:00100000:2.0:1782759422.859793:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849920 00000100:00100000:2.0:1782759422.859810:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908 00000100:00100000:0.0:1782759422.859818:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:2.0:1782759422.859819:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232849024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.859834:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232848768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859838:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232848640:12345-0@lo:400:kworker.0 Request processed in 66us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.859847:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3074 00000100:00100000:2.0:1782759422.859855:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232849024:12345-0@lo:400:kworker.0 Request processed in 41us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.859861:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908 00000100:00100000:2.0:1782759422.859875:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910 00000100:00100000:2.0:1782759422.859883:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232849280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859884:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849536 00000100:00100000:1.0:1782759422.859887:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849536 00000100:00100000:2.0:1782759422.859911:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232849280:12345-0@lo:400:kworker.0 Request processed in 30us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.859913:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850048 00000100:00100000:1.0:1782759422.859916:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850048 00000100:00100000:2.0:1782759422.859917:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910 00000100:00100000:2.0:1782759422.859927:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:2.0:1782759422.859933:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232849792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.859935:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:1.0:1782759422.859939:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232849536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.859953:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232848768:12345-0@lo:400:kworker.0 Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.859960:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232849792:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.859963:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232849536:12345-0@lo:400:kworker.0 Request processed in 23us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.859970:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00000100:00100000:1.0:1782759422.859976:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:0.0:1782759422.859980:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000100:00100000:2.0:1782759422.859991:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000100:00100000:1.0:1782759422.859991:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:2.0:1782759422.860000:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232849408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759422.860000:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.860004:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1782759422.860014:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232849920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860032:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232849408:12345-0@lo:400:kworker.0 Request processed in 33us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.860032:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232850048:12345-0@lo:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.860039:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00000100:00100000:1.0:1782759422.860039:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:2.0:1782759422.860056:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849152 00000100:00100000:2.0:1782759422.860065:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849152 00000100:00100000:2.0:1782759422.860107:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848896 00000100:00100000:2.0:1782759422.860110:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848896 00000100:00100000:2.0:1782759422.860123:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3129 00000100:00100000:2.0:1782759422.860128:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232849152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759422.860206:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232848512 00000100:00100000:3.0:1782759422.860210:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232848512 00000100:00100000:3.0:1782759422.860240:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1782759422.860247:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232848512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759422.860268:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759422.860382:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:1.0:1782759422.860390:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232848896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860396:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232849152:12345-0@lo:400:kworker.0 Request processed in 268us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.860402:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3129 00000100:00100000:0.0:1782759422.860430:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232849920:12345-0@lo:400:kworker.0 Request processed in 415us (708us total) trans 0 rc 0/0 00000100:00080000:2.0:1782759422.860435:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759422.860438:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232848896:12345-0@lo:400:kworker.0 Request processed in 48us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.860439:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00080000:2.0:1782759422.860440:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759422.860444:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759422.860446:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759422.860448:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:2.0:1782759422.860482:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232848768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860494:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232849280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860502:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232849792:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860530:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759422.860564:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232848640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860574:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232849152:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860638:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232848896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860649:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232849408:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860662:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232849920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.860663:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232849664 00000100:00100000:0.0:1782759422.860669:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232849664 00000100:00100000:2.0:1782759422.860677:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232849024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759422.860690:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232849536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.860711:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:2.0:1782759422.860714:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232850048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.860723:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232849664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759422.860768:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232849664:12345-0@lo:400:kworker.0 Request processed in 48us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.860775:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00080000:0.0:1782759422.860793:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759422.860814:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232849664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759422.861605:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232848512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1355us (2430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.861614:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1782759422.861757:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232848512:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1782759422.884327:0:140859:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c24066a2 len=0 uarg=00007fffdf24ed70 00040000:00000080:3.0:1782759422.884347:0:140859:0:(qmt_handler.c:1453:qmt_iocontrol()) lustre-QMT0000: cmd=c24066a2 len=584 karg=ffff8cddc57de400 uarg=0000000000000000 00000020:01000004:3.0:1782759422.885080:0:140860:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cdec77f6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782759422.885085:0:140860:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8cdec77f6000 4 00000020:01000004:1.0:1782759422.885382:0:140861:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cdec77f6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782759422.885385:0:140861:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8cdec77f6000 4 00080000:10000000:2.0:1782759422.885736:0:140859:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x41:0x0] (4/8) registered 00000100:00100000:3.0:1782759422.915616:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.915716:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477824 00000100:00100000:0.0:1782759422.915726:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477824 00000100:00100000:0.0:1782759422.915786:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2733 00000100:00100000:0.0:1782759422.915796:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104346:x1869355218477824:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759422.923289:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104346:x1869355218477824:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 7486us (7675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.923303:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2733 00000100:00100000:3.0:1782759422.925192:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.925301:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218477952 00000100:00100000:0.0:1782759422.925323:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218477952 00000100:00100000:0.0:1782759422.925375:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2734 00000100:00100000:0.0:1782759422.925383:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104346:x1869355218477952:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759422.929148:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104346:x1869355218477952:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3756us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759422.929284:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2734 00000100:00100000:0.0:1782759422.939895:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759422.940356:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478080 00000100:00100000:2.0:1782759422.940366:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478080 00000100:00100000:2.0:1782759422.940437:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2735 00000100:00100000:2.0:1782759422.940448:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104347:x1869355218478080:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759422.940546:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104347:x1869355218478080:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 100us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.940553:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2735 00000100:00100000:3.0:1782759422.942406:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759422.942551:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478208 00000100:00100000:1.0:1782759422.942559:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478208 00000100:00100000:1.0:1782759422.942978:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2736 00000100:00100000:1.0:1782759422.942996:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104347:x1869355218478208:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759422.946701:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104347:x1869355218478208:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3700us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759422.946715:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2736 00000100:00100000:3.0:1782759422.959808:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759422.959980:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478336 00000100:00100000:2.0:1782759422.959990:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478336 00000100:00100000:2.0:1782759422.960043:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2737 00000100:00100000:2.0:1782759422.960053:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104348:x1869355218478336:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759422.969776:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104348:x1869355218478336:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 9714us (9967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.969792:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2737 00000100:00100000:0.0:1782759422.974281:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.974333:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478464 00000100:00100000:0.0:1782759422.974343:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478464 00000100:00100000:0.0:1782759422.974400:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2738 00000100:00100000:0.0:1782759422.974411:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104348:x1869355218478464:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759422.981178:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104348:x1869355218478464:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 6747us (6886us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759422.981193:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2738 00000100:00100000:2.0:1782759422.993783:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759422.993826:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478592 00000100:00100000:3.0:1782759422.993836:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478592 00000100:00100000:3.0:1782759422.993888:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2739 00000100:00100000:3.0:1782759422.993897:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104349:x1869355218478592:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759422.993985:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104349:x1869355218478592:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 89us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759422.993992:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2739 00000100:00100000:3.0:1782759422.995527:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759422.995595:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478720 00000100:00100000:0.0:1782759422.995602:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478720 00000100:00100000:0.0:1782759422.995634:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2740 00000100:00100000:0.0:1782759422.995640:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104349:x1869355218478720:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759423.000550:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104349:x1869355218478720:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4899us (5016us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.000564:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2740 00000100:00100000:0.0:1782759423.014373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759423.015340:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478848 00000100:00100000:2.0:1782759423.015349:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478848 00000100:00100000:2.0:1782759423.015420:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2741 00000100:00100000:2.0:1782759423.015429:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104350:x1869355218478848:12345-192.168.202.31@tcp:48:lfs.0 00000100:00080000:0.0:1782759423.015647:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759423.021017:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104350:x1869355218478848:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 5578us (6640us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.021033:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2741 00000100:00100000:2.0:1782759423.022745:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759423.022846:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218478976 00000100:00100000:1.0:1782759423.022855:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218478976 00000100:00100000:1.0:1782759423.022942:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2742 00000100:00100000:1.0:1782759423.022952:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104350:x1869355218478976:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759423.026851:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104350:x1869355218478976:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3887us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759423.026866:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2742 00000100:00100000:3.0:1782759423.044669:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759423.044848:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479104 00000100:00100000:2.0:1782759423.044867:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479104 00000100:00100000:2.0:1782759423.044961:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2743 00000100:00100000:2.0:1782759423.044972:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104351:x1869355218479104:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.045090:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104351:x1869355218479104:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 119us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.045098:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2743 00000100:00100000:0.0:1782759423.047685:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759423.047741:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479232 00000100:00100000:3.0:1782759423.047750:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479232 00000100:00100000:2.0:1782759423.047947:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2744 00000100:00100000:2.0:1782759423.047959:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104351:x1869355218479232:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759423.052131:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104351:x1869355218479232:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4167us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759423.052142:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2744 00010000:00010000:1.0:1782759423.306706:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759423.370974:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232850176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759423.371059:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759423.371097:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850176 00000100:00100000:0.0:1782759423.371106:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850176 00000100:00100000:0.0:1782759423.371159:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1782759423.371171:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232850176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759423.371193:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759423.371307:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232850176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 139us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.371327:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1782759423.371337:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232850176:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1782759423.557175:0:140909:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc88e18710 20000000:00000080:3.0:1782759423.557190:0:140909:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc57df400 uarg=0000000000000000 00010000:00010000:3.0:1782759423.557788:0:140909:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759423.557837:0:140909:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759423.557840:0:140909:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759423.557849:0:140909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c086 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27249 expref: 5 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.557862:0:140909:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759423.557889:0:140909:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759423.557896:0:140909:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759423.557909:0:140909:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759423.557919:0:140909:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.557929:0:140909:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.557934:0:140909:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.557962:0:140909:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.557971:0:140909:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 23 pid: 6524 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759423.557990:0:140909:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140909:1869355232850304:0@lo:104: 00000100:00100000:3.0:1782759423.558038:0:140909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759423.558078:0:140909:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759423.558131:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850304 00000100:00100000:0.0:1782759423.558136:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850304 00000100:00100000:0.0:1782759423.558171:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:0.0:1782759423.558177:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:140909:x1869355232850304:12345-0@lo:104: 00010000:00010000:0.0:1782759423.558186:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558232:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759423.558236:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:140909:x1869355232850304:12345-0@lo:104: Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.558241:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00010000:00010000:2.0:1782759423.558257:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759423.558265:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759423.558273:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759423.558277:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759423.558286:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759423.558292:0:140909:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:140909:1869355232850304:0@lo:104: 10000000:00010000:2.0:1782759423.558317:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.558318:0:140909:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759423.558331:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759423.558363:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759423.558370:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759423.558425:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232850432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759423.558447:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759423.558504:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850432 00000100:00100000:0.0:1782759423.558508:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850432 00010000:00010000:0.0:1782759423.558525:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 24 pid: 6524 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759423.558554:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1782759423.558560:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232850432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759423.558569:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759423.558574:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 24 pid: 6524 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558614:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 24 pid: 6524 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558625:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60c094 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c08d expref: 24 pid: 6524 timeout: 3613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558636:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558653:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558664:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558671:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558677:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558682:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558688:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759423.558692:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558699:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558716:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759423.558725:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759423.558757:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232850432:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759423.558765:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:0.0:1782759423.558793:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232850432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759423.558910:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759423.558918:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60c08d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c094 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759423.558931:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759423.558932:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759423.558934:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759423.559343:0:140909:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.559353:0:140909:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759423.559359:0:140909:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5e00/0xd5b45c7f5c60c1c8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 140909 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759423.882869:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232850560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759423.882962:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759423.883067:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850560 00000100:00100000:3.0:1782759423.883074:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850560 00000100:00100000:3.0:1782759423.883130:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:3.0:1782759423.883137:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232850560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759423.883166:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:3.0:1782759423.883212:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232850560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759423.883217:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:0.0:1782759423.883278:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232850560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759424.220277:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759424.220334:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759424.220362:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479360 00000100:00100000:3.0:1782759424.220380:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479360 00000100:00100000:2.0:1782759424.220386:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759424.220410:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759424.220434:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3075 00000100:00100000:3.0:1782759424.220446:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218479360:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759424.220480:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759424.220521:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218479360:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 77us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759424.220530:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3075 00000100:00100000:1.0:1782759424.220551:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479616 00000100:00100000:1.0:1782759424.220556:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479616 00000100:00100000:1.0:1782759424.220625:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479488 00000100:00100000:1.0:1782759424.220627:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479488 00000100:00100000:1.0:1782759424.220648:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4914 00000100:00100000:1.0:1782759424.220655:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218479616:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759424.220816:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479872 00000100:00100000:2.0:1782759424.220820:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479872 00000100:00100000:2.0:1782759424.220849:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218479744 00000100:00100000:2.0:1782759424.220852:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218479744 00000100:00100000:2.0:1782759424.220867:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2816 00000100:00100000:2.0:1782759424.220878:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218479872:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759424.220900:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218479872:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.220905:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2816 00000100:00100000:2.0:1782759424.220913:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2817 00000100:00100000:1.0:1782759424.220945:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218479616:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 291us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759424.220949:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4914 00000100:00100000:1.0:1782759424.220962:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4915 00000100:00100000:1.0:1782759424.220968:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218479488:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759424.220991:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218479488:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759424.221007:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4915 00000100:00080000:1.0:1782759424.221022:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759424.221024:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759424.221026:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759424.221271:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218479744:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759424.221313:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218479744:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 395us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759424.221320:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2817 00010000:00010000:2.0:1782759424.330710:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759424.394709:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759424.394730:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232850688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759424.394796:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759424.394856:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850688 00000100:00100000:0.0:1782759424.394862:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850688 00000100:00080000:3.0:1782759424.394905:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759424.394937:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1782759424.394946:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232850688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759424.394976:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759424.395022:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232850688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.395028:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1782759424.395070:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232850688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759424.395224:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232850816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759424.395247:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759424.395275:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850816 00000100:00100000:0.0:1782759424.395278:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850816 00000100:00080000:3.0:1782759424.395326:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759424.395329:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1782759424.395336:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232850816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759424.395347:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759424.395393:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232850816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759424.395399:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1782759424.395637:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232850816:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1782759424.912468:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000001:00100000:3.0:1782759424.912478:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759424.912481:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc4598800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:1.0:1782759424.912891:0:62521:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc4598800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:1.0:1782759424.912948:0:62521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cdedb934000 for lustre-OST0001 10000000:01000000:0.0:1782759425.034793:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759425.034801:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759425.034811:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759425.034853:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759425.034866:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759425.034877:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759425.034902:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232850944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759425.034969:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759425.035024:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d089c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759425.035084:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232850944 00000100:00100000:2.0:1782759425.035093:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232850944 00000100:00100000:2.0:1782759425.035181:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:2.0:1782759425.035191:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232850944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759425.035207:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759425.035220:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c1cf expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.035243:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.035254:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759425.035263:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759425.035323:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232850944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.035340:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:1.0:1782759425.035355:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232850944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759425.035375:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.035385:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759425.035402:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759425.035408:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759425.035416:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759425.129961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.130127:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480000 00000100:00100000:2.0:1782759425.130137:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480000 00000100:00100000:2.0:1782759425.130209:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2745 00000100:00100000:2.0:1782759425.130283:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104424:x1869355218480000:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.130375:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104424:x1869355218480000:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 157us (423us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.130383:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2745 00000100:00080000:0.0:1782759425.130504:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759425.161411:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.162339:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480128 00000100:00100000:1.0:1782759425.162350:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480128 00000100:00100000:1.0:1782759425.162412:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2746 00000100:00100000:1.0:1782759425.162422:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104425:x1869355218480128:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.162543:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104425:x1869355218480128:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 122us (1142us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.162560:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2746 00000100:00100000:0.0:1782759425.184048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.184350:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480256 00000100:00100000:1.0:1782759425.184360:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480256 00000100:00100000:1.0:1782759425.184447:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2747 00000100:00100000:1.0:1782759425.184455:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104426:x1869355218480256:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.184528:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104426:x1869355218480256:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 74us (489us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.184533:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2747 00000100:00100000:2.0:1782759425.199872:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.199929:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480384 00000100:00100000:3.0:1782759425.199942:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480384 00000100:00100000:3.0:1782759425.200003:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2748 00000100:00100000:3.0:1782759425.200014:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104427:x1869355218480384:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.200205:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104427:x1869355218480384:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 192us (341us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759425.200213:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2748 00000100:00100000:3.0:1782759425.217271:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.217349:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480512 00000100:00100000:1.0:1782759425.217359:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480512 00000100:00100000:1.0:1782759425.217776:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2749 00000100:00100000:1.0:1782759425.217788:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104428:x1869355218480512:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.219336:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104428:x1869355218480512:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 1543us (2069us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.219347:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2749 00000100:00100000:0.0:1782759425.234938:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.235034:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480640 00000100:00100000:2.0:1782759425.235046:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480640 00000100:00100000:2.0:1782759425.235110:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2750 00000100:00100000:2.0:1782759425.235130:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104429:x1869355218480640:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.235238:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104429:x1869355218480640:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 119us (311us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.235246:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2750 00000100:00100000:2.0:1782759425.255682:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.256461:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480768 00000100:00100000:0.0:1782759425.256473:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480768 00000100:00100000:0.0:1782759425.256618:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2751 00000100:00100000:0.0:1782759425.256629:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218480768:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759425.256738:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218480768:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 111us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.256746:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2751 00000100:00100000:3.0:1782759425.258089:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.258263:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218480896 00000100:00100000:0.0:1782759425.258271:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218480896 00000100:00100000:0.0:1782759425.258329:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1049 00000100:00100000:0.0:1782759425.258338:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104430:x1869355218480896:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759425.258791:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104430:x1869355218480896:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 453us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.258811:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1049 00000100:00100000:1.0:1782759425.261942:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.262031:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481024 00000100:00100000:3.0:1782759425.262040:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481024 00000100:00100000:3.0:1782759425.262097:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2752 00000100:00100000:3.0:1782759425.262108:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218481024:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.262346:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218481024:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 239us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.262367:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2752 00000100:00100000:2.0:1782759425.265827:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.266276:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481152 00000100:00100000:1.0:1782759425.266286:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481152 00000100:00100000:1.0:1782759425.266354:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2753 00000100:00100000:1.0:1782759425.266362:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218481152:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.266750:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218481152:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 387us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.266769:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2753 00000100:00100000:2.0:1782759425.273939:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.274049:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481280 00000100:00100000:3.0:1782759425.274058:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481280 00000100:00100000:3.0:1782759425.274155:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2754 00000100:00100000:3.0:1782759425.274166:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218481280:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.274254:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104430:x1869355218481280:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 90us (324us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759425.274262:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2754 00000100:00100000:0.0:1782759425.286684:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.287140:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481408 00000100:00100000:3.0:1782759425.287150:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481408 00000100:00100000:3.0:1782759425.287209:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2755 00000100:00100000:3.0:1782759425.287228:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481408:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.287346:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481408:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 129us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.287354:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2755 00000100:00100000:2.0:1782759425.291943:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.292002:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481536 00000100:00100000:1.0:1782759425.292012:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481536 00000100:00100000:1.0:1782759425.292074:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1050 00000100:00100000:1.0:1782759425.292082:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104431:x1869355218481536:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759425.292287:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104431:x1869355218481536:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 203us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.292306:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1050 00000100:00100000:2.0:1782759425.293944:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.293995:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481664 00000100:00100000:1.0:1782759425.294002:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481664 00000100:00100000:1.0:1782759425.294060:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2756 00000100:00100000:1.0:1782759425.294070:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481664:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.294260:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481664:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 191us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.294268:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2756 00000100:00100000:0.0:1782759425.296308:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.298359:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481792 00000100:00100000:2.0:1782759425.298372:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481792 00000100:00100000:2.0:1782759425.298425:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2757 00000100:00100000:2.0:1782759425.298433:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481792:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.298621:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481792:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 186us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.298629:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2757 00000100:00100000:2.0:1782759425.303807:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.303862:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218481920 00000100:00100000:3.0:1782759425.303871:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218481920 00000100:00100000:3.0:1782759425.303917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2758 00000100:00100000:3.0:1782759425.303925:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481920:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.303998:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104431:x1869355218481920:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 75us (202us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759425.304004:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2758 00000100:00100000:3.0:1782759425.315070:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.315144:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482048 00000100:00100000:2.0:1782759425.315152:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482048 00000100:00100000:2.0:1782759425.315223:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2759 00000100:00100000:2.0:1782759425.315233:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482048:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.315379:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482048:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 146us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.315387:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2759 00000100:00100000:0.0:1782759425.317347:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.318474:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482176 00000100:00100000:2.0:1782759425.318484:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482176 00000100:00100000:2.0:1782759425.318541:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1051 00000100:00100000:2.0:1782759425.318550:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104432:x1869355218482176:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759425.318751:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104432:x1869355218482176:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 197us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.318759:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1051 00000100:00100000:3.0:1782759425.323631:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.323747:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482304 00000100:00100000:2.0:1782759425.323759:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482304 00000100:00100000:2.0:1782759425.323830:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2760 00000100:00100000:2.0:1782759425.323840:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482304:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.324057:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482304:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 218us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.324065:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2760 00000100:00100000:3.0:1782759425.326427:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.326720:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482432 00000100:00100000:1.0:1782759425.326730:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482432 00000100:00100000:1.0:1782759425.326786:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2761 00000100:00100000:1.0:1782759425.326797:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482432:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.326973:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482432:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 178us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.326980:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2761 00000100:00100000:1.0:1782759425.328683:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.329026:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482560 00000100:00100000:2.0:1782759425.329033:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482560 00000100:00100000:2.0:1782759425.329076:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2762 00000100:00100000:2.0:1782759425.329087:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482560:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.329159:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104432:x1869355218482560:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 74us (481us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.329167:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2762 00000100:00100000:3.0:1782759425.339521:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.339611:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482688 00000100:00100000:2.0:1782759425.339620:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482688 00000100:00100000:2.0:1782759425.339678:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2763 00000100:00100000:2.0:1782759425.339688:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104433:x1869355218482688:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.339783:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104433:x1869355218482688:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 96us (271us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.339792:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2763 00010000:00010000:1.0:1782759425.354726:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759425.354761:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.354933:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482816 00000100:00100000:1.0:1782759425.354942:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482816 00000100:00100000:1.0:1782759425.355002:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2764 00000100:00100000:1.0:1782759425.355019:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104434:x1869355218482816:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.355102:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104434:x1869355218482816:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 92us (359us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.355125:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2764 00000100:00100000:1.0:1782759425.367997:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.368069:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218482944 00000100:00100000:2.0:1782759425.368079:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218482944 00000100:00100000:2.0:1782759425.368153:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2765 00000100:00100000:2.0:1782759425.368169:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104435:x1869355218482944:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.368260:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104435:x1869355218482944:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 93us (273us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.368268:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2765 00000100:00100000:3.0:1782759425.380280:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.380368:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483072 00000100:00100000:0.0:1782759425.380378:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483072 00000100:00100000:0.0:1782759425.380450:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2766 00000100:00100000:0.0:1782759425.380463:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104436:x1869355218483072:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759425.380548:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104436:x1869355218483072:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 88us (275us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759425.380556:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2766 00000100:00100000:3.0:1782759425.391239:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.391408:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483200 00000100:00100000:1.0:1782759425.391418:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483200 00000100:00100000:1.0:1782759425.391568:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2767 00000100:00100000:1.0:1782759425.391614:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104437:x1869355218483200:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.391702:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104437:x1869355218483200:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 90us (471us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.391710:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2767 00000100:00100000:1.0:1782759425.405615:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.405678:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483328 00000100:00100000:2.0:1782759425.405689:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483328 00000100:00100000:2.0:1782759425.405748:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2768 00000100:00100000:2.0:1782759425.405758:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104438:x1869355218483328:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.405840:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104438:x1869355218483328:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 84us (234us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.405857:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2768 00000100:00100000:2.0:1782759425.417636:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.417688:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483456 00000100:00100000:3.0:1782759425.417697:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483456 00000100:00100000:3.0:1782759425.417748:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2769 00000100:00100000:3.0:1782759425.417756:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104439:x1869355218483456:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.417824:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104439:x1869355218483456:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 69us (200us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759425.417830:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2769 00000100:00100000:3.0:1782759425.429038:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.429114:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483584 00000100:00100000:1.0:1782759425.429124:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483584 00000100:00100000:1.0:1782759425.429173:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2770 00000100:00100000:1.0:1782759425.429181:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104440:x1869355218483584:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.429267:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104440:x1869355218483584:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 86us (239us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.429276:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2770 00000100:00100000:1.0:1782759425.439626:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.439768:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483712 00000100:00100000:2.0:1782759425.439778:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483712 00000100:00100000:2.0:1782759425.439840:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2771 00000100:00100000:2.0:1782759425.439850:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104441:x1869355218483712:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.439928:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104441:x1869355218483712:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 80us (312us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.439939:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2771 00000100:00100000:2.0:1782759425.453791:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.457399:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483840 00000100:00100000:3.0:1782759425.457413:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483840 00000100:00100000:3.0:1782759425.457491:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2772 00000100:00100000:3.0:1782759425.457501:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218483840:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.457635:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218483840:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 134us (3852us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.457644:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2772 00000100:00100000:3.0:1782759425.460874:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.460998:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218483968 00000100:00100000:0.0:1782759425.461006:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218483968 00000100:00100000:0.0:1782759425.461063:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1052 00000100:00100000:0.0:1782759425.461074:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104442:x1869355218483968:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759425.461250:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104442:x1869355218483968:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 179us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.461258:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1052 00000100:00100000:1.0:1782759425.462769:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.463149:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484096 00000100:00100000:2.0:1782759425.463158:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484096 00000100:00100000:2.0:1782759425.463210:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1053 00000100:00100000:2.0:1782759425.463225:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484096:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759425.463362:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484096:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 143us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.463368:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1053 00000100:00100000:2.0:1782759425.464751:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759425.465510:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484224 00000100:00100000:3.0:1782759425.465519:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484224 00000100:00100000:3.0:1782759425.465633:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2773 00000100:00100000:3.0:1782759425.465641:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484224:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759425.465747:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484224:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 106us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759425.465766:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2773 00000100:00100000:3.0:1782759425.467000:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.467074:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484352 00000100:00100000:2.0:1782759425.467080:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484352 00000100:00100000:2.0:1782759425.467141:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2774 00000100:00100000:2.0:1782759425.467148:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484352:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.467239:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484352:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.467247:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2774 00000100:00100000:2.0:1782759425.469732:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.469853:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484480 00000100:00100000:0.0:1782759425.469865:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484480 00000100:00100000:0.0:1782759425.469917:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2775 00000100:00100000:0.0:1782759425.469927:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484480:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759425.470001:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104442:x1869355218484480:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 76us (275us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759425.470009:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2775 00000100:00100000:3.0:1782759425.483636:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.483764:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484608 00000100:00100000:1.0:1782759425.483773:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484608 00000100:00100000:1.0:1782759425.483831:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2776 00000100:00100000:1.0:1782759425.483843:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218484608:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.483950:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218484608:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.483969:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2776 00000100:00100000:3.0:1782759425.491236:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.491307:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484736 00000100:00100000:2.0:1782759425.491325:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484736 00000100:00100000:2.0:1782759425.491430:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1054 00000100:00100000:2.0:1782759425.491439:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104443:x1869355218484736:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759425.491565:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104443:x1869355218484736:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 127us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.491570:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1054 00000100:00100000:2.0:1782759425.494348:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.494526:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484864 00000100:00100000:0.0:1782759425.494536:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484864 00000100:00100000:0.0:1782759425.494611:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1055 00000100:00100000:0.0:1782759425.494621:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218484864:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:0.0:1782759425.494857:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218484864:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 237us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.494864:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1055 00000100:00100000:3.0:1782759425.496523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.496867:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218484992 00000100:00100000:1.0:1782759425.496876:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218484992 00000100:00100000:1.0:1782759425.496979:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2777 00000100:00100000:1.0:1782759425.496989:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218484992:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.497112:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218484992:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 124us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.497120:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2777 00000100:00100000:3.0:1782759425.498392:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.498537:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485120 00000100:00100000:2.0:1782759425.498544:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485120 00000100:00100000:2.0:1782759425.498614:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2778 00000100:00100000:2.0:1782759425.498624:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218485120:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.498733:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218485120:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 109us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.498741:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2778 00000100:00100000:3.0:1782759425.500306:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.500804:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485248 00000100:00100000:1.0:1782759425.500813:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485248 00000100:00100000:1.0:1782759425.500917:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2779 00000100:00100000:1.0:1782759425.500939:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218485248:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.501013:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104443:x1869355218485248:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 87us (725us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.501021:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2779 00000100:00100000:3.0:1782759425.515526:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.515619:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485376 00000100:00100000:2.0:1782759425.515627:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485376 00000100:00100000:2.0:1782759425.515675:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2780 00000100:00100000:2.0:1782759425.515685:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485376:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.515783:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485376:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.515788:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2780 00000100:00100000:2.0:1782759425.518519:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.518629:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485504 00000100:00100000:1.0:1782759425.518638:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485504 00000100:00100000:1.0:1782759425.518746:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1056 00000100:00100000:1.0:1782759425.518757:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104444:x1869355218485504:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:1.0:1782759425.518887:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:104444:x1869355218485504:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 131us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.518895:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1056 00000100:00100000:3.0:1782759425.520271:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.520359:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485632 00000100:00100000:2.0:1782759425.520366:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485632 00000100:00100000:2.0:1782759425.520423:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1057 00000100:00100000:2.0:1782759425.520432:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485632:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:2.0:1782759425.520999:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485632:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 565us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.521008:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1057 00000100:00100000:3.0:1782759425.521967:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.522018:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485760 00000100:00100000:0.0:1782759425.522024:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485760 00000100:00100000:0.0:1782759425.522069:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2781 00000100:00100000:0.0:1782759425.522080:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485760:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759425.522180:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485760:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 102us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759425.522185:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2781 00000100:00100000:3.0:1782759425.523324:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.523384:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218485888 00000100:00100000:1.0:1782759425.523391:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218485888 00000100:00100000:1.0:1782759425.523440:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2782 00000100:00100000:1.0:1782759425.523464:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485888:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.523564:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218485888:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 102us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.523571:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2782 00000100:00100000:3.0:1782759425.527961:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.528061:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486016 00000100:00100000:2.0:1782759425.528070:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486016 00000100:00100000:2.0:1782759425.528127:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2783 00000100:00100000:2.0:1782759425.528139:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218486016:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.528221:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104444:x1869355218486016:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 85us (270us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759425.528229:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2783 00000100:00100000:3.0:1782759425.538321:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.538492:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486144 00000100:00100000:2.0:1782759425.538503:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486144 00000100:00100000:2.0:1782759425.538569:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2784 00000100:00100000:2.0:1782759425.538602:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104445:x1869355218486144:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.538709:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104445:x1869355218486144:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 132us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.538716:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2784 00000100:00100000:3.0:1782759425.540460:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.540536:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486272 00000100:00100000:1.0:1782759425.540545:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486272 00000100:00100000:1.0:1782759425.540613:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2785 00000100:00100000:1.0:1782759425.540624:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104445:x1869355218486272:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.540696:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104445:x1869355218486272:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 74us (239us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.540703:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2785 00000100:00100000:3.0:1782759425.554763:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759425.554834:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486400 00000100:00100000:2.0:1782759425.554844:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486400 00000100:00100000:2.0:1782759425.554905:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2786 00000100:00100000:2.0:1782759425.554917:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104446:x1869355218486400:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759425.555019:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104446:x1869355218486400:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759425.555041:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2786 00000100:00100000:3.0:1782759425.556751:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759425.556917:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486528 00000100:00100000:0.0:1782759425.556926:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486528 00000100:00100000:0.0:1782759425.556983:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2787 00000100:00100000:0.0:1782759425.556994:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104446:x1869355218486528:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759425.557117:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104446:x1869355218486528:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 125us (375us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759425.557125:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2787 00000100:00100000:3.0:1782759425.569737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.569884:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486656 00000100:00100000:1.0:1782759425.569894:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486656 00000100:00100000:1.0:1782759425.569994:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2788 00000100:00100000:1.0:1782759425.570006:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104447:x1869355218486656:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.570110:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104447:x1869355218486656:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 106us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759425.570118:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2788 00000100:00100000:3.0:1782759425.572913:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759425.573001:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486784 00000100:00100000:1.0:1782759425.573011:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486784 00000100:00100000:1.0:1782759425.573065:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2789 00000100:00100000:1.0:1782759425.573076:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104447:x1869355218486784:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759425.573156:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104447:x1869355218486784:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 82us (251us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759425.573164:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2789 00010000:00010000:3.0:1782759426.379652:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759426.431270:0:141152:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc71f8e990 20000000:00000080:0.0:1782759426.431297:0:141152:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3c29800 uarg=0000000000000000 00010000:00010000:0.0:1782759426.432189:0:141152:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759426.432208:0:141152:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759426.432234:0:141152:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759426.432259:0:141152:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759426.432321:0:141152:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759426.432342:0:141152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759426.432361:0:141152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759426.432370:0:141152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759426.432410:0:141152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759426.432424:0:141152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 23 pid: 6526 timeout: 3616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759426.432439:0:141152:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141152:1869355232851072:0@lo:104: 00000100:00100000:0.0:1782759426.432504:0:141152:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759426.432560:0:141152:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759426.433398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851072 00000100:00100000:3.0:1782759426.433404:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851072 00000100:00100000:3.0:1782759426.433449:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1782759426.433458:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:141152:x1869355232851072:12345-0@lo:104: 00010000:00010000:3.0:1782759426.433472:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759426.433526:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759426.433537:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:141152:x1869355232851072:12345-0@lo:104: Request processed in 81us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759426.433544:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00010000:00010000:2.0:1782759426.433550:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759426.433559:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759426.433567:0:141152:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141152:1869355232851072:0@lo:104: 00010000:00010000:2.0:1782759426.433570:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759426.433600:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759426.433611:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759426.433621:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759426.433621:0:141152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759426.433641:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759426.433678:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759426.433685:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759426.433710:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759426.433717:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c1cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1d6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759426.433732:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759426.433734:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759426.433736:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759426.433752:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759426.433764:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232851200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759426.433802:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759426.433840:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851200 00000100:00100000:1.0:1782759426.433846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851200 00010000:00010000:1.0:1782759426.433868:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 24 pid: 6526 timeout: 3616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759426.433895:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1782759426.433902:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232851200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759426.433913:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759426.433918:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 24 pid: 6526 timeout: 3616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433928:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 24 pid: 6526 timeout: 3616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433941:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c1d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1cf expref: 24 pid: 6526 timeout: 3616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433954:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433963:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433976:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433983:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.433990:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.434007:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.434013:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759426.434017:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.434024:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.434041:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.434050:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759426.434067:0:141152:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759426.434078:0:141152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759426.434086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232851200:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759426.434089:0:141152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c1dd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759426.434113:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1782759426.434116:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232851200:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1782759426.835400:0:141201:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdfcbc5680 20000000:00000080:1.0:1782759426.835419:0:141201:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4848800 uarg=0000000000000000 00010000:00010000:1.0:1782759426.835640:0:141201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759426.835656:0:141201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759426.835679:0:141201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759426.835690:0:141201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759426.835710:0:141201:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759426.835732:0:141201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.835747:0:141201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.835765:0:141201:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836333:0:141201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836342:0:141201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836349:0:141201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836355:0:141201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759426.836360:0:141201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836368:0:141201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836382:0:141201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836389:0:141201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759426.836395:0:141201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c1e4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759426.957715:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232851328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759426.957794:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759426.957941:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851328 00000100:00100000:1.0:1782759426.957948:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851328 00000100:00100000:1.0:1782759426.958016:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132 00000100:00100000:1.0:1782759426.958025:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232851328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759426.958058:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445810176 avail 1299570688 00000100:00100000:1.0:1782759426.958179:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232851328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759426.958186:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132 00000100:00100000:3.0:1782759426.958265:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232851328:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759427.295759:0:141249:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8c032830 20000000:00000080:1.0:1782759427.295775:0:141249:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc484a800 uarg=0000000000000000 00010000:00010000:1.0:1782759427.295954:0:141249:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759427.295966:0:141249:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759427.295978:0:141249:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759427.295985:0:141249:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759427.296000:0:141249:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759427.296015:0:141249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296028:0:141249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296035:0:141249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296039:0:141249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296043:0:141249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296048:0:141249:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296059:0:141249:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759427.296063:0:141249:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296068:0:141249:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296077:0:141249:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296081:0:141249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.296086:0:141249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c1eb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759427.402717:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759427.739517:0:141297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe272a0af0 20000000:00000080:3.0:1782759427.739532:0:141297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd7e6000 uarg=0000000000000000 00010000:00010000:3.0:1782759427.739767:0:141297:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759427.739782:0:141297:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759427.739801:0:141297:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759427.739812:0:141297:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759427.739828:0:141297:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759427.739846:0:141297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739861:0:141297:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739871:0:141297:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739878:0:141297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739891:0:141297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739898:0:141297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739904:0:141297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759427.739908:0:141297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739916:0:141297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739928:0:141297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739935:0:141297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759427.739943:0:141297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c1f2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759427.978886:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232851456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.978956:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.978998:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232851968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979024:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979043:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232852480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979066:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979082:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232852992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979103:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979124:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759427.979130:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232851840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979154:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979171:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232852352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979190:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979206:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232852864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979226:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979264:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232851584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979295:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979311:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232852096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979329:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979342:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232852608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979358:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979378:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759427.979383:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232851712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979411:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979428:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232852224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979447:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979462:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232852736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979481:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759427.979511:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851456 00000100:00100000:0.0:1782759427.979519:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851456 00000100:00100000:0.0:1782759427.979562:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:0.0:1782759427.979570:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232851456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979634:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232851456:12345-0@lo:400:kworker.0 Request processed in 65us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.979641:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00100000:0.0:1782759427.979671:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851968 00000100:00100000:0.0:1782759427.979674:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851968 00000100:00100000:0.0:1782759427.979746:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851712 00000100:00100000:0.0:1782759427.979748:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851712 00000100:00100000:0.0:1782759427.979763:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133 00000100:00100000:0.0:1782759427.979768:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232851968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979798:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232851968:12345-0@lo:400:kworker.0 Request processed in 29us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.979803:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133 00000100:00100000:0.0:1782759427.979813:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3134 00000100:00100000:0.0:1782759427.979818:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232851712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979845:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232851712:12345-0@lo:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.979849:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3134 00000100:00100000:0.0:1782759427.979872:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852480 00000100:00100000:0.0:1782759427.979874:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852480 00000100:00100000:0.0:1782759427.979903:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852992 00000100:00100000:0.0:1782759427.979905:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852992 00000100:00100000:0.0:1782759427.979914:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852352 00000100:00100000:0.0:1782759427.979916:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852352 00000100:00100000:0.0:1782759427.979926:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852864 00000100:00100000:0.0:1782759427.979928:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852864 00000100:00100000:0.0:1782759427.979939:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1782759427.979944:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.979972:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232852480:12345-0@lo:400:kworker.0 Request processed in 28us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.979977:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1782759427.979987:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1782759427.979992:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232852992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980014:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232852992:12345-0@lo:400:kworker.0 Request processed in 23us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980019:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1782759427.980029:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1782759427.980034:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980055:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232852352:12345-0@lo:400:kworker.0 Request processed in 22us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980060:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:0.0:1782759427.980070:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1782759427.980075:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232852864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980097:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232852864:12345-0@lo:400:kworker.0 Request processed in 23us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980112:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1782759427.980132:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851840 00000100:00100000:0.0:1782759427.980136:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851840 00000100:00100000:0.0:1782759427.980151:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232851584 00000100:00100000:0.0:1782759427.980153:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232851584 00000100:00100000:0.0:1782759427.980162:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852096 00000100:00100000:0.0:1782759427.980164:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852096 00000100:00100000:0.0:1782759427.980174:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852608 00000100:00100000:0.0:1782759427.980177:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852608 00000100:00100000:0.0:1782759427.980187:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852224 00000100:00100000:0.0:1782759427.980189:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852224 00000100:00100000:0.0:1782759427.980197:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232852736 00000100:00100000:0.0:1782759427.980199:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232852736 00000100:00100000:0.0:1782759427.980210:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4916 00000100:00100000:0.0:1782759427.980216:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232851840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980243:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232851840:12345-0@lo:400:kworker.0 Request processed in 27us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980249:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4916 00000100:00100000:0.0:1782759427.980259:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4917 00000100:00100000:0.0:1782759427.980264:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232851584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980300:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232851584:12345-0@lo:400:kworker.0 Request processed in 35us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980305:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4917 00000100:00100000:0.0:1782759427.980316:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:0.0:1782759427.980322:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980347:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232852096:12345-0@lo:400:kworker.0 Request processed in 25us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980352:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00000100:00100000:0.0:1782759427.980369:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:0.0:1782759427.980374:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232852608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980400:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232852608:12345-0@lo:400:kworker.0 Request processed in 25us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980405:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00100000:0.0:1782759427.980416:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00000100:00100000:0.0:1782759427.980423:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232852224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980447:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232852224:12345-0@lo:400:kworker.0 Request processed in 26us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980451:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00000100:00100000:0.0:1782759427.980460:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:0.0:1782759427.980465:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232852736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980488:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232852736:12345-0@lo:400:kworker.0 Request processed in 23us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759427.980493:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00000100:00080000:0.0:1782759427.980535:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759427.980539:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759427.980541:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759427.980543:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759427.980573:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232851712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980608:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232852224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980618:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232852736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980628:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232851584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980637:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232852096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980658:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232852608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980703:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232851840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980712:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232852352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980720:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232852864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980728:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232851456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980736:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232851968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980745:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232852480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759427.980753:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232852992:0@lo:400:kworker.0 00000100:00100000:2.0:1782759427.980896:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759427.980911:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759427.980940:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759427.980965:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853120 00000100:00100000:2.0:1782759427.980969:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853120 00000100:00100000:2.0:1782759427.980997:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:2.0:1782759427.981003:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232853120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759427.981022:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759427.981054:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232853120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759427.981059:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:2.0:1782759427.981087:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232853120:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1782759428.042699:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759428.042707:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759428.042712:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759428.042769:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759428.042782:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759428.042793:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759428.042818:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232853248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759428.042899:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759428.042985:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759428.044258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853248 00000100:00100000:3.0:1782759428.044278:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853248 00000100:00100000:3.0:1782759428.044375:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:3.0:1782759428.044386:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232853248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759428.044402:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759428.044419:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c1f9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.044454:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.044465:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.044475:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5a00, rc 0) 00000100:00100000:3.0:1782759428.044531:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232853248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759428.044537:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:1.0:1782759428.044625:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232853248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759428.044640:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759428.044648:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759428.044665:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759428.044670:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759428.044677:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759428.426775:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759428.491417:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232853376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759428.491493:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759428.491655:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853376 00000100:00100000:2.0:1782759428.491665:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853376 00000100:00100000:2.0:1782759428.491726:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1782759428.491736:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232853376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759428.491758:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759428.491805:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232853376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759428.491812:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1782759428.491856:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232853376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759429.004240:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759429.004270:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232853504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759429.004330:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759429.004367:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853504 00000100:00100000:3.0:1782759429.004375:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853504 00000100:00100000:3.0:1782759429.004442:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135 00000100:00100000:3.0:1782759429.004451:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232853504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759429.004492:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:3.0:1782759429.004536:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232853504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759429.004543:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135 00000100:00100000:0.0:1782759429.004640:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232853504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759429.343159:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759429.343242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759429.343282:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759429.343308:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759429.343332:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759429.343360:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487040 00000100:00100000:1.0:1782759429.343369:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487040 00000100:00100000:1.0:1782759429.343427:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487168 00000100:00100000:1.0:1782759429.343431:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487168 00000100:00100000:1.0:1782759429.343456:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4922 00000100:00100000:1.0:1782759429.343466:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218487040:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759429.343539:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218487040:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759429.343557:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4922 00000100:00100000:1.0:1782759429.343591:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4923 00000100:00100000:1.0:1782759429.343599:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218487168:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759429.343627:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218487168:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759429.343634:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4923 00000100:00100000:1.0:1782759429.343652:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487296 00000100:00100000:1.0:1782759429.343655:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487296 00000100:00100000:1.0:1782759429.343682:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487424 00000100:00100000:1.0:1782759429.343685:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487424 00000100:00100000:1.0:1782759429.343706:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2822 00000100:00100000:1.0:1782759429.343713:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218487296:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759429.343738:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218487296:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759429.343744:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2822 00000100:00100000:1.0:1782759429.343756:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2823 00000100:00100000:1.0:1782759429.343762:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218487424:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759429.343784:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218487424:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759429.343791:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2823 00000100:00080000:1.0:1782759429.343809:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759429.343813:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759429.343816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759429.343818:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759429.344544:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218486912 00000100:00100000:2.0:1782759429.344550:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218486912 00000100:00100000:2.0:1782759429.344592:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3079 00000100:00100000:2.0:1782759429.344598:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218486912:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759429.344642:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218486912:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759429.344661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3079 00010000:00010000:2.0:1782759429.450750:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759429.518206:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759429.518229:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232853632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759429.518308:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759429.518388:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853632 00000100:00100000:2.0:1782759429.518395:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853632 00000100:00100000:2.0:1782759429.518455:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1782759429.518465:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232853632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759429.518495:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759429.518538:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232853632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759429.518546:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00080000:2.0:1782759429.518571:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759429.518626:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232853632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759429.520735:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232853760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759429.520844:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759429.521801:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853760 00000100:00100000:2.0:1782759429.521809:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853760 00000100:00100000:2.0:1782759429.521866:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1782759429.521875:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232853760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759429.521897:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1782759429.521997:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759429.522362:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232853760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 488us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759429.522455:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232853760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759429.522506:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000020:00000080:0.0:1782759429.711906:0:141492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed2766c50 20000000:00000080:0.0:1782759429.711923:0:141492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4540c00 uarg=0000000000000000 10000000:01000000:0.0:1782759429.712084:0:141492:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759429.712104:0:141492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.712122:0:141492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.712141:0:141492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.712181:0:141492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.712196:0:141492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 23 pid: 6525 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759429.712210:0:141492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141492:1869355232853888:0@lo:104: 00000100:00100000:0.0:1782759429.712280:0:141492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759429.712768:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232853888 00000100:00100000:2.0:1782759429.712776:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232853888 00000100:00100000:2.0:1782759429.712831:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:2.0:1782759429.712849:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:141492:x1869355232853888:12345-0@lo:104: 00010000:00010000:2.0:1782759429.712861:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759429.714016:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759429.714027:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:141492:x1869355232853888:12345-0@lo:104: Request processed in 1179us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759429.714037:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00010000:00010000:3.0:1782759429.714057:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759429.714068:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714078:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759429.714082:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714106:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759429.714114:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759429.714120:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759429.714155:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714162:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759429.714187:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714197:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428200/0xd5b45c7f5c60c1f9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c200 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714212:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759429.714213:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759429.714215:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759429.714223:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759429.714239:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232854016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759429.714290:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759429.714442:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854016 00000100:00100000:3.0:1782759429.714446:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854016 00010000:00010000:3.0:1782759429.714467:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 6/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 24 pid: 6525 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759429.714486:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1782759429.714492:0:141492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759429.714493:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232854016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759429.714505:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759429.714509:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 24 pid: 6525 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714521:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 24 pid: 6525 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759429.714529:0:141492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141492:1869355232853888:0@lo:104: 00010000:00010000:3.0:1782759429.714533:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c200 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1f9 expref: 24 pid: 6525 timeout: 3619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714546:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714553:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714563:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.714563:0:141492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714601:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714617:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714624:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.714852:0:141492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759429.714861:0:141492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714918:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759429.714923:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714931:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714951:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714959:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c207 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759429.714972:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759429.715023:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232854016:12345-0@lo:103:ldlm_bl.0 Request processed in 529us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759429.715030:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1782759429.715304:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232854016:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1782759430.138242:0:141540:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeee62eb80 20000000:00000080:0.0:1782759430.138266:0:141540:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4540c00 uarg=0000000000000000 10000000:01000000:0.0:1782759430.138468:0:141540:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759430.138488:0:141540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138503:0:141540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138518:0:141540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138524:0:141540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138531:0:141540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138538:0:141540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138544:0:141540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759430.138547:0:141540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138554:0:141540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138566:0:141540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.138572:0:141540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.139018:0:141540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc600/0xd5b45c7f5c60c20e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759430.474876:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759430.594891:0:141588:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd145daa70 20000000:00000080:0.0:1782759430.594908:0:141588:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4542c00 uarg=0000000000000000 00010000:00010000:0.0:1782759430.595066:0:141588:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759430.595077:0:141588:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759430.595090:0:141588:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759430.595096:0:141588:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759430.595110:0:141588:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759430.595124:0:141588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595137:0:141588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595144:0:141588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595149:0:141588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595153:0:141588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595157:0:141588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595161:0:141588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759430.595164:0:141588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595169:0:141588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595176:0:141588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595186:0:141588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759430.595190:0:141588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c215 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.498786:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759431.498857:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759431.498862:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759431.498867:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759431.498913:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.498925:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.498937:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759431.498966:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232854144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759431.499049:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759431.499115:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2629000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759431.499235:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854144 00000100:00100000:2.0:1782759431.499254:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854144 00000100:00100000:2.0:1782759431.499330:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3080 00000100:00100000:2.0:1782759431.499343:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232854144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759431.499356:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759431.499370:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c21c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.499409:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.499420:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759431.499429:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759431.499476:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232854144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759431.499483:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3080 00000100:00100000:3.0:1782759431.499789:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232854144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759431.499801:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.499813:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759431.499830:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759431.499834:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759431.499839:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759432.075848:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232854272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759432.075927:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759432.075966:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854272 00000100:00100000:0.0:1782759432.075975:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854272 00000100:00100000:0.0:1782759432.076042:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:0.0:1782759432.076054:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232854272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759432.076086:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445810176 avail 1299570688 00000100:00100000:0.0:1782759432.076154:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232854272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759432.076162:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:2.0:1782759432.076625:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232854272:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759432.523816:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759432.545077:0:141783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd4e25840 20000000:00000080:2.0:1782759432.545094:0:141783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf746800 uarg=0000000000000000 00010000:00010000:2.0:1782759432.545319:0:141783:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759432.545334:0:141783:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759432.545356:0:141783:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759432.545367:0:141783:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759432.545389:0:141783:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759432.545406:0:141783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759432.545422:0:141783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759432.545430:0:141783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759432.545468:0:141783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759432.545482:0:141783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 23 pid: 6525 timeout: 3622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759432.545497:0:141783:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141783:1869355232854400:0@lo:104: 00000100:00100000:2.0:1782759432.545568:0:141783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759432.545655:0:141783:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759432.545670:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759432.545681:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854400 00000100:00100000:0.0:1782759432.545686:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854400 00000100:00100000:0.0:1782759432.545727:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:0.0:1782759432.545734:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf628850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:141783:x1869355232854400:12345-0@lo:104: 00010000:00010000:0.0:1782759432.545744:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759432.545787:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759432.545791:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf628850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:141783:x1869355232854400:12345-0@lo:104: Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759432.545796:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00010000:00010000:3.0:1782759432.545819:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759432.545823:0:141783:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141783:1869355232854400:0@lo:104: 00010000:00010000:3.0:1782759432.545829:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.545839:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc133cc20) 00010000:00010000:2.0:1782759432.545845:0:141783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759432.545846:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.545855:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759432.545865:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759432.545871:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759432.545905:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.545922:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759432.545953:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.545961:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c21c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c223 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759432.545973:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1782759432.545976:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759432.545979:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759432.545981:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759432.545988:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232854528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759432.546017:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759432.546127:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854528 00000100:00100000:3.0:1782759432.546133:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854528 00010000:00010000:3.0:1782759432.546152:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 24 pid: 6525 timeout: 3622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759432.546217:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1782759432.546225:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232854528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759432.546246:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759432.546252:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 24 pid: 6525 timeout: 3622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546263:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 24 pid: 6525 timeout: 3622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546277:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c223 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c21c expref: 24 pid: 6525 timeout: 3622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546298:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546317:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546330:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546336:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546342:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546348:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546353:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759432.546357:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546363:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546383:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759432.546393:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759432.546419:0:141783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759432.546429:0:141783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759432.546436:0:141783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c22a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759432.546447:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232854528:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759432.546456:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1782759432.546532:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232854528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759433.100746:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232854784:0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.100831:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.100884:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232855296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.100892:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854784 00000100:00100000:2.0:1782759433.100899:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854784 00000100:00100000:0.0:1782759433.100907:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.100931:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232855808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.100948:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.100953:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855296 00000100:00100000:2.0:1782759433.100955:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855296 00000100:00100000:0.0:1782759433.100964:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232856320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759433.100979:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855808 00000100:00100000:2.0:1782759433.100982:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855808 00000100:00100000:0.0:1782759433.100989:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.101004:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4924 00000100:00100000:0.0:1782759433.101004:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1782759433.101009:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232854656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.101012:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232854784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101031:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.101049:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232855168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.101056:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232854784:12345-0@lo:400:kworker.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759433.101063:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4924 00000100:00100000:0.0:1782759433.101068:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.101079:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925 00000100:00100000:0.0:1782759433.101082:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232855680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.101086:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232855296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101102:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.101107:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232855296:12345-0@lo:400:kworker.0 Request processed in 24us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759433.101116:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232856192:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.101122:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925 00000100:00100000:0.0:1782759433.101132:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.101133:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4926 00000100:00100000:2.0:1782759433.101140:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232855808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101158:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232854784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.101162:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232855808:12345-0@lo:400:kworker.0 Request processed in 25us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759433.101167:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4926 00000100:00100000:0.0:1782759433.101168:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232855296:0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101175:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232855808:0@lo:400:kworker.0 00000100:00080000:2.0:1782759433.101183:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759433.101193:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856320 00000100:00100000:2.0:1782759433.101195:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856320 00000100:00100000:0.0:1782759433.101197:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232855040:0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101218:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.101219:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1782759433.101238:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232856320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759433.101243:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232855552:0@lo:400:kworker.0 00002000:00000024:2.0:1782759433.101258:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759433.101270:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.101283:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232856064:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.101292:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232856320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759433.101297:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:0.0:1782759433.101300:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.101313:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759433.101318:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232854912:0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101336:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.101347:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232855424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759433.101363:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.101370:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232855936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101469:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855040 00000100:00100000:1.0:1782759433.101474:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855040 00000100:00100000:1.0:1782759433.101499:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855424 00000100:00100000:1.0:1782759433.101502:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855424 00000100:00100000:1.0:1782759433.101525:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4927 00000100:00100000:2.0:1782759433.101533:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4928 00000100:00100000:1.0:1782759433.101535:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232855040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101596:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232855040:12345-0@lo:400:kworker.0 Request processed in 42us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.101604:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4927 00000100:00100000:3.0:1782759433.101614:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854656 00000100:00100000:3.0:1782759433.101623:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854656 00000100:00100000:1.0:1782759433.101635:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855680 00000100:00100000:1.0:1782759433.101641:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855680 00000100:00100000:3.0:1782759433.101654:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3081 00000100:00100000:3.0:1782759433.101663:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232854656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101673:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856192 00000100:00100000:1.0:1782759433.101677:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856192 00000100:00100000:1.0:1782759433.101694:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855552 00000100:00100000:1.0:1782759433.101697:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855552 00000100:00100000:3.0:1782759433.101699:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232854656:12345-0@lo:400:kworker.0 Request processed in 38us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759433.101707:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3081 00000100:00100000:1.0:1782759433.101712:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856064 00000100:00100000:1.0:1782759433.101716:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856064 00000100:00080000:3.0:1782759433.101731:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759433.101736:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759433.101740:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00080000:3.0:1782759433.101741:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759433.101750:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232855680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759433.101772:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232854656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101791:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232855680:12345-0@lo:400:kworker.0 Request processed in 42us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759433.101793:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232856320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759433.101807:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:3.0:1782759433.101814:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232855680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101824:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:1.0:1782759433.101832:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232856192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101875:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232856192:12345-0@lo:400:kworker.0 Request processed in 44us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.101880:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:1.0:1782759433.101889:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:1.0:1782759433.101895:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232855552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759433.101921:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232856192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101926:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232855552:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.101934:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:1.0:1782759433.101948:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:1.0:1782759433.101954:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232856064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.101980:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232856064:12345-0@lo:400:kworker.0 Request processed in 27us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.101985:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:1.0:1782759433.102022:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855168 00000100:00100000:1.0:1782759433.102025:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855168 00000100:00100000:1.0:1782759433.102073:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232854912 00000100:00100000:1.0:1782759433.102076:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232854912 00000100:00100000:1.0:1782759433.102098:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1782759433.102108:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232855168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.102153:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232855168:12345-0@lo:400:kworker.0 Request processed in 47us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.102160:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1782759433.102186:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:1.0:1782759433.102196:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232854912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.102261:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232854912:12345-0@lo:400:kworker.0 Request processed in 67us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.102268:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00100000:1.0:1782759433.102321:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232855168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.102626:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232855424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.102659:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232855424:12345-0@lo:400:kworker.0 Request processed in 40us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759433.102664:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4928 00000100:00100000:0.0:1782759433.104325:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759433.104399:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232855936 00000100:00100000:2.0:1782759433.104408:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232855936 00000100:00100000:1.0:1782759433.104433:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232855040:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.104451:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232855552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.104462:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232856064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.104489:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232854912:0@lo:400:kworker.0 00000100:00100000:1.0:1782759433.104500:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232855424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.104517:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4929 00000100:00100000:2.0:1782759433.104529:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232855936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759433.104613:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232855936:12345-0@lo:400:kworker.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759433.104631:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4929 00000100:00100000:1.0:1782759433.104747:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232855936:0@lo:400:kworker.0 00000100:00080000:3.0:1782759433.104778:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782759433.547162:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759433.611387:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759433.611410:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232856448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759433.611475:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.611778:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856448 00000100:00100000:0.0:1782759433.611786:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856448 00000100:00100000:0.0:1782759433.611994:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1782759433.612003:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232856448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759433.612026:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759433.612080:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232856448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759433.612087:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1782759433.612738:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232856448:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1782759433.803476:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759433.803484:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759433.803488:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759433.803529:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.803553:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.803564:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759433.803609:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232856576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759433.803675:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759433.803727:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759433.803787:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856576 00000100:00100000:1.0:1782759433.803794:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856576 00000100:00100000:1.0:1782759433.803851:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:1.0:1782759433.803861:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232856576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759433.803875:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759433.803892:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c231 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.803916:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.803936:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759433.803945:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428600, rc 0) 00000100:00100000:1.0:1782759433.803981:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232856576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759433.803987:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000100:00100000:0.0:1782759433.804076:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232856576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759433.804089:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.804097:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759433.804113:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759433.804119:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759433.804125:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759434.092673:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759434.092786:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487552 00000100:00100000:2.0:1782759434.092796:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487552 00000100:00100000:2.0:1782759434.092866:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2790 00000100:00100000:2.0:1782759434.092887:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104719:x1869355218487552:12345-192.168.202.31@tcp:48:lfs.0 00000100:00080000:3.0:1782759434.093059:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759434.097407:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104719:x1869355218487552:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4520us (4731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759434.097422:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2790 00000100:00100000:3.0:1782759434.113976:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759434.114068:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487680 00000100:00100000:2.0:1782759434.114080:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487680 00000100:00100000:2.0:1782759434.114147:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2791 00000100:00100000:2.0:1782759434.114157:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104720:x1869355218487680:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759434.120954:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104720:x1869355218487680:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 6792us (6979us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759434.120966:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2791 00000100:00100000:0.0:1782759434.122962:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232856704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759434.123027:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759434.123056:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856704 00000100:00100000:1.0:1782759434.123063:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856704 00000100:00100000:1.0:1782759434.123158:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3139 00000100:00100000:1.0:1782759434.123168:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232856704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759434.123200:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:1.0:1782759434.127376:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232856704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4202us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759434.127392:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3139 00000100:00100000:0.0:1782759434.127744:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232856704:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759434.133773:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759434.133813:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487808 00000100:00100000:2.0:1782759434.133822:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487808 00000100:00100000:2.0:1782759434.133876:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2792 00000100:00100000:2.0:1782759434.133884:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104721:x1869355218487808:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759434.141003:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104721:x1869355218487808:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 7108us (7228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759434.141019:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2792 00000100:00100000:1.0:1782759434.153468:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759434.153667:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218487936 00000100:00100000:2.0:1782759434.153679:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218487936 00000100:00100000:3.0:1782759434.153759:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2793 00000100:00100000:3.0:1782759434.153768:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104722:x1869355218487936:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759434.157385:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104722:x1869355218487936:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3607us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759434.157399:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2793 00000100:00100000:3.0:1782759434.167499:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759434.167566:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488064 00000100:00100000:2.0:1782759434.167606:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488064 00000100:00100000:3.0:1782759434.167738:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2794 00000100:00100000:3.0:1782759434.167750:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104723:x1869355218488064:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759434.171152:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104723:x1869355218488064:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 3395us (3654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759434.171174:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2794 00000100:00100000:3.0:1782759434.179203:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759434.179284:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488192 00000100:00100000:0.0:1782759434.179295:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488192 00000100:00100000:0.0:1782759434.179347:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2795 00000100:00100000:0.0:1782759434.179358:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104724:x1869355218488192:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759434.184293:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104724:x1869355218488192:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 4927us (5093us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759434.184308:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2795 00000100:00100000:3.0:1782759434.460487:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759434.460523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759434.460550:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759434.460609:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759434.460647:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488576 00000100:00100000:3.0:1782759434.460657:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488576 00000100:00100000:3.0:1782759434.460715:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488704 00000100:00100000:3.0:1782759434.460719:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488704 00000100:00100000:3.0:1782759434.460748:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2828 00000100:00100000:3.0:1782759434.460759:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218488576:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759434.460842:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218488576:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759434.460850:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2828 00000100:00100000:3.0:1782759434.460868:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2829 00000100:00100000:3.0:1782759434.460876:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218488704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759434.460906:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218488704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759434.460913:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2829 00000100:00100000:3.0:1782759434.460935:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488448 00000100:00100000:3.0:1782759434.460939:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488448 00000100:00100000:3.0:1782759434.460967:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4930 00000100:00100000:3.0:1782759434.460975:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218488448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759434.461004:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218488448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759434.461017:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4930 00000100:00080000:3.0:1782759434.461041:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759434.461045:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759434.461047:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759434.461360:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488320 00000100:00100000:0.0:1782759434.461365:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488320 00000100:00100000:0.0:1782759434.461400:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3083 00000100:00100000:0.0:1782759434.461409:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218488320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759434.461445:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218488320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759434.461453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3083 00010000:00010000:0.0:1782759434.570818:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759434.618490:0:141979:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe90b209c0 20000000:00000080:0.0:1782759434.618507:0:141979:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4543800 uarg=0000000000000000 00010000:00010000:0.0:1782759434.618717:0:141979:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759434.618734:0:141979:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759434.618758:0:141979:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759434.618770:0:141979:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759434.618789:0:141979:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759434.618807:0:141979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.618824:0:141979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.618833:0:141979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.618880:0:141979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.618894:0:141979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 23 pid: 6525 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759434.618909:0:141979:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141979:1869355232856832:0@lo:104: 00000100:00100000:0.0:1782759434.618965:0:141979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759434.619019:0:141979:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc263a840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759434.619084:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856832 00000100:00100000:1.0:1782759434.619091:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856832 00000100:00100000:1.0:1782759434.619136:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:1.0:1782759434.619145:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:141979:x1869355232856832:12345-0@lo:104: 00010000:00010000:1.0:1782759434.619157:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759434.619262:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759434.619268:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:141979:x1869355232856832:12345-0@lo:104: Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759434.619275:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00010000:00010000:3.0:1782759434.619294:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759434.619302:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.619311:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759434.619314:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.619323:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759434.619328:0:141979:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:141979:1869355232856832:0@lo:104: 10000000:00010000:3.0:1782759434.619331:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759434.619339:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759434.619345:0:141979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.619382:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.619390:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759434.619427:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759434.619429:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232856960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759434.619441:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c231 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c238 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759434.619464:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759434.619464:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759434.619474:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759434.619477:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759434.619527:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232856960 00000100:00100000:0.0:1782759434.619531:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232856960 00010000:00010000:0.0:1782759434.619547:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 24 pid: 6525 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759434.619647:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1782759434.619655:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232856960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759434.619665:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759434.619672:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 24 pid: 6525 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619682:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 24 pid: 6525 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619694:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60c238 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c231 expref: 24 pid: 6525 timeout: 3624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619712:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619719:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619731:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619738:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619744:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619750:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619755:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759434.619759:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619766:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619782:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759434.619791:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759434.619812:0:141979:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759434.619832:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232856960:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (369us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759434.619833:0:141979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759434.619841:0:141979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c23f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 141979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759434.619851:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1782759434.619910:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232856960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759434.635712:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232857088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759434.635776:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759434.635964:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232857216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759434.635986:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759434.636017:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857088 00000100:00100000:0.0:1782759434.636022:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857088 00000100:00100000:0.0:1782759434.636057:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857216 00000100:00100000:0.0:1782759434.636059:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857216 00000100:00100000:0.0:1782759434.636076:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1782759434.636083:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232857088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759434.636110:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759434.636160:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232857088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759434.636167:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1782759434.636186:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1782759434.636191:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232857216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759434.636201:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759434.636241:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232857216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759434.636246:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1782759434.636291:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232857216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759434.636323:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232857088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759435.595739:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759436.093360:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759436.093447:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488832 00000100:00100000:0.0:1782759436.093458:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488832 00000100:00100000:0.0:1782759436.093543:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2796 00000100:00100000:0.0:1782759436.093553:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104798:x1869355218488832:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759436.093659:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104798:x1869355218488832:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 106us (307us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759436.093667:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2796 00000100:00080000:1.0:1782759436.093819:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759436.121645:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759436.121678:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218488960 00000100:00100000:3.0:1782759436.121686:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218488960 00000100:00100000:3.0:1782759436.121732:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2797 00000100:00100000:3.0:1782759436.121741:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104799:x1869355218488960:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759436.121814:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104799:x1869355218488960:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 74us (176us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759436.121821:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2797 00000100:00100000:0.0:1782759436.134490:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759436.134539:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489088 00000100:00100000:3.0:1782759436.134548:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489088 00000100:00100000:3.0:1782759436.134614:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2798 00000100:00100000:3.0:1782759436.134625:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104800:x1869355218489088:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759436.134700:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:104800:x1869355218489088:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 77us (219us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759436.134707:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2798 10000000:01000000:2.0:1782759436.298924:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759436.298931:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759436.298936:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759436.298992:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759436.299005:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759436.299016:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759436.299049:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232857344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759436.299127:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759436.299243:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e36300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759436.300285:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857344 00000100:00100000:0.0:1782759436.300294:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857344 00000100:00100000:0.0:1782759436.300348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1782759436.300357:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232857344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759436.300372:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759436.300386:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c246 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759436.300410:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759436.300420:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759436.300429:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc200, rc 0) 00000100:00100000:0.0:1782759436.300487:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232857344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759436.300499:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:2.0:1782759436.302825:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232857344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759436.302853:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759436.302888:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759436.302914:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759436.302921:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759436.302928:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759436.618750:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759437.194897:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232857472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759437.194973:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759437.195019:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857472 00000100:00100000:1.0:1782759437.195027:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857472 00000100:00100000:1.0:1782759437.195104:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3140 00000100:00100000:1.0:1782759437.195112:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232857472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759437.195142:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445810176 avail 1299570688 00000100:00100000:1.0:1782759437.195215:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232857472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759437.195224:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3140 00000100:00100000:2.0:1782759437.195295:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232857472:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759437.646225:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759438.219980:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232857600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759438.220046:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759438.220426:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232857856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.220463:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759438.220523:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232858368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.220549:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759438.220789:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232858880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.220817:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759438.220836:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857856 00000100:00100000:1.0:1782759438.220843:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857856 00000100:00100000:1.0:1782759438.220885:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858368 00000100:00100000:1.0:1782759438.220888:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858368 00000100:00100000:1.0:1782759438.220914:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:1.0:1782759438.220929:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232857856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759438.220975:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232857856:12345-0@lo:400:kworker.0 Request processed in 47us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759438.220981:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00000100:00100000:1.0:1782759438.220996:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932 00000100:00100000:1.0:1782759438.221002:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232858368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759438.221027:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232858368:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759438.221032:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932 00000100:00080000:1.0:1782759438.221053:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759438.221164:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232857728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.221211:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759438.221240:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232858240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.221265:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759438.221282:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232858752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.221304:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759438.221320:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782759438.221327:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232858112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.221347:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759438.221404:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232857856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.221417:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232858368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.221437:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759438.221443:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232857984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.221471:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759438.221492:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232858496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759438.222601:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858880 00000100:00100000:1.0:1782759438.222608:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858880 00000100:00100000:0.0:1782759438.222609:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232858624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.222638:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759438.222656:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858112 00000100:00100000:0.0:1782759438.222656:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232859136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759438.222659:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858112 00000100:00100000:1.0:1782759438.222678:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933 00000100:00100000:0.0:1782759438.222678:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759438.222687:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232858880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.222708:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857600 00000100:00100000:0.0:1782759438.222712:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857600 00000100:00100000:1.0:1782759438.222727:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232858880:12345-0@lo:400:kworker.0 Request processed in 43us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759438.222735:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933 00000100:00100000:0.0:1782759438.222742:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1782759438.222749:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:0.0:1782759438.222749:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232857600:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759438.222755:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232858112:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1782759438.222771:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759438.222790:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232858112:12345-0@lo:400:kworker.0 Request processed in 36us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759438.222796:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00080000:1.0:1782759438.222816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759438.222821:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759438.222828:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232857600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.222834:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1782759438.222855:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857728 00000100:00100000:0.0:1782759438.222859:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857728 00000100:00100000:0.0:1782759438.222888:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:0.0:1782759438.222895:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232857728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.222922:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232857728:12345-0@lo:400:kworker.0 Request processed in 28us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.222927:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:0.0:1782759438.222960:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858240 00000100:00100000:0.0:1782759438.222963:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858240 00000100:00100000:0.0:1782759438.222998:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232857984 00000100:00100000:0.0:1782759438.223000:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232857984 00000100:00100000:0.0:1782759438.223012:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:0.0:1782759438.223020:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232858240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.223050:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232858240:12345-0@lo:400:kworker.0 Request processed in 33us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.223056:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:0.0:1782759438.223068:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:0.0:1782759438.223074:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232857984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759438.223102:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759438.223114:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232857984:12345-0@lo:400:kworker.0 Request processed in 39us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.223121:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1782759438.223134:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232859008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.223141:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858752 00000100:00100000:0.0:1782759438.223146:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858752 00000100:00100000:3.0:1782759438.223170:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759438.223178:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858624 00000100:00100000:0.0:1782759438.223194:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858624 00000100:00100000:0.0:1782759438.223214:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859136 00000100:00100000:0.0:1782759438.223217:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859136 00000100:00100000:0.0:1782759438.223232:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:0.0:1782759438.223237:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232858752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759438.226229:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232858496 00000100:00100000:2.0:1782759438.226243:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232858496 00000100:00100000:2.0:1782759438.226316:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859008 00000100:00100000:2.0:1782759438.226319:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859008 00000100:00100000:2.0:1782759438.226349:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:2.0:1782759438.226357:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232858496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226570:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232858752:12345-0@lo:400:kworker.0 Request processed in 3330us (5263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.226596:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:0.0:1782759438.226615:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:0.0:1782759438.226624:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232858624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226655:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232858624:12345-0@lo:400:kworker.0 Request processed in 34us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.226667:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:0.0:1782759438.226680:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1782759438.226687:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232859136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226718:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232859136:12345-0@lo:400:kworker.0 Request processed in 31us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.226724:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1782759438.226746:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4936 00000100:00100000:0.0:1782759438.226753:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232859008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226778:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232859008:12345-0@lo:400:kworker.0 Request processed in 26us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.226782:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4936 00000100:00100000:0.0:1782759438.226834:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232858112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226851:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232858624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226861:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232859136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226870:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232857728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226881:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232858240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759438.226891:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232858752:0@lo:400:kworker.0 00000100:00080000:0.0:1782759438.226948:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759438.226952:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759438.226954:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759438.226984:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232857600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759438.227549:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232858496:12345-0@lo:400:kworker.0 Request processed in 1192us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759438.227557:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00000100:00100000:3.0:1782759438.228087:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232859008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759438.228110:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232858880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759438.228136:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232857984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759438.228153:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232858496:0@lo:400:kworker.0 00010000:00010000:2.0:1782759438.666824:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759438.731827:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759438.731847:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232859264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759438.731913:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759438.732022:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859264 00000100:00100000:0.0:1782759438.732038:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859264 00000100:00100000:0.0:1782759438.732088:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1782759438.732097:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232859264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759438.732117:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759438.732290:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232859264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759438.732299:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1782759438.733431:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232859264:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1782759438.868973:0:142320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd897af2f0 20000000:00000080:2.0:1782759438.868992:0:142320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd7a4c00 uarg=0000000000000000 00010000:00010000:2.0:1782759438.869254:0:142320:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759438.869271:0:142320:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759438.869296:0:142320:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759438.869308:0:142320:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759438.869330:0:142320:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759438.869348:0:142320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.869364:0:142320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.869373:0:142320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.869411:0:142320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.869437:0:142320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 23 pid: 6526 timeout: 3629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759438.869451:0:142320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142320:1869355232859392:0@lo:104: 00000100:00100000:2.0:1782759438.869669:0:142320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759438.869768:0:142320:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc1095f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759438.869858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859392 00000100:00100000:3.0:1782759438.869866:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859392 00000100:00100000:3.0:1782759438.869948:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:3.0:1782759438.869958:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:142320:x1869355232859392:12345-0@lo:104: 00010000:00010000:3.0:1782759438.869970:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759438.870031:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759438.870037:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:142320:x1869355232859392:12345-0@lo:104: Request processed in 81us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759438.870043:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00010000:00010000:1.0:1782759438.870081:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759438.870088:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870095:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759438.870099:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870107:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759438.870123:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759438.870129:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759438.870159:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870165:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759438.870198:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870205:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60c246 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c24d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870218:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759438.870220:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759438.870222:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759438.870243:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232859520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759438.870275:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759438.870318:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859520 00000100:00100000:1.0:1782759438.870322:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859520 00010000:00010000:1.0:1782759438.870342:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 24 pid: 6526 timeout: 3629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759438.870363:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1782759438.870369:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232859520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759438.870379:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759438.870384:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 24 pid: 6526 timeout: 3629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870394:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 24 pid: 6526 timeout: 3629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870409:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870417:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870430:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870437:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870443:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870448:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870464:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759438.870468:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870475:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870483:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759438.870504:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759438.870532:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232859520:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759438.870539:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1782759438.870573:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232859520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759438.870679:0:142320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c24d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c246 expref: 23 pid: 6526 timeout: 3629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759438.870689:0:142320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142320:1869355232859392:0@lo:104: 00010000:00010000:2.0:1782759438.870717:0:142320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.870737:0:142320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.870743:0:142320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759438.870749:0:142320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c254 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759439.242936:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232859648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759439.243010:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759439.243345:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859648 00000100:00100000:3.0:1782759439.243353:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859648 00000100:00100000:3.0:1782759439.243414:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:3.0:1782759439.243423:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232859648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759439.243453:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:3.0:1782759439.243623:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232859648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 201us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759439.243631:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00100000:2.0:1782759439.243956:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232859648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759439.580882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759439.580921:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759439.580961:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759439.580974:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489344 00000100:00100000:0.0:1782759439.580985:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489344 00000100:00100000:2.0:1782759439.580990:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759439.581022:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759439.581050:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489472 00000100:00100000:2.0:1782759439.581054:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489472 00000100:00100000:0.0:1782759439.581057:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4937 00000100:00100000:0.0:1782759439.581070:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218489344:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759439.581091:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4938 00000100:00100000:2.0:1782759439.581109:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218489472:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759439.581151:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218489344:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759439.581158:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4937 00000100:00100000:0.0:1782759439.581198:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489600 00000100:00100000:3.0:1782759439.581199:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489216 00000100:00100000:0.0:1782759439.581202:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489600 00000100:00100000:3.0:1782759439.581205:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489216 00000100:00100000:0.0:1782759439.581234:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489728 00000100:00100000:0.0:1782759439.581239:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489728 00000100:00100000:3.0:1782759439.581246:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3086 00000100:00100000:3.0:1782759439.581254:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218489216:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759439.581276:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2833 00000100:00100000:0.0:1782759439.581284:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218489600:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759439.583236:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218489472:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2128us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759439.583249:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4938 00000100:00100000:3.0:1782759439.584519:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218489216:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 3258us (3639us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759439.584532:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3086 00000100:00100000:0.0:1782759439.586236:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218489600:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 4946us (5240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759439.586257:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2833 00000100:00100000:0.0:1782759439.586285:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2834 00000100:00100000:0.0:1782759439.586299:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218489728:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759439.586359:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218489728:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 66us (5338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759439.586375:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2834 00000100:00080000:0.0:1782759439.586394:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759439.586399:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759439.586402:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759439.586405:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759439.692015:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759439.754855:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232859776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759439.754934:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759439.755001:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859776 00000100:00100000:0.0:1782759439.755008:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859776 00000100:00100000:0.0:1782759439.755054:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1782759439.755063:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232859776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759439.755092:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759439.755151:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232859776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759439.755158:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1782759439.755215:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232859776:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759439.756222:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232859904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759439.756260:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759439.759504:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232859904 00000100:00100000:2.0:1782759439.759517:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232859904 00000100:00100000:2.0:1782759439.759592:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:2.0:1782759439.759604:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232859904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759439.759631:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759439.759705:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232859904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759439.759712:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1782759439.759876:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232859904:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1782759440.651120:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759440.651131:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759440.651137:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759440.651213:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759440.651228:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759440.651240:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759440.651296:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232860032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759440.651404:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759440.651497:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759440.651874:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860032 00000100:00100000:0.0:1782759440.651884:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860032 00000100:00100000:0.0:1782759440.651948:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3087 00000100:00100000:0.0:1782759440.651962:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232860032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759440.651980:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759440.651999:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c25b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759440.652041:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759440.652052:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759440.652062:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759440.652107:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232860032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759440.652114:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3087 00000100:00100000:1.0:1782759440.652430:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232860032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759440.652449:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759440.652461:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759440.652483:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759440.652489:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759440.652497:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759440.716386:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759440.946433:0:142516:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c24066a2 len=0 uarg=00007ffd11daf490 00040000:00000080:3.0:1782759440.946519:0:142516:0:(qmt_handler.c:1453:qmt_iocontrol()) lustre-QMT0000: cmd=c24066a2 len=584 karg=ffff8cddc4c76000 uarg=0000000000000000 00010000:00010000:3.0:1782759441.747163:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759442.315870:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759442.315892:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759442.315957:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759442.316840:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860160 00000100:00100000:1.0:1782759442.316849:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860160 00000100:00100000:1.0:1782759442.316941:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:1.0:1782759442.316951:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232860160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759442.316983:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445867520 avail 1299628032 00000100:00100000:1.0:1782759442.317038:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232860160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759442.317045:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:3.0:1782759442.317105:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232860160:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759442.470723:0:142660:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc893b37d0 20000000:00000080:1.0:1782759442.470745:0:142660:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8cdecd4eb800 uarg=0000000000000000 00000040:00100000:1.0:1782759442.471303:0:142660:0:(llog.c:1067:llog_reverse_process()) index 57 : idx 49 20000000:01000000:1.0:1782759442.471309:0:142660:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool64c lustre-OST0000_UUID 20000000:01000000:1.0:1782759442.471322:0:142660:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool64c.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1782759442.471823:0:142661:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 55 marker 46 1->4: lustre-clilov add lustre.pool64c.lustre-OST0000_UUID 20000000:01000000:3.0:1782759442.471878:0:142661:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 57 marker 46 2->4: lustre-clilov add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:3.0:1782759442.471893:0:142661:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:1.0:1782759442.472423:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18304 20000000:01000000:1.0:1782759442.472450:0:142660:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1782759442.472470:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 128 off18432 00000040:00080000:1.0:1782759442.472492:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18656 20000000:01000000:1.0:1782759442.472507:0:142660:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool64c.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1782759442.472914:0:142662:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0000-mdtlov add lustre.pool64c.lustre-OST0000_UUID 20000000:01000000:3.0:1782759442.472942:0:142662:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0000-mdtlov add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:3.0:1782759442.472956:0:142662:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:1.0:1782759442.473110:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17416 20000000:01000000:1.0:1782759442.473122:0:142660:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1782759442.473138:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 136 off17552 00000040:00080000:1.0:1782759442.473169:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17776 20000000:01000000:1.0:1782759442.473185:0:142660:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool64c.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1782759442.473443:0:142663:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 50 marker 48 1->4: lustre-MDT0001-mdtlov add lustre.pool64c.lustre-OST0000_UUID 20000000:01000000:3.0:1782759442.473464:0:142663:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 48 2->4: lustre-MDT0001-mdtlov add lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:3.0:1782759442.473474:0:142663:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:1.0:1782759442.473926:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17416 20000000:01000000:1.0:1782759442.473939:0:142660:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool64c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1782759442.473953:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 136 off17552 00000040:00080000:1.0:1782759442.473969:0:142660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17776 10000000:01000000:1.0:1782759442.473979:0:142660:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782759442.473997:0:142660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474016:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474024:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474031:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474051:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474058:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474064:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474071:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474078:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474085:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474091:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474097:0:142660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474105:0:142660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474143:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474178:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 23 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.474191:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860288:0@lo:104: 00000100:00100000:1.0:1782759442.474251:0:142660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.474343:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474351:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 23 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.474358:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860416:0@lo:104: 00000100:00100000:1.0:1782759442.474380:0:142660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.474454:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.474462:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 23 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.474471:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860544:0@lo:104: 00000100:00100000:1.0:1782759442.474493:0:142660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759442.474537:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860288 00000100:00100000:2.0:1782759442.474544:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860288 00000100:00100000:2.0:1782759442.474615:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860416 00000100:00100000:2.0:1782759442.474619:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860416 00000100:00100000:2.0:1782759442.474640:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1782759442.474650:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:142660:x1869355232860288:12345-0@lo:104: 00010000:00010000:2.0:1782759442.474670:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.474718:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759442.474724:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:142660:x1869355232860288:12345-0@lo:104: Request processed in 77us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759442.474731:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:2.0:1782759442.474748:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:2.0:1782759442.474755:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:142660:x1869355232860416:12345-0@lo:104: 00010000:00010000:2.0:1782759442.474763:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759442.474793:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759442.474798:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:142660:x1869355232860416:12345-0@lo:104: Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759442.474804:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00010000:00010000:1.0:1782759442.475010:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475019:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 23 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475027:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860672:0@lo:104: 00000100:00100000:1.0:1782759442.475056:0:142660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.475083:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475091:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 23 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475098:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860800:0@lo:104: 00000100:00100000:1.0:1782759442.475120:0:142660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759442.475139:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475156:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 23 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475165:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860928:0@lo:104: 00010000:00010000:1.0:1782759442.475190:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475198:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 23 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475205:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861056:0@lo:104: 00010000:00010000:1.0:1782759442.475225:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475232:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 23 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475240:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861184:0@lo:104: 00010000:00010000:1.0:1782759442.475273:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475281:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 23 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475289:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861312:0@lo:104: 00010000:00010000:1.0:1782759442.475313:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475323:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 9 pid: 6526 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475332:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861440:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759442.475379:0:142660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.475387:0:142660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 9 pid: 6524 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.475396:0:142660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861568:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759442.475418:0:142660:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c96900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759442.475437:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860288:0@lo:104: 00000100:00100000:1.0:1782759442.475446:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860416:0@lo:104: 00000100:00100000:3.0:1782759442.475505:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759442.475524:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.475538:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.475547:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.475555:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.475561:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860544 00000100:00100000:3.0:1782759442.475564:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860544 00000100:00100000:3.0:1782759442.475615:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860672 00000100:00100000:3.0:1782759442.475619:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860672 00000100:00100000:3.0:1782759442.475629:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860800 00000100:00100000:3.0:1782759442.475631:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860800 00000100:00100000:3.0:1782759442.475639:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232860928 00000100:00100000:3.0:1782759442.475641:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232860928 00000100:00100000:3.0:1782759442.475650:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232861056 00000100:00100000:3.0:1782759442.475652:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232861056 00000100:00100000:3.0:1782759442.475660:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232861184 00000100:00100000:3.0:1782759442.475662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232861184 00000100:00100000:3.0:1782759442.475671:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232861312 00000100:00100000:3.0:1782759442.475674:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232861312 00000100:00100000:3.0:1782759442.475685:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1782759442.475692:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+9:142660:x1869355232860544:12345-0@lo:104: 00010000:00010000:3.0:1782759442.475700:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.475741:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782759442.475747:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+9:142660:x1869355232860544:12345-0@lo:104: Request processed in 56us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.475752:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:3.0:1782759442.475766:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1782759442.475772:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142660:x1869355232860672:12345-0@lo:104: 00010000:00010000:3.0:1782759442.475779:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.475803:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782759442.475807:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142660:x1869355232860672:12345-0@lo:104: Request processed in 37us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.475813:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1782759442.475830:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1782759442.475835:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4542850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+7:142660:x1869355232860800:12345-0@lo:104: 00010000:00010000:3.0:1782759442.475842:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.475869:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782759442.475873:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4542850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+7:142660:x1869355232860800:12345-0@lo:104: Request processed in 39us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.475879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1782759442.475906:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1782759442.475913:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:142660:x1869355232860928:12345-0@lo:104: 00010000:00010000:3.0:1782759442.475919:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.475945:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782759442.475951:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:142660:x1869355232860928:12345-0@lo:104: Request processed in 39us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.475957:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:3.0:1782759442.475968:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1782759442.475974:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:142660:x1869355232861056:12345-0@lo:104: 00010000:00010000:3.0:1782759442.475981:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476005:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782759442.476009:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:142660:x1869355232861056:12345-0@lo:104: Request processed in 36us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.476015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1782759442.476031:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1782759442.476037:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:142660:x1869355232861184:12345-0@lo:104: 00010000:00010000:3.0:1782759442.476044:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476069:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1782759442.476073:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:142660:x1869355232861184:12345-0@lo:104: Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.476079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1782759442.476095:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1782759442.476101:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:142660:x1869355232861312:12345-0@lo:104: 00010000:00010000:3.0:1782759442.476108:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476132:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1782759442.476137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:142660:x1869355232861312:12345-0@lo:104: Request processed in 37us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.476142:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00010000:00010000:3.0:1782759442.476173:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1782759442.476178:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476186:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476190:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476198:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476216:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476223:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476250:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476256:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476273:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476279:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c1b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1ba expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476292:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1782759442.476295:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476300:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476303:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476310:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476316:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476321:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476339:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476345:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476358:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476362:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c1a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c1ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476369:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782759442.476371:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476374:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476376:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476381:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476387:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476392:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476404:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476410:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476415:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476431:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c197 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c19e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476440:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782759442.476443:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476448:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476451:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476457:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476462:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476467:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476479:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476484:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476490:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476495:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c190 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476503:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782759442.476511:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476517:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476520:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476527:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476532:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476537:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476549:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476555:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476560:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476566:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c17b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c182 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476595:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782759442.476598:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476604:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476607:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476620:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476624:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476627:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476636:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476639:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476642:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476646:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60c16d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c174 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476652:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782759442.476653:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476656:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476658:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476662:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476665:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476671:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476678:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476681:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476684:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476688:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c15f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c166 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476692:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759442.476694:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476698:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476701:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476706:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476711:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476716:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476727:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476733:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476743:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476749:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429200/0xd5b45c7f5c60c151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c158 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476756:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759442.476758:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476761:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759442.476763:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476767:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759442.476770:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759442.476773:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759442.476781:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476784:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759442.476787:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476790:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60c143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c14a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.476799:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759442.476804:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759442.476805:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759442.476825:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232861696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.476849:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.476868:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.476889:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.476903:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.476919:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.476932:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782759442.476935:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.476947:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.476955:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.476967:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.476982:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232861952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.476994:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.477002:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232862464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477011:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.477017:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782759442.477020:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232861824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477029:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.477033:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232862336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477042:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759442.477054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232861696 00000100:00100000:3.0:1782759442.477060:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232861696 00010000:00010000:3.0:1782759442.477080:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 24 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477102:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862208 00000100:00100000:3.0:1782759442.477105:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862208 00010000:00010000:3.0:1782759442.477116:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 25 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477126:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862720 00000100:00100000:3.0:1782759442.477128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862720 00010000:00010000:3.0:1782759442.477137:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 26 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862080 00000100:00100000:3.0:1782759442.477159:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862080 00010000:00010000:3.0:1782759442.477169:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 27 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477178:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862592 00000100:00100000:3.0:1782759442.477179:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862592 00010000:00010000:3.0:1782759442.477186:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 28 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477191:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232861952 00000100:00100000:3.0:1782759442.477192:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232861952 00010000:00010000:3.0:1782759442.477197:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 29 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477202:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862464 00000100:00100000:3.0:1782759442.477203:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862464 00010000:00010000:3.0:1782759442.477207:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 30 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232861824 00000100:00100000:3.0:1782759442.477217:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232861824 00010000:00010000:3.0:1782759442.477224:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 31 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477230:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862336 00000100:00100000:3.0:1782759442.477231:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862336 00010000:00010000:3.0:1782759442.477235:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 32 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.477242:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1782759442.477246:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+32:3663:x1869355232861696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477253:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477256:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 32 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477263:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 32 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477272:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60c1ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1b3 expref: 32 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477281:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477300:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+31:3663:x1869355232861696:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477304:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:3.0:1782759442.477312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1782759442.477315:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+30:3663:x1869355232862208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477320:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477322:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 30 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477334:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 30 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477340:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477353:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+30:3663:x1869355232862208:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477357:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:3.0:1782759442.477364:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1782759442.477367:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+29:3663:x1869355232862720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477373:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477375:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 29 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477380:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 29 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477388:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477407:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+29:3663:x1869355232862720:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1782759442.477423:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1782759442.477429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+28:3663:x1869355232862080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477435:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477439:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 28 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477443:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 28 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477454:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477468:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+28:3663:x1869355232862080:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477471:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1782759442.477504:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1782759442.477508:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+27:3663:x1869355232862592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477512:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477514:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 27 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477519:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 27 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477527:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477544:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+27:3663:x1869355232862592:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477550:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1782759442.477562:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1782759442.477568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+26:3665:x1869355232861952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477588:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477591:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 26 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477597:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 26 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477603:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477624:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+26:3665:x1869355232861952:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1782759442.477636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1782759442.477639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355232862464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477644:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477646:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 25 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477651:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 25 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477656:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477667:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355232862464:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1782759442.477676:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1782759442.477679:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232861824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477683:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477686:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 24 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477690:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 24 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477697:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428a00/0xd5b45c7f5c60c1ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c1a5 expref: 24 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477704:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477729:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232861824:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477735:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1782759442.477746:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1782759442.477752:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+22:3665:x1869355232862336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.477757:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.477759:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 22 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477765:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 22 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.477771:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759442.477784:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+22:3665:x1869355232862336:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.477787:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1782759442.477814:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232861824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477819:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232862336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477823:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232861952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477827:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232862464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477849:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477855:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477861:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232861696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477868:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759442.477882:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232862720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759442.477989:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c19e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c197 expref: 21 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.477999:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860544:0@lo:104: 00010000:00010000:1.0:1782759442.478018:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60c190 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c189 expref: 20 pid: 6525 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.478026:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860672:0@lo:104: 00010000:00010000:1.0:1782759442.478034:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c17b expref: 19 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.478041:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860800:0@lo:104: 00010000:00010000:1.0:1782759442.478048:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c16d expref: 18 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.478056:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232860928:0@lo:104: 00010000:00010000:1.0:1782759442.478063:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60c166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c15f expref: 17 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.478070:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861056:0@lo:104: 00010000:00010000:1.0:1782759442.478077:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60c158 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c151 expref: 16 pid: 6524 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.478084:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861184:0@lo:104: 00010000:00010000:1.0:1782759442.478093:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c14a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c143 expref: 15 pid: 6526 timeout: 3632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.478100:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861312:0@lo:104: 00010000:00010000:2.0:1782759442.478388:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759442.478394:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759442.480866:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861440:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759442.480881:0:142660:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142660:1869355232861568:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759442.480925:0:142660:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759442.481200:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759442.481253:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489984 00000100:00100000:1.0:1782759442.481260:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489984 00000100:00100000:0.0:1782759442.481281:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1782759442.481290:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 10 pid: 6524 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759442.481351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218489856 00000100:00100000:1.0:1782759442.481355:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218489856 00010000:00010000:1.0:1782759442.481368:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 11 pid: 6526 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.481446:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 757 00000100:00100000:3.0:1782759442.481498:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+11:2402:x1869355218489984:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759442.481511:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759442.481517:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 11 pid: 6524 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.481528:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 11 pid: 6524 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.481544:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2725e expref: 11 pid: 6524 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.481559:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759442.481699:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 758 00000100:00100000:1.0:1782759442.481707:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218489856:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759442.481716:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759442.481720:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 10 pid: 6526 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481730:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 10 pid: 6526 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481741:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c13c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27265 expref: 10 pid: 6526 timeout: 3582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481752:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481761:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759442.481814:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2402:x1869355218489984:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 320us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759442.481822:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 757 00010000:00010000:1.0:1782759442.481859:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481878:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481884:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481891:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481898:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759442.481902:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481913:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481930:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759442.481938:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759442.481956:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2403:x1869355218489856:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 250us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759442.481966:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 758 00010000:00010000:0.0:1782759442.482034:0:142660:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.482043:0:142660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759442.482246:0:142660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c269 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759442.762855:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759443.339026:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232862976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.339062:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232863232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339108:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.339126:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232863104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.339158:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862976 00000100:00100000:1.0:1782759443.339166:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862976 00000100:00100000:3.0:1782759443.339170:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232863488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.339171:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.339195:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.339202:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232863616:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339208:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232864000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.339221:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.339238:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232864128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339250:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863104 00000100:00100000:3.0:1782759443.339253:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863104 00000100:00100000:0.0:1782759443.339272:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.339304:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863488 00000100:00100000:0.0:1782759443.339308:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863488 00000100:00100000:1.0:1782759443.339311:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863616 00000100:00100000:3.0:1782759443.339312:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:1.0:1782759443.339317:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863616 00000100:00100000:3.0:1782759443.339330:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232863104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.339341:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864128 00000100:00100000:0.0:1782759443.339344:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864128 00000100:00100000:1.0:1782759443.339350:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4939 00000100:00100000:1.0:1782759443.339368:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232862976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.339374:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4940 00000100:00100000:0.0:1782759443.339383:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232863488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339385:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232863104:12345-0@lo:400:kworker.0 Request processed in 58us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.339392:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:1.0:1782759443.339418:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232862976:12345-0@lo:400:kworker.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.339424:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232863488:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.339430:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232863104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.339431:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4939 00000100:00100000:3.0:1782759443.339460:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.339478:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232864512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759443.339493:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232862848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339503:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.339533:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232862976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759443.339541:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.339549:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232863488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339605:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864512 00000100:00100000:2.0:1782759443.339608:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232863360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339610:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864512 00000100:00100000:2.0:1782759443.339641:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.339660:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1782759443.339665:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232863872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339676:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232864512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759443.339696:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1782759443.339700:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759443.339718:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232864384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339754:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232864512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759443.339759:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759443.339764:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1782759443.339802:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232864512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759443.339816:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864000 00000100:00100000:2.0:1782759443.339822:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864000 00000100:00100000:3.0:1782759443.339837:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863360 00000100:00100000:3.0:1782759443.339842:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863360 00000100:00100000:3.0:1782759443.339870:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:3.0:1782759443.339877:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232863360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759443.339911:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232863360:12345-0@lo:400:kworker.0 Request processed in 35us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759443.339923:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:0.0:1782759443.340489:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4940 00000100:00100000:1.0:1782759443.340517:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941 00000100:00100000:1.0:1782759443.340527:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232863616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.340569:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232863616:12345-0@lo:400:kworker.0 Request processed in 45us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.340592:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:1.0:1782759443.340599:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941 00000100:00100000:0.0:1782759443.340603:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232864128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.340635:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232863616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.340642:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232864128:12345-0@lo:400:kworker.0 Request processed in 42us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.340650:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232864128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.340651:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00080000:0.0:1782759443.340677:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759443.340682:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759443.340683:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759443.340685:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759443.340699:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863232 00000100:00100000:0.0:1782759443.340703:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863232 00000100:00100000:1.0:1782759443.340709:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232863744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.340729:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943 00000100:00100000:0.0:1782759443.340736:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232863232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.340771:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.340849:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232864256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.340871:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759443.340909:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863872 00000100:00100000:1.0:1782759443.340912:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863872 00000100:00100000:1.0:1782759443.340933:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864384 00000100:00100000:1.0:1782759443.340935:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864384 00000100:00100000:1.0:1782759443.340940:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232863744 00000100:00100000:1.0:1782759443.340941:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232863744 00000100:00100000:1.0:1782759443.340947:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864256 00000100:00100000:1.0:1782759443.340948:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864256 00000100:00100000:1.0:1782759443.340956:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1782759443.340959:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232863872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.340989:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232863872:12345-0@lo:400:kworker.0 Request processed in 29us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.340993:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1782759443.341001:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:1.0:1782759443.341004:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232864384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341018:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232864384:12345-0@lo:400:kworker.0 Request processed in 13us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.341021:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:1.0:1782759443.341026:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1782759443.341029:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232863744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341044:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232863744:12345-0@lo:400:kworker.0 Request processed in 15us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.341048:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:1.0:1782759443.341053:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:1.0:1782759443.341056:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232864256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341068:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232864256:12345-0@lo:400:kworker.0 Request processed in 12us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.341072:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:1.0:1782759443.341091:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232862848 00000100:00100000:1.0:1782759443.341093:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232862848 00000100:00100000:0.0:1782759443.341099:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232863232:12345-0@lo:400:kworker.0 Request processed in 362us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.341108:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943 00000100:00100000:0.0:1782759443.341124:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944 00000100:00100000:0.0:1782759443.341131:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232864000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759443.341164:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232863360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341179:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:2.0:1782759443.341182:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232863872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341193:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+15:3664:x1869355232862848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759443.341199:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232864384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341242:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+15:3664:x1869355232862848:12345-0@lo:400:kworker.0 Request processed in 53us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759443.341250:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:2.0:1782759443.341253:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232862848:0@lo:400:kworker.0 00000100:00100000:0.0:1782759443.341255:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232864000:12345-0@lo:400:kworker.0 Request processed in 60us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.341268:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944 00000100:00100000:1.0:1782759443.341305:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232863232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341320:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232863744:0@lo:400:kworker.0 00000100:00100000:2.0:1782759443.341330:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232864000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759443.341340:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232864256:0@lo:400:kworker.0 00000100:00080000:0.0:1782759443.341343:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759443.341348:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759443.786859:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759443.854259:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759443.854285:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232864640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759443.854357:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759443.855221:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864640 00000100:00100000:0.0:1782759443.855229:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864640 00000100:00100000:0.0:1782759443.855295:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:0.0:1782759443.855307:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232864640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759443.855332:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759443.855392:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232864640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759443.855399:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1782759443.855694:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232864640:0@lo:13:osp-pre-1-1.0 10000000:01000000:3.0:1782759444.107156:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759444.107164:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 58 10000000:01000000:3.0:1782759444.107169:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759444.107216:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.107228:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.107238:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759444.107265:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232864768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.107328:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.107400:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec32d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.109190:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864768 00000100:00100000:0.0:1782759444.109200:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864768 00000100:00100000:0.0:1782759444.109257:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:0.0:1782759444.109267:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355232864768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.109280:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759444.109296:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c270 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.109320:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.109330:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.109338:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc400, rc 0) 00000100:00100000:0.0:1782759444.109411:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232864768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.109418:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:3.0:1782759444.109513:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232864768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759444.109528:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.109538:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759444.109622:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232864896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.109659:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.109696:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec32d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.109759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232864896 00000100:00100000:1.0:1782759444.109764:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232864896 00000100:00100000:1.0:1782759444.109798:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:1.0:1782759444.109806:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232864896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.109916:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232864896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.109923:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:3.0:1782759444.109986:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232864896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.110010:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.110042:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.110066:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec32d6300 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.110165:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865024 00000100:00100000:0.0:1782759444.110169:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865024 00000100:00100000:0.0:1782759444.110185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1782759444.110190:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232865024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.110265:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232865024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.110271:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:3.0:1782759444.110415:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.110838:0:142664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142664:1869355232865152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.110872:0:142664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.110900:0:142664:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec32d6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.110937:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865152 00000100:00100000:0.0:1782759444.110940:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865152 00000100:00100000:0.0:1782759444.110962:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3092 00000100:00100000:0.0:1782759444.110967:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:142664:x1869355232865152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759444.111028:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:142664:x1869355232865152:12345-0@lo:502:llog_process_th.0 Request processed in 61us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.111032:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3092 00000100:00100000:3.0:1782759444.111168:0:142664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142664:1869355232865152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.111202:0:142664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142664:1869355232865280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.111231:0:142664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.111252:0:142664:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb66d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.111296:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865280 00000100:00100000:1.0:1782759444.111300:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865280 00000100:00100000:1.0:1782759444.111327:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3093 00000100:00100000:1.0:1782759444.111333:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:142664:x1869355232865280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.111403:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:142664:x1869355232865280:12345-0@lo:502:llog_process_th.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.111410:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3093 00000100:00100000:3.0:1782759444.111504:0:142664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142664:1869355232865280:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759444.111520:0:142664:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1782759444.111663:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1782759444.111677:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759444.111683:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.111689:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759444.111695:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1782759444.111701:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1782759444.111703:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1782759444.111722:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.111730:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.111738:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.111750:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.111776:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.111823:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.114287:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865408 00000100:00100000:2.0:1782759444.114297:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865408 00000100:00100000:2.0:1782759444.114400:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:2.0:1782759444.114410:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232865408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759444.114423:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759444.114437:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c27e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.114458:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.114465:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.114475:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759444.114540:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232865408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (2763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.114545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1782759444.114651:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759444.114667:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.114674:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759444.114727:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.114756:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.114846:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb66d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.114893:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865536 00000100:00100000:1.0:1782759444.114896:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865536 00000100:00100000:1.0:1782759444.114911:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:1.0:1782759444.114915:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232865536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.115008:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232865536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.115013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1782759444.115067:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.115087:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.115117:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.115146:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb66d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.115233:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865664 00000100:00100000:1.0:1782759444.115236:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865664 00000100:00100000:1.0:1782759444.115248:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:1.0:1782759444.115252:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232865664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.115312:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232865664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.115317:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:3.0:1782759444.115383:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782759444.116015:0:142665:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1782759444.116198:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1782759444.116213:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782759444.116219:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.116226:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759444.116233:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759444.116234:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 58 10000000:01000000:1.0:1782759444.116236:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759444.116254:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.116260:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.116266:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.116276:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.116300:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.116324:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.116412:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865792 00000100:00100000:3.0:1782759444.116416:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865792 00000100:00100000:3.0:1782759444.116435:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:3.0:1782759444.116440:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232865792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759444.116447:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759444.116455:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c28c expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.116469:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.116477:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.116485:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4000, rc 0) 00000100:00100000:3.0:1782759444.116521:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232865792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.116527:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000100:00100000:1.0:1782759444.116611:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759444.116622:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.116630:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.116684:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.116708:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.116722:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.116780:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232865920 00000100:00100000:3.0:1782759444.116788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232865920 00000100:00100000:3.0:1782759444.116800:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3098 00000100:00100000:3.0:1782759444.116803:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232865920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.116866:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232865920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.116870:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3098 00000100:00100000:1.0:1782759444.116924:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232865920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.116941:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.116963:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.116982:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.117017:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866048 00000100:00100000:3.0:1782759444.117020:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866048 00000100:00100000:3.0:1782759444.117032:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3099 00000100:00100000:3.0:1782759444.117035:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232866048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.117217:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232866048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.117221:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3099 00000100:00100000:1.0:1782759444.117344:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.117696:0:142666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142666:1869355232866176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.117721:0:142666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.117762:0:142666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.117786:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866176 00000100:00100000:3.0:1782759444.117788:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866176 00000100:00100000:3.0:1782759444.117829:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:3.0:1782759444.117834:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:142666:x1869355232866176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.117893:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:142666:x1869355232866176:12345-0@lo:502:llog_process_th.0 Request processed in 58us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.117898:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:0.0:1782759444.117946:0:142666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142666:1869355232866176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759444.117974:0:142666:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142666:1869355232866304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759444.117995:0:142666:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759444.118044:0:142666:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.118156:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866304 00000100:00100000:2.0:1782759444.118160:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866304 00000100:00100000:2.0:1782759444.118189:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:2.0:1782759444.118195:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:142666:x1869355232866304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.118261:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:142666:x1869355232866304:12345-0@lo:502:llog_process_th.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.118265:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:0.0:1782759444.118345:0:142666:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142666:1869355232866304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782759444.118363:0:142666:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1782759444.118474:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1782759444.118495:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759444.118502:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.118511:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759444.118517:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759444.118518:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1782759444.118520:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759444.118535:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.118540:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.118545:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759444.118566:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.118617:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.118629:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.118679:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866432 00000100:00100000:0.0:1782759444.118682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866432 00000100:00100000:0.0:1782759444.118699:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:0.0:1782759444.118702:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232866432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.118708:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759444.118716:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c29a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.118727:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.118733:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.118737:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:0.0:1782759444.118755:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232866432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.118758:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:2.0:1782759444.118813:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759444.118822:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.118828:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759444.118853:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.118869:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.118888:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.118921:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866560 00000100:00100000:0.0:1782759444.118924:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866560 00000100:00100000:0.0:1782759444.118935:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:0.0:1782759444.118939:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232866560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.119005:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232866560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.119009:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:2.0:1782759444.119050:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.119075:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.119096:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.119150:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.119314:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866688 00000100:00100000:3.0:1782759444.119317:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866688 00000100:00100000:0.0:1782759444.119440:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3104 00000100:00100000:0.0:1782759444.119446:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232866688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.119509:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232866688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.119520:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3104 00000100:00100000:2.0:1782759444.119603:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759444.120280:0:142667:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1782759444.120379:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1782759444.120399:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782759444.120404:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.120410:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759444.120415:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782759444.120417:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 58 10000000:01000000:0.0:1782759444.120418:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782759444.120433:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.120437:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.120443:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759444.120451:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.120490:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759444.120512:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.120555:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866816 00000100:00100000:2.0:1782759444.120559:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866816 00000100:00100000:2.0:1782759444.120609:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3105 00000100:00100000:2.0:1782759444.120616:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232866816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759444.120623:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759444.120635:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c2a8 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.120646:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.120652:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.120656:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759444.120675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232866816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.120679:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3105 00000100:00100000:0.0:1782759444.120791:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.120799:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.120812:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759444.120842:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.120858:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759444.120877:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.120906:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232866944 00000100:00100000:2.0:1782759444.120908:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232866944 00000100:00100000:2.0:1782759444.120930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:2.0:1782759444.120934:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232866944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.120998:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232866944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.121002:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:0.0:1782759444.121106:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232866944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.121128:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.121239:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759444.121254:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.121282:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867072 00000100:00100000:2.0:1782759444.121285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867072 00000100:00100000:2.0:1782759444.121306:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:2.0:1782759444.121311:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232867072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.121397:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232867072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.121403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:0.0:1782759444.121627:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.121883:0:142668:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142668:1869355232867200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.121909:0:142668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.121955:0:142668:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.122018:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867200 00000100:00100000:1.0:1782759444.122021:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867200 00000100:00100000:1.0:1782759444.122067:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00100000:1.0:1782759444.122072:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:142668:x1869355232867200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.122261:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:142668:x1869355232867200:12345-0@lo:502:llog_process_th.0 Request processed in 189us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.122266:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:2.0:1782759444.122317:0:142668:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142668:1869355232867200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.122344:0:142668:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142668:1869355232867328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.122372:0:142668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.122419:0:142668:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.122441:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867328 00000100:00100000:1.0:1782759444.122443:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867328 00000100:00100000:1.0:1782759444.122463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:1.0:1782759444.122467:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:142668:x1869355232867328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.122530:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:142668:x1869355232867328:12345-0@lo:502:llog_process_th.0 Request processed in 62us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.122534:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:2.0:1782759444.122611:0:142668:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142668:1869355232867328:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782759444.122624:0:142668:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1782759444.122734:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1782759444.122757:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759444.122764:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.122772:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759444.122780:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1782759444.122782:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:1.0:1782759444.122785:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782759444.122804:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.122812:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.122820:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.122833:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.122857:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.122878:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded191fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.122912:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867456 00000100:00100000:2.0:1782759444.122915:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867456 00000100:00100000:2.0:1782759444.122930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3110 00000100:00100000:2.0:1782759444.122933:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232867456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759444.122939:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759444.122946:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c2b6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.122958:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.122964:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.122968:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759444.122994:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232867456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.122997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3110 00000100:00100000:1.0:1782759444.123047:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759444.123055:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.123068:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.123097:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.123120:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.123231:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867584 00000100:00100000:2.0:1782759444.123235:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867584 00000100:00100000:2.0:1782759444.123248:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3111 00000100:00100000:2.0:1782759444.123252:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232867584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.123410:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232867584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.123415:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3111 00000100:00100000:1.0:1782759444.123447:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded191fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.123455:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.123475:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.123506:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.123550:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded191fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.123720:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867712 00000100:00100000:3.0:1782759444.123724:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867712 00000100:00100000:3.0:1782759444.123775:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:3.0:1782759444.123781:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232867712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.123839:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232867712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.123847:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 00000100:00100000:1.0:1782759444.123893:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232867712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.124098:0:142669:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142669:1869355232867840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.124119:0:142669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759444.124255:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867840 00000100:00100000:0.0:1782759444.124260:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867840 00000100:00100000:1.0:1782759444.124269:0:142669:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b586c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759444.124299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:3.0:1782759444.124306:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:142669:x1869355232867840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.124382:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:142669:x1869355232867840:12345-0@lo:502:llog_process_th.0 Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.124389:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:1.0:1782759444.124404:0:142669:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142669:1869355232867840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759444.124423:0:142669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759444.124432:0:142669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759444.124434:0:142669:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0001-m rem lustre.pool64c.lustre-OST0000_UUID 00000020:00000080:1.0:1782759444.124441:0:142669:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1782759444.124456:0:142669:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from pool64c 00000100:00100000:1.0:1782759444.124473:0:142669:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142669:1869355232867968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.124504:0:142669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.124522:0:142669:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b586c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.124565:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232867968 00000100:00100000:2.0:1782759444.124569:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232867968 00000100:00100000:2.0:1782759444.124614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114 00000100:00100000:2.0:1782759444.124622:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:142669:x1869355232867968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.124727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:142669:x1869355232867968:12345-0@lo:502:llog_process_th.0 Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.124734:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114 00000100:00100000:1.0:1782759444.124781:0:142669:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142669:1869355232867968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759444.124797:0:142669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759444.124801:0:142669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759444.124802:0:142669:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0001-m rem lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:1.0:1782759444.124806:0:142669:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:3.0:1782759444.124928:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:3.0:1782759444.124947:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1782759444.124953:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.124962:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759444.124970:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759444.124972:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 58 10000000:01000000:3.0:1782759444.124974:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759444.124989:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.124996:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.125003:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759444.125014:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.125036:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.125071:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded0a03540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.125151:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868096 00000100:00100000:1.0:1782759444.125159:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868096 00000100:00100000:1.0:1782759444.125174:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:1.0:1782759444.125179:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232868096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759444.125186:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759444.125194:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c2c4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.125208:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.125216:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.125223:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759444.125254:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232868096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.125259:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:3.0:1782759444.125440:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759444.125451:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.125459:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759444.125493:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.125513:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.125528:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded0a03540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.125609:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868224 00000100:00100000:1.0:1782759444.125613:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868224 00000100:00100000:1.0:1782759444.125627:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3116 00000100:00100000:1.0:1782759444.125631:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232868224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.125691:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232868224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.125695:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3116 00000100:00100000:3.0:1782759444.125755:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.125776:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.125800:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.125818:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded0a03540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.125845:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868352 00000100:00100000:1.0:1782759444.125849:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868352 00000100:00100000:1.0:1782759444.125865:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3117 00000100:00100000:1.0:1782759444.125871:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232868352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.125945:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232868352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.125951:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3117 00000100:00100000:3.0:1782759444.126009:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759444.126339:0:142670:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142670:1869355232868480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.126370:0:142670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.126387:0:142670:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.126463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868480 00000100:00100000:0.0:1782759444.126467:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868480 00000100:00100000:0.0:1782759444.126491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:0.0:1782759444.126497:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:142670:x1869355232868480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759444.126675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:142670:x1869355232868480:12345-0@lo:502:llog_process_th.0 Request processed in 177us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.126682:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:3.0:1782759444.126736:0:142670:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142670:1869355232868480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.126768:0:142670:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142670:1869355232868608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759444.126794:0:142670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.126813:0:142670:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759444.126892:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868608 00000100:00100000:1.0:1782759444.126898:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868608 00000100:00100000:1.0:1782759444.126929:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:1.0:1782759444.126936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:142670:x1869355232868608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.127007:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:142670:x1869355232868608:12345-0@lo:502:llog_process_th.0 Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.127014:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:3.0:1782759444.127031:0:142670:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142670:1869355232868608:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759444.127118:0:142670:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1782759444.127236:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1782759444.127319:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759444.127327:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.127337:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759444.127345:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1782759444.127348:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:1.0:1782759444.127350:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1782759444.127369:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.127377:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.127385:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.127462:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.127627:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.127647:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.127707:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868736 00000100:00100000:0.0:1782759444.127712:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868736 00000100:00100000:0.0:1782759444.127742:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:0.0:1782759444.127749:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232868736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.127765:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759444.127777:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c2d2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.127795:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.127804:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.127811:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759444.127845:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232868736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.127851:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:1.0:1782759444.127897:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759444.127911:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.127920:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.127963:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.127991:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.128008:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.128068:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868864 00000100:00100000:2.0:1782759444.128073:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868864 00000100:00100000:2.0:1782759444.128111:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:2.0:1782759444.128120:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232868864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.128229:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232868864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.128237:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:1.0:1782759444.128300:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.128324:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.128357:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.128381:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.128394:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232868992 00000100:00100000:2.0:1782759444.128399:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232868992 00000100:00100000:2.0:1782759444.128430:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3122 00000100:00100000:2.0:1782759444.128437:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232868992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.128512:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232868992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.128524:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3122 00000100:00100000:1.0:1782759444.128594:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232868992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.128849:0:142671:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142671:1869355232869120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759444.128876:0:142671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.128897:0:142671:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.128915:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869120 00000100:00100000:2.0:1782759444.128920:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869120 00000100:00100000:2.0:1782759444.128951:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3123 00000100:00100000:2.0:1782759444.128958:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:142671:x1869355232869120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.129031:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:142671:x1869355232869120:12345-0@lo:502:llog_process_th.0 Request processed in 72us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.129039:0:142671:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142671:1869355232869120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.129040:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3123 00000020:01000000:1.0:1782759444.129062:0:142671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759444.129074:0:142671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759444.129076:0:142671:0:(obd_config.c:1561:class_process_config()) marker 50 (0x1) lustre-MDT0000-m rem lustre.pool64c.lustre-OST0000_UUID 00000020:00000080:1.0:1782759444.129083:0:142671:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1782759444.129094:0:142671:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from pool64c 00000100:00100000:2.0:1782759444.130419:0:142671:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142671:1869355232869248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759444.130470:0:142671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1782759444.130475:0:142672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cdec77f6000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782759444.130479:0:142672:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8cdec77f6000 4 00000100:00100000:2.0:1782759444.130497:0:142671:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759444.130564:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869248 00000100:00100000:0.0:1782759444.130569:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869248 00000100:00100000:0.0:1782759444.130709:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:0.0:1782759444.130718:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:142671:x1869355232869248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759444.130836:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:142671:x1869355232869248:12345-0@lo:502:llog_process_th.0 Request processed in 119us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.130843:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1782759444.131010:0:142671:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142671:1869355232869248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759444.131032:0:142671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759444.131038:0:142671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759444.131040:0:142671:0:(obd_config.c:1561:class_process_config()) marker 50 (0x2) lustre-MDT0000-m rem lustre.pool64c.lustre-OST0000_UUID 00000040:00080000:2.0:1782759444.131043:0:142671:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:1.0:1782759444.131244:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:1.0:1782759444.131263:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782759444.131272:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.131282:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759444.131292:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782759444.131294:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759444.131296:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782759444.131318:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.131326:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759444.131335:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759444.131348:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232869376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.131375:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.131430:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.131822:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869376 00000100:00100000:2.0:1782759444.131828:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869376 00000100:00100000:2.0:1782759444.131890:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:2.0:1782759444.131898:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232869376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759444.131908:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759444.131919:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c2e0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.131937:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.131959:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759444.131966:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759444.132097:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232869376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.132103:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00100000:0.0:1782759444.132188:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232869376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.132201:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.132209:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759444.132267:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232869504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.132294:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759444.132350:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759444.132432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869504 00000100:00100000:2.0:1782759444.132436:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869504 00000100:00100000:2.0:1782759444.132505:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:2.0:1782759444.132513:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232869504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759444.132603:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232869504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (307us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759444.132610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1782759444.132671:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232869504:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759444.132698:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759444.132703:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759444.132711:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759444.316616:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759444.316687:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490112 00000100:00100000:0.0:1782759444.316698:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490112 00000100:00100000:0.0:1782759444.316789:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3127 00000100:00100000:0.0:1782759444.316800:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218490112:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.316818:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759444.316837:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2726c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.316865:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.316877:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.316885:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc000, rc 0) 00000100:00100000:0.0:1782759444.316955:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218490112:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 156us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.316962:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3127 00000100:00100000:3.0:1782759444.322770:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759444.322843:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490240 00000100:00100000:1.0:1782759444.322853:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490240 00000100:00100000:1.0:1782759444.323000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3128 00000100:00100000:1.0:1782759444.323012:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218490240:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.323446:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218490240:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 436us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.323455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3128 00000100:00100000:1.0:1782759444.328060:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759444.328167:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490368 00000100:00100000:0.0:1782759444.328178:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490368 00000100:00100000:0.0:1782759444.328235:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3129 00000100:00100000:0.0:1782759444.328245:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218490368:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759444.328397:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218490368:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.328411:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3129 00000100:00100000:2.0:1782759444.332309:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759444.332481:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490496 00000100:00100000:1.0:1782759444.332491:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490496 00000100:00100000:1.0:1782759444.332547:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3130 00000100:00100000:1.0:1782759444.332556:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105337:x1869355218490496:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759444.332732:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105337:x1869355218490496:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 176us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.332740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3130 00000100:00100000:3.0:1782759444.334727:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759444.335014:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490624 00000100:00100000:2.0:1782759444.335023:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490624 00000100:00100000:2.0:1782759444.335085:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3131 00000100:00100000:2.0:1782759444.335097:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105337:x1869355218490624:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759444.335262:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105337:x1869355218490624:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 167us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.335270:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3131 00000100:00100000:2.0:1782759444.341104:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759444.341255:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490752 00000100:00100000:0.0:1782759444.341266:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490752 00000100:00100000:0.0:1782759444.341324:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3132 00000100:00100000:0.0:1782759444.341336:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218490752:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759444.341353:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759444.341371:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27273 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.341400:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.341412:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759444.341422:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4ddc00, rc 0) 00000100:00100000:0.0:1782759444.341485:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218490752:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 152us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759444.341492:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3132 00000100:00100000:3.0:1782759444.344609:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759444.345051:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218490880 00000100:00100000:1.0:1782759444.345062:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218490880 00000100:00100000:1.0:1782759444.345119:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3133 00000100:00100000:1.0:1782759444.345129:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218490880:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759444.345375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218490880:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 246us (798us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759444.345383:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3133 00000100:00100000:2.0:1782759444.364251:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759444.366769:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232869632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759444.366848:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759444.367331:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869632 00000100:00100000:3.0:1782759444.367340:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869632 00000100:00100000:3.0:1782759444.367463:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:3.0:1782759444.367474:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232869632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759444.367512:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:3.0:1782759444.367603:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232869632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.367611:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1782759444.367696:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232869632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759444.701670:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759444.701708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759444.701743:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759444.701771:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759444.701798:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491008 00000100:00100000:3.0:1782759444.701806:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491008 00000100:00100000:3.0:1782759444.701854:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491136 00000100:00100000:3.0:1782759444.701867:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491136 00000100:00100000:3.0:1782759444.701897:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4945 00000100:00100000:3.0:1782759444.701906:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218491008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759444.701968:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218491008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.701975:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4945 00000100:00100000:3.0:1782759444.701989:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4946 00000100:00100000:3.0:1782759444.701994:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218491136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759444.702015:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218491136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.702020:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4946 00000100:00100000:3.0:1782759444.702036:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491264 00000100:00100000:3.0:1782759444.702038:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491264 00000100:00100000:3.0:1782759444.702059:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491392 00000100:00100000:3.0:1782759444.702061:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491392 00000100:00100000:3.0:1782759444.702076:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2839 00000100:00100000:3.0:1782759444.702081:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218491264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759444.702101:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218491264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.702107:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2839 00000100:00100000:3.0:1782759444.702115:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2840 00000100:00100000:3.0:1782759444.702120:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218491392:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759444.702152:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218491392:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759444.702158:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2840 00000100:00080000:3.0:1782759444.702179:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759444.702183:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759444.702185:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759444.702187:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759444.815419:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759444.874784:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232869760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759444.874851:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759444.874983:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869760 00000100:00100000:2.0:1782759444.874991:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869760 00000100:00100000:2.0:1782759444.875053:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1782759444.875064:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232869760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759444.875092:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759444.878237:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232869760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3167us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759444.878250:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1782759444.878373:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232869760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759444.882897:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759444.882919:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232869888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759444.882981:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759444.883046:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232869888 00000100:00100000:1.0:1782759444.883052:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232869888 00000100:00100000:1.0:1782759444.883094:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1782759444.883102:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232869888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759444.883124:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759444.883186:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232869888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759444.883193:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1782759444.883240:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232869888:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1782759445.442801:0:142770:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd8176efd0 20000000:00000080:1.0:1782759445.442816:0:142770:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8cddc36ae000 uarg=0000000000000000 00000040:00100000:1.0:1782759445.444917:0:142770:0:(llog.c:1067:llog_reverse_process()) index 60 : idx 49 20000000:01000000:1.0:1782759445.444927:0:142770:0:(mgs_llog.c:960:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool64c lustre-OST0000_UUID 20000000:01000000:1.0:1782759445.444942:0:142770:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool64c fl=4 20000000:01000000:1.0:1782759445.445921:0:142771:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 52 marker 43 1->4: lustre-clilov new lustre.pool64c 20000000:01000000:1.0:1782759445.445977:0:142771:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 54 marker 43 2->4: lustre-clilov new lustre.pool64c 00000040:00080000:1.0:1782759445.445992:0:142771:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:2.0:1782759445.446188:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18880 20000000:01000000:2.0:1782759445.446209:0:142770:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool64c (null) (null) 00000040:00080000:2.0:1782759445.446223:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 104 off18984 00000040:00080000:2.0:1782759445.446237:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19208 20000000:01000000:2.0:1782759445.446251:0:142770:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool64c fl=4 20000000:01000000:2.0:1782759445.446500:0:142772:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0000-mdtlov new lustre.pool64c 20000000:01000000:2.0:1782759445.446527:0:142772:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0000-mdtlov new lustre.pool64c 00000040:00080000:2.0:1782759445.446541:0:142772:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:1.0:1782759445.446705:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18000 20000000:01000000:1.0:1782759445.446717:0:142770:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool64c (null) (null) 00000040:00080000:1.0:1782759445.446730:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 112 off18112 00000040:00080000:1.0:1782759445.446746:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18336 20000000:01000000:1.0:1782759445.446757:0:142770:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool64c fl=4 20000000:01000000:1.0:1782759445.448347:0:142773:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 46 marker 45 1->4: lustre-MDT0001-mdtlov new lustre.pool64c 20000000:01000000:1.0:1782759445.448399:0:142773:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 49 marker 45 2->4: lustre-MDT0001-mdtlov new lustre.pool64c 00000040:00080000:1.0:1782759445.448415:0:142773:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:2.0:1782759445.448615:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18000 20000000:01000000:2.0:1782759445.448635:0:142770:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool64c (null) (null) 00000040:00080000:2.0:1782759445.448653:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 112 off18112 00000040:00080000:2.0:1782759445.448669:0:142770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18336 10000000:01000000:2.0:1782759445.448683:0:142770:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782759445.448701:0:142770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448718:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448743:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448749:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448756:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448762:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448769:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448776:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448783:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448789:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448800:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448806:0:142770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448823:0:142770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448858:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448873:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 9 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.448887:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870016:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759445.448978:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.448986:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 9 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.448994:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870144:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759445.449019:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.449026:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 23 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.449035:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870272:0@lo:104: 00000100:00100000:2.0:1782759445.449069:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759445.449107:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.449139:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 23 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.449147:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870400:0@lo:104: 00000100:00100000:3.0:1782759445.449160:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232870272 00000100:00100000:3.0:1782759445.449167:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232870272 00000100:00100000:2.0:1782759445.449168:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759445.449198:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.449206:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 23 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449208:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232870400 00000100:00100000:3.0:1782759445.449211:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232870400 00000100:00100000:2.0:1782759445.449214:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870528:0@lo:104: 00000100:00100000:3.0:1782759445.449228:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:2.0:1782759445.449235:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.449236:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:142770:x1869355232870272:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449248:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.449249:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.449256:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 23 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.449263:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870656:0@lo:104: 00010000:00010000:2.0:1782759445.449283:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.449290:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 23 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449293:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759445.449298:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870784:0@lo:104: 00000100:00100000:3.0:1782759445.449299:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:142770:x1869355232870272:12345-0@lo:104: Request processed in 63us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.449306:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00010000:00010000:2.0:1782759445.449319:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449328:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1782759445.449332:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 23 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.449339:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870912:0@lo:104: 00000100:00100000:3.0:1782759445.449341:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.449351:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.449356:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232870528 00000100:00100000:2.0:1782759445.449358:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.449359:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232870528 00000100:00100000:3.0:1782759445.449370:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232870656 00000100:00100000:3.0:1782759445.449372:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232870656 00010000:00010000:2.0:1782759445.449372:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232870784 00010000:00010000:2.0:1782759445.449380:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 23 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449381:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232870784 00000100:00100000:2.0:1782759445.449388:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232871040:0@lo:104: 00000100:00100000:3.0:1782759445.449389:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232870912 00000100:00100000:3.0:1782759445.449396:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232870912 00000100:00100000:2.0:1782759445.449404:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.449407:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871040 00000100:00100000:3.0:1782759445.449409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871040 00010000:00010000:2.0:1782759445.449418:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449419:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1782759445.449424:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142770:x1869355232870400:12345-0@lo:104: 00010000:00010000:2.0:1782759445.449426:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 23 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449431:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.449434:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232871168:0@lo:104: 00000100:00100000:2.0:1782759445.449455:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759445.449460:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759445.449465:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142770:x1869355232870400:12345-0@lo:104: Request processed in 40us (296us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759445.449468:0:142770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449470:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00010000:00010000:2.0:1782759445.449476:0:142770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 23 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.449480:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871168 00000100:00100000:3.0:1782759445.449482:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871168 00000100:00100000:2.0:1782759445.449483:0:142770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232871296:0@lo:104: 00000100:00100000:3.0:1782759445.449492:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1782759445.449497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142770:x1869355232870528:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449503:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.449507:0:142770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759445.449516:0:142770:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c540 going to sleep for 11 seconds 00010000:00010000:3.0:1782759445.449529:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782759445.449533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142770:x1869355232870528:12345-0@lo:104: Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759445.449535:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870272:0@lo:104: 00000100:00100000:3.0:1782759445.449539:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:2.0:1782759445.449542:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870400:0@lo:104: 00000100:00100000:2.0:1782759445.449548:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870528:0@lo:104: 00000100:00100000:3.0:1782759445.449566:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871296 00000100:00100000:3.0:1782759445.449570:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871296 00000100:00100000:3.0:1782759445.449604:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1782759445.449610:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142770:x1869355232870656:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449617:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449656:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782759445.449660:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:142770:x1869355232870656:12345-0@lo:104: Request processed in 52us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.449666:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1782759445.449677:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1782759445.449682:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+7:142770:x1869355232870784:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449688:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449709:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782759445.449714:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+7:142770:x1869355232870784:12345-0@lo:104: Request processed in 32us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.449719:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:3.0:1782759445.449731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1782759445.449736:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:142770:x1869355232870912:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449742:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449765:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782759445.449769:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:142770:x1869355232870912:12345-0@lo:104: Request processed in 34us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.449774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:3.0:1782759445.449787:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1782759445.449793:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:142770:x1869355232871040:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449799:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449884:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782759445.449890:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:142770:x1869355232871040:12345-0@lo:104: Request processed in 97us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.449896:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:3.0:1782759445.449907:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1782759445.449912:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:142770:x1869355232871168:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449919:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449941:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1782759445.449945:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:142770:x1869355232871168:12345-0@lo:104: Request processed in 34us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.449950:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1782759445.449960:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1782759445.449965:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:142770:x1869355232871296:12345-0@lo:104: 00010000:00010000:3.0:1782759445.449971:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.449991:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1782759445.449995:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:142770:x1869355232871296:12345-0@lo:104: Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.450001:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00010000:00010000:3.0:1782759445.450018:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1782759445.450023:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450039:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450043:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450052:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450058:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450065:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450104:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450112:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450142:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450150:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c2e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450164:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1782759445.450167:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450172:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450175:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450191:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450198:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450203:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782759445.450211:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870656:0@lo:104: 00000100:00100000:2.0:1782759445.450219:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870784:0@lo:104: 00000100:00100000:2.0:1782759445.450225:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870912:0@lo:104: 00010000:00010000:3.0:1782759445.450227:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.450231:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232871040:0@lo:104: 00010000:00010000:3.0:1782759445.450233:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759445.450238:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232871168:0@lo:104: 00010000:00010000:3.0:1782759445.450239:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.450244:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232871296:0@lo:104: 00010000:00010000:3.0:1782759445.450246:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c2d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2d9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450254:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782759445.450257:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450263:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450266:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450272:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450278:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450290:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450312:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450318:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450335:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450342:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60c2c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450351:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782759445.450354:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450359:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450362:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450368:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450374:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450378:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450388:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450393:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450404:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450411:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60c2b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2bd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450419:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782759445.450422:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450428:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450430:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450436:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450442:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450447:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450457:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450463:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450467:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450473:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c2a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2af expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450480:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782759445.450487:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450493:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450496:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450502:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450508:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450513:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450629:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450637:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450642:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450648:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c29a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c2a1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450657:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782759445.450661:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450667:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450670:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450687:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450693:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450699:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450716:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450721:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450726:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450732:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429c00/0xd5b45c7f5c60c28c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c293 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450741:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759445.450743:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450748:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450751:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450758:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450764:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450773:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450782:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450788:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450791:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450798:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429e00/0xd5b45c7f5c60c27e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c285 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450804:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759445.450807:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450812:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759445.450815:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450821:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759445.450827:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759445.450832:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759445.450840:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450845:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759445.450852:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c277 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.450870:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759445.450871:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759445.450873:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759445.450879:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759445.450883:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759445.450892:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232871424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.450922:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.450945:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232871936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.450960:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.450971:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232872448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.450984:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451000:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759445.451004:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232871552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.451019:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451028:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232872064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.451042:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451061:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232871808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.451077:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451089:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232872320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.451105:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451119:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782759445.451137:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232871680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.451155:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451163:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232872192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.451176:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759445.451193:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871424 00000100:00100000:3.0:1782759445.451197:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871424 00010000:00010000:3.0:1782759445.451215:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 24 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451229:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871936 00000100:00100000:3.0:1782759445.451231:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871936 00010000:00010000:3.0:1782759445.451239:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 25 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451247:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872448 00000100:00100000:3.0:1782759445.451249:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872448 00010000:00010000:3.0:1782759445.451256:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 26 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451264:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871552 00000100:00100000:3.0:1782759445.451266:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871552 00010000:00010000:3.0:1782759445.451272:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 27 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451279:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872064 00000100:00100000:3.0:1782759445.451281:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872064 00010000:00010000:3.0:1782759445.451288:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 28 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451295:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871808 00000100:00100000:3.0:1782759445.451297:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871808 00010000:00010000:3.0:1782759445.451310:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 29 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451319:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872320 00000100:00100000:3.0:1782759445.451321:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872320 00010000:00010000:3.0:1782759445.451328:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 30 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451336:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232871680 00000100:00100000:3.0:1782759445.451337:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232871680 00010000:00010000:3.0:1782759445.451344:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 31 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451352:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872192 00000100:00100000:3.0:1782759445.451354:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872192 00010000:00010000:3.0:1782759445.451361:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 32 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.451372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1782759445.451377:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+32:3662:x1869355232871424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451387:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451391:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 32 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451401:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 32 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451413:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c2e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2e0 expref: 32 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451423:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451448:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+31:3662:x1869355232871424:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1782759445.451544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1782759445.451549:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+30:3662:x1869355232871936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451556:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451561:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 30 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451569:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 30 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451596:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c2af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2a8 expref: 30 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451605:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451624:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+29:3662:x1869355232871936:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:3.0:1782759445.451640:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1782759445.451644:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+28:3662:x1869355232872448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451651:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451655:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 28 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451663:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 28 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451672:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c270 expref: 28 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451688:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451704:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+27:3662:x1869355232872448:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451710:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:3.0:1782759445.451719:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1782759445.451724:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+26:3662:x1869355232871552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451730:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451734:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 26 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451742:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 26 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451751:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60c2d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2d2 expref: 26 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451758:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451773:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+25:3662:x1869355232871552:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451778:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:3.0:1782759445.451787:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1782759445.451791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232872064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451798:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451802:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 24 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451810:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 24 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451823:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c2a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c29a expref: 24 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451831:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451847:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232872064:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451852:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1782759445.451862:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1782759445.451867:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+22:3665:x1869355232871808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451873:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451876:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 22 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451884:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 22 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451892:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c2bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2b6 expref: 22 pid: 6526 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451899:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451918:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+21:3665:x1869355232871808:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451923:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:3.0:1782759445.451932:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1782759445.451937:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+20:3665:x1869355232872320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.451942:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.451945:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 20 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451957:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 20 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451966:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c27e expref: 20 pid: 6525 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.451974:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.451990:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+19:3665:x1869355232872320:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.451996:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1782759445.452035:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1782759445.452039:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+18:3665:x1869355232871680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.452044:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.452048:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 18 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452056:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 18 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452064:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c2cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c2c4 expref: 18 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452071:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.452086:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+17:3665:x1869355232871680:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.452091:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1782759445.452099:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1782759445.452104:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+16:3665:x1869355232872192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.452114:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.452117:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 16 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452215:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 16 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452225:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4000/0xd5b45c7f5c60c293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c28c expref: 16 pid: 6524 timeout: 3635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452234:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.452255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+15:3665:x1869355232872192:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.452260:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1782759445.452295:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232871552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452303:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232872064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452310:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232871424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452317:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232871936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452323:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232872448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452410:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759445.452472:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759445.452495:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232871680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452503:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232872192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452510:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232871808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452523:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232872320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759445.452546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491520 00000100:00100000:3.0:1782759445.452550:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491520 00010000:00010000:3.0:1782759445.452565:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 10 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.452643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491648 00000100:00100000:3.0:1782759445.452647:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491648 00010000:00010000:3.0:1782759445.452658:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 11 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759445.452670:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 768 00000100:00100000:3.0:1782759445.452676:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+11:2403:x1869355218491520:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.452683:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.452687:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 11 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452696:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 11 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452706:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.452735:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+11:2403:x1869355218491520:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 59us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.452742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 768 00000100:00100000:3.0:1782759445.452753:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 769 00000100:00100000:3.0:1782759445.452759:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218491648:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759445.452765:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759445.452776:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 10 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452784:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 10 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452795:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452803:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452815:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452822:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452829:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452835:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452841:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759445.452845:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452853:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452860:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.452873:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759445.452889:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218491648:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 130us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759445.452895:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 769 00010000:00010000:2.0:1782759445.455283:0:142770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c2f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27273 expref: 9 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.455304:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870016:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759445.455316:0:142770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60c2ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2726c expref: 8 pid: 6526 timeout: 3585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759445.455324:0:142770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142770:1869355232870144:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759445.455381:0:142770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.455392:0:142770:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.455398:0:142770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759445.455418:0:142770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c2fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759445.834884:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759446.303526:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759446.303732:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491776 00000100:00100000:2.0:1782759446.303740:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491776 00000100:00100000:2.0:1782759446.303791:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3134 00000100:00100000:2.0:1782759446.303799:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218491776:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759446.303813:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759446.303829:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2727a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.303850:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.303858:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.303864:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759446.303911:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218491776:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.303916:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3134 00000100:00100000:3.0:1782759446.306338:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759446.306730:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218491904 00000100:00100000:0.0:1782759446.306739:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218491904 00000100:00100000:0.0:1782759446.306802:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3135 00000100:00100000:0.0:1782759446.306812:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218491904:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.307229:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218491904:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 418us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.307237:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3135 00000100:00100000:3.0:1782759446.308877:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759446.308943:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492032 00000100:00100000:2.0:1782759446.308951:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492032 00000100:00100000:2.0:1782759446.309017:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3136 00000100:00100000:2.0:1782759446.309028:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218492032:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.309138:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218492032:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.309152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3136 00000100:00100000:1.0:1782759446.312202:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759446.312273:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492160 00000100:00100000:0.0:1782759446.312283:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492160 00000100:00100000:0.0:1782759446.312337:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3137 00000100:00100000:0.0:1782759446.312345:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105355:x1869355218492160:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759446.312537:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105355:x1869355218492160:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 191us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.312544:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3137 00000100:00100000:3.0:1782759446.315243:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759446.315377:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492288 00000100:00100000:2.0:1782759446.315387:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492288 00000100:00100000:2.0:1782759446.315450:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3138 00000100:00100000:2.0:1782759446.315463:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105355:x1869355218492288:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759446.315637:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:105355:x1869355218492288:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.315646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3138 00000100:00100000:3.0:1782759446.318106:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759446.318906:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492416 00000100:00100000:0.0:1782759446.318916:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492416 00000100:00100000:0.0:1782759446.319606:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3139 00000100:00100000:0.0:1782759446.319619:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218492416:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759446.319636:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759446.319652:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27281 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.319681:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.319692:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.319702:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc800, rc 0) 00000100:00100000:0.0:1782759446.319765:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218492416:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 149us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.319772:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3139 00000100:00100000:1.0:1782759446.326385:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759446.326551:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492544 00000100:00100000:2.0:1782759446.326559:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492544 00000100:00100000:2.0:1782759446.326638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3140 00000100:00100000:2.0:1782759446.326660:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218492544:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.326819:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218492544:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 163us (442us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759446.326826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3140 10000000:01000000:3.0:1782759446.666697:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759446.666704:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 61 10000000:01000000:3.0:1782759446.666710:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759446.666763:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.666774:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.666782:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.666803:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232872576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.666859:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.666978:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.667103:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872576 00000100:00100000:0.0:1782759446.667110:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872576 00000100:00100000:0.0:1782759446.667227:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:0.0:1782759446.667236:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355232872576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759446.667249:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759446.667261:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c311 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.667284:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.667294:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.667301:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd200, rc 0) 00000100:00100000:0.0:1782759446.667347:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232872576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.667356:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1782759446.667393:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232872576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759446.667410:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.667430:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.667504:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232872704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.667541:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.667559:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.667563:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872704 00000100:00100000:0.0:1782759446.667568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872704 00000100:00100000:0.0:1782759446.667742:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:0.0:1782759446.667750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232872704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.667866:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232872704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.667872:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1782759446.667932:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232872704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.667960:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232872832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.667999:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.668105:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.668146:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872832 00000100:00100000:1.0:1782759446.668151:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872832 00000100:00100000:2.0:1782759446.668220:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:2.0:1782759446.668238:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232872832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.668305:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232872832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.668310:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00100000:3.0:1782759446.668336:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232872832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.668725:0:142774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142774:1869355232872960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.668763:0:142774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.668781:0:142774:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.668801:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232872960 00000100:00100000:1.0:1782759446.668806:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232872960 00000100:00100000:1.0:1782759446.668839:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:1.0:1782759446.668847:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:142774:x1869355232872960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.668933:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:142774:x1869355232872960:12345-0@lo:502:llog_process_th.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.668940:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00100000:2.0:1782759446.668966:0:142774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142774:1869355232872960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.669006:0:142774:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142774:1869355232873088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.669029:0:142774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.669049:0:142774:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.669099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873088 00000100:00100000:0.0:1782759446.669103:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873088 00000100:00100000:0.0:1782759446.669141:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3145 00000100:00100000:0.0:1782759446.669149:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:142774:x1869355232873088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759446.669260:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:142774:x1869355232873088:12345-0@lo:502:llog_process_th.0 Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.669269:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3145 00000100:00100000:2.0:1782759446.669315:0:142774:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142774:1869355232873088:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1782759446.669329:0:142774:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1782759446.669472:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1782759446.669497:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759446.669504:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.669515:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759446.669523:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759446.669525:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1782759446.669528:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759446.669545:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.669554:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.669568:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.669692:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.669713:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.669754:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.669778:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873216 00000100:00100000:1.0:1782759446.669781:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873216 00000100:00100000:1.0:1782759446.669802:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3146 00000100:00100000:1.0:1782759446.669822:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355232873216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759446.669830:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759446.669841:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c31f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.669857:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.669864:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.669868:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429600, rc 0) 00000100:00100000:1.0:1782759446.669899:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232873216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.669905:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3146 00000100:00100000:3.0:1782759446.669924:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759446.669935:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.669952:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.669990:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.670007:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.670025:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.670047:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873344 00000100:00100000:0.0:1782759446.670051:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873344 00000100:00100000:0.0:1782759446.670080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:0.0:1782759446.670086:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232873344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.670182:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232873344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.670188:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:3.0:1782759446.670316:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.670338:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.670371:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.670398:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.670403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873472 00000100:00100000:1.0:1782759446.670407:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873472 00000100:00100000:1.0:1782759446.670440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1782759446.670446:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232873472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.670516:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232873472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.670524:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:3.0:1782759446.670627:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782759446.671335:0:142775:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1782759446.671403:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1782759446.671421:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1782759446.671428:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.671437:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759446.671446:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759446.671448:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 61 10000000:01000000:1.0:1782759446.671451:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759446.671470:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.671477:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.671486:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.671500:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.671532:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.671631:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79b780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.671681:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873600 00000100:00100000:0.0:1782759446.671686:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873600 00000100:00100000:0.0:1782759446.671744:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:0.0:1782759446.671750:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355232873600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759446.671757:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759446.671765:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c32d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.671777:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.671783:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.671788:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc200, rc 0) 00000100:00100000:0.0:1782759446.671824:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232873600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.671831:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:3.0:1782759446.671837:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759446.671848:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.671863:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.671901:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.671926:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.671984:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.672011:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873728 00000100:00100000:1.0:1782759446.672020:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873728 00000100:00100000:1.0:1782759446.672129:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:1.0:1782759446.672137:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232873728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.672237:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232873728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.672244:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00000100:00100000:3.0:1782759446.672265:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.672287:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.672318:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.672335:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.672364:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873856 00000100:00100000:0.0:1782759446.672374:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873856 00000100:00100000:0.0:1782759446.672418:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151 00000100:00100000:0.0:1782759446.672426:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232873856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.672508:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232873856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.672516:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151 00000100:00100000:3.0:1782759446.672523:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232873856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.672773:0:142776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142776:1869355232873984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.672806:0:142776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.672834:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232873984 00000100:00100000:1.0:1782759446.672838:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232873984 00000100:00100000:3.0:1782759446.672840:0:142776:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.672863:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:1.0:1782759446.672868:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:142776:x1869355232873984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.672950:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:142776:x1869355232873984:12345-0@lo:502:llog_process_th.0 Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.672957:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00000100:00100000:3.0:1782759446.672977:0:142776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142776:1869355232873984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.673016:0:142776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142776:1869355232874112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.673045:0:142776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.673068:0:142776:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.673124:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874112 00000100:00100000:2.0:1782759446.673128:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874112 00000100:00100000:2.0:1782759446.673167:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:2.0:1782759446.673175:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:142776:x1869355232874112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.673286:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:142776:x1869355232874112:12345-0@lo:502:llog_process_th.0 Request processed in 112us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.673292:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:3.0:1782759446.673356:0:142776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142776:1869355232874112:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759446.673372:0:142776:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1782759446.675188:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1782759446.675222:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759446.675233:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.675245:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759446.675255:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1782759446.675258:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1782759446.675260:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1782759446.675291:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.675299:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.675318:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.675338:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.675388:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.675428:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.675563:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874240 00000100:00100000:2.0:1782759446.675568:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874240 00000100:00100000:2.0:1782759446.675633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:2.0:1782759446.675651:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355232874240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759446.675663:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759446.675675:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c33b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.675696:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.675711:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.675719:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759446.676257:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232874240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 615us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.676265:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:1.0:1782759446.676344:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759446.676358:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.676367:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.676423:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.676448:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.677062:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79b780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.679277:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874368 00000100:00100000:2.0:1782759446.679290:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874368 00000100:00100000:2.0:1782759446.679361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:2.0:1782759446.679372:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232874368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.679551:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232874368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (3101us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.679559:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:3.0:1782759446.679712:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.679765:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.679828:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.679859:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.679885:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874496 00000100:00100000:2.0:1782759446.679890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874496 00000100:00100000:2.0:1782759446.679920:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:2.0:1782759446.679930:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232874496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.680235:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232874496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 306us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.680242:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:3.0:1782759446.681062:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759446.681857:0:142777:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1782759446.684341:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1782759446.684367:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759446.684376:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.684385:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759446.684393:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759446.684395:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 61 10000000:01000000:3.0:1782759446.684397:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759446.684426:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.684432:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.684439:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.684455:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.684511:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.684549:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.684568:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874624 00000100:00100000:1.0:1782759446.684591:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874624 00000100:00100000:1.0:1782759446.684780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:1.0:1782759446.684793:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355232874624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759446.684808:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759446.684821:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c349 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.684845:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.684872:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.684881:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429200, rc 0) 00000100:00100000:1.0:1782759446.684925:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232874624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.684933:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:3.0:1782759446.684947:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759446.684959:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.684971:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.685013:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.685034:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.685058:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.685799:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874752 00000100:00100000:2.0:1782759446.685805:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874752 00000100:00100000:2.0:1782759446.685848:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:2.0:1782759446.685858:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232874752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.685981:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232874752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.685989:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:3.0:1782759446.688553:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.688631:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.688699:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.688721:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.689030:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232874880 00000100:00100000:1.0:1782759446.689036:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232874880 00000100:00100000:1.0:1782759446.689080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:1.0:1782759446.689088:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232874880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.689389:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232874880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.689399:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:3.0:1782759446.689420:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232874880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.689784:0:142778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142778:1869355232875008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.689822:0:142778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.689847:0:142778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.689855:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875008 00000100:00100000:2.0:1782759446.689862:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875008 00000100:00100000:2.0:1782759446.689903:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:2.0:1782759446.689918:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:142778:x1869355232875008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.690005:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:142778:x1869355232875008:12345-0@lo:502:llog_process_th.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.690012:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:3.0:1782759446.690341:0:142778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142778:1869355232875008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.690383:0:142778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142778:1869355232875136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.690418:0:142778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.690436:0:142778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.690464:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875136 00000100:00100000:1.0:1782759446.690470:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875136 00000100:00100000:1.0:1782759446.690541:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:1.0:1782759446.690549:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:142778:x1869355232875136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.690643:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:142778:x1869355232875136:12345-0@lo:502:llog_process_th.0 Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.690649:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:3.0:1782759446.690724:0:142778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142778:1869355232875136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759446.690741:0:142778:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1782759446.690814:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1782759446.690843:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782759446.690852:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.690872:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759446.690880:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1782759446.690883:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:1.0:1782759446.690886:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1782759446.690907:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.690914:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.690923:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.690936:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.690962:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.690990:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.691039:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875264 00000100:00100000:2.0:1782759446.691043:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875264 00000100:00100000:2.0:1782759446.691124:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:2.0:1782759446.691144:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355232875264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759446.691154:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759446.691174:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c357 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.691195:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.691205:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.691214:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649000, rc 0) 00000100:00100000:2.0:1782759446.691248:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232875264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.691254:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00100000:1.0:1782759446.691310:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759446.691322:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.691331:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.691383:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.691407:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.691791:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.691827:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875392 00000100:00100000:0.0:1782759446.691832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875392 00000100:00100000:0.0:1782759446.691856:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:0.0:1782759446.691863:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232875392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.692008:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232875392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.692015:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:1.0:1782759446.692272:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.692297:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.692332:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.692355:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759446.692430:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875520 00000100:00100000:3.0:1782759446.692435:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875520 00000100:00100000:3.0:1782759446.692468:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:3.0:1782759446.692475:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232875520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.692551:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232875520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759446.692559:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00100000:1.0:1782759446.692723:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.693736:0:142779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142779:1869355232875648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.693779:0:142779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.693810:0:142779:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.693850:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875648 00000100:00100000:2.0:1782759446.693854:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875648 00000100:00100000:2.0:1782759446.693937:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1782759446.693947:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:142779:x1869355232875648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.694033:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:142779:x1869355232875648:12345-0@lo:502:llog_process_th.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.694054:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:1.0:1782759446.694128:0:142779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142779:1869355232875648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759446.694151:0:142779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782759446.694170:0:142779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759446.694172:0:142779:0:(obd_config.c:1561:class_process_config()) marker 54 (0x1) lustre-MDT0001-m del lustre.pool64c 00000020:00000080:1.0:1782759446.694179:0:142779:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1782759446.694286:0:142779:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142779:1869355232875776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.694315:0:142779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.694511:0:142779:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.694746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875776 00000100:00100000:0.0:1782759446.694751:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875776 00000100:00100000:0.0:1782759446.694774:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1782759446.694781:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:142779:x1869355232875776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759446.694855:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:142779:x1869355232875776:12345-0@lo:502:llog_process_th.0 Request processed in 74us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.694862:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1782759446.695002:0:142779:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142779:1869355232875776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759446.695020:0:142779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759446.695025:0:142779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759446.695026:0:142779:0:(obd_config.c:1561:class_process_config()) marker 54 (0x2) lustre-MDT0001-m del lustre.pool64c 00000040:00080000:0.0:1782759446.695030:0:142779:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:2.0:1782759446.695298:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:2.0:1782759446.695320:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782759446.695330:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.695340:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759446.695349:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759446.695352:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 61 10000000:01000000:2.0:1782759446.695355:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759446.695378:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.695386:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.695395:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759446.695409:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.695440:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.695470:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.695509:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232875904 00000100:00100000:0.0:1782759446.695518:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232875904 00000100:00100000:0.0:1782759446.695553:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:0.0:1782759446.695560:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355232875904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759446.695567:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759446.695597:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c365 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.695617:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.695627:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.695635:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd600, rc 0) 00000100:00100000:0.0:1782759446.695663:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232875904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.695668:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:2.0:1782759446.695741:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232875904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759446.695752:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.695770:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759446.695813:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.695837:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.695863:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.696885:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876032 00000100:00100000:0.0:1782759446.696893:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876032 00000100:00100000:0.0:1782759446.696930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:0.0:1782759446.696938:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232876032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.697132:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232876032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.697140:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:2.0:1782759446.697301:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.697334:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.697381:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.697412:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.697456:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876160 00000100:00100000:0.0:1782759446.697460:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876160 00000100:00100000:0.0:1782759446.697491:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:0.0:1782759446.697498:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232876160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.697612:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232876160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.697618:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:2.0:1782759446.697701:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759446.705878:0:142780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142780:1869355232876288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.705968:0:142780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.706036:0:142780:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec4c049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.706871:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876288 00000100:00100000:0.0:1782759446.706879:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876288 00000100:00100000:0.0:1782759446.706961:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:0.0:1782759446.706970:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:142780:x1869355232876288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759446.707126:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:142780:x1869355232876288:12345-0@lo:502:llog_process_th.0 Request processed in 157us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759446.707134:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:3.0:1782759446.707179:0:142780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142780:1869355232876288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.707235:0:142780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142780:1869355232876416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.707280:0:142780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.707313:0:142780:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.707326:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876416 00000100:00100000:1.0:1782759446.707331:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876416 00000100:00100000:1.0:1782759446.707357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:1.0:1782759446.707364:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:142780:x1869355232876416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.707439:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:142780:x1869355232876416:12345-0@lo:502:llog_process_th.0 Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.707446:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1782759446.707476:0:142780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142780:1869355232876416:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782759446.707497:0:142780:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1782759446.707631:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1782759446.707660:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759446.707670:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.707682:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759446.707690:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782759446.707692:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:0.0:1782759446.707695:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782759446.707717:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.707725:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759446.707734:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759446.707752:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.707780:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759446.707885:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.707922:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876544 00000100:00100000:1.0:1782759446.707931:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876544 00000100:00100000:1.0:1782759446.707986:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:1.0:1782759446.707993:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355232876544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759446.708001:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759446.708011:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c373 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.708029:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.708037:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.708057:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759446.708096:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232876544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.708101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:3.0:1782759446.708299:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759446.708313:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.708322:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759446.708364:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.708391:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.708408:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.708435:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876672 00000100:00100000:1.0:1782759446.708440:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876672 00000100:00100000:1.0:1782759446.708495:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173 00000100:00100000:1.0:1782759446.708501:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232876672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.708638:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232876672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.708646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173 00000100:00100000:3.0:1782759446.708651:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.708680:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.708715:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759446.710687:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876800 00000100:00100000:2.0:1782759446.710697:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876800 00000100:00100000:3.0:1782759446.710718:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.710742:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:1.0:1782759446.710752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232876800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.710864:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232876800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.710878:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000100:00100000:3.0:1782759446.711375:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232876800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759446.711733:0:142781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142781:1869355232876928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759446.711779:0:142781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759446.711809:0:142781:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.711885:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232876928 00000100:00100000:2.0:1782759446.711890:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232876928 00000100:00100000:2.0:1782759446.711927:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:2.0:1782759446.711936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:142781:x1869355232876928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759446.712030:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:142781:x1869355232876928:12345-0@lo:502:llog_process_th.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.712037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00100000:0.0:1782759446.712124:0:142781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142781:1869355232876928:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759446.712149:0:142781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759446.712158:0:142781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759446.712161:0:142781:0:(obd_config.c:1561:class_process_config()) marker 53 (0x1) lustre-MDT0000-m del lustre.pool64c 00000020:00000080:0.0:1782759446.712165:0:142781:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1782759446.715490:0:142781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142781:1869355232877056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759446.715553:0:142781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759446.715605:0:142781:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759446.715616:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877056 00000100:00100000:1.0:1782759446.715623:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877056 00000100:00100000:1.0:1782759446.715678:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176 00000100:00100000:1.0:1782759446.715687:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:142781:x1869355232877056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759446.715783:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:142781:x1869355232877056:12345-0@lo:502:llog_process_th.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759446.715790:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1782759446.715803:0:142781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:142781:1869355232877056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759446.715825:0:142781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759446.715831:0:142781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759446.715833:0:142781:0:(obd_config.c:1561:class_process_config()) marker 53 (0x2) lustre-MDT0000-m del lustre.pool64c 00000040:00080000:0.0:1782759446.715837:0:142781:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:1.0:1782759446.715980:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:1.0:1782759446.715995:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782759446.716002:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.716010:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759446.716017:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782759446.716019:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759446.716021:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782759446.716038:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.716043:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.716059:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.716068:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232877184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.716093:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.716119:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759446.716139:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877184 00000100:00100000:2.0:1782759446.716149:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877184 00000100:00100000:2.0:1782759446.716189:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:2.0:1782759446.716197:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232877184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759446.716206:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759446.716217:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c381 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.716238:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.716248:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759446.716257:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649a00, rc 0) 00000100:00100000:2.0:1782759446.716291:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232877184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759446.716297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:1.0:1782759446.716328:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232877184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759446.716340:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.716348:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759446.716386:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232877312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759446.716403:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759446.716419:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759446.716432:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877312 00000100:00100000:0.0:1782759446.716436:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877312 00000100:00100000:0.0:1782759446.716462:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00000100:00100000:0.0:1782759446.716467:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232877312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759446.716514:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232877312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (108us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759446.716520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:1.0:1782759446.716534:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232877312:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782759446.716554:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782759446.716560:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759446.716567:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759446.859142:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759447.434850:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232877440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759447.434939:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759447.435006:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877440 00000100:00100000:2.0:1782759447.435015:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877440 00000100:00100000:2.0:1782759447.435117:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:2.0:1782759447.435130:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232877440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759447.435166:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445896192 avail 1299656704 00000100:00100000:2.0:1782759447.435221:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232877440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759447.435230:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:3.0:1782759447.435301:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232877440:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759447.884626:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759448.458975:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232877568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759448.459050:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459079:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232877952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459121:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232878080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459130:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459160:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232878464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459167:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459192:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759448.459214:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232878592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459218:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232878976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459246:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459265:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759448.459266:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232879104:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459293:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459302:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759448.459311:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232877824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459317:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782759448.459326:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232877696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459351:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759448.459361:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459378:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232878336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459388:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232878208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459416:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759448.459429:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232878720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459446:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759448.459459:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232879232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459468:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759448.459479:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459496:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232878848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759448.459515:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878592 00000100:00100000:2.0:1782759448.459522:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878592 00000100:00100000:1.0:1782759448.459527:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759448.459561:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877568 00000100:00100000:1.0:1782759448.459566:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877568 00000100:00100000:2.0:1782759448.459604:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879104 00000100:00100000:2.0:1782759448.459607:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879104 00000100:00100000:1.0:1782759448.459629:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1782759448.459637:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878720 00000100:00100000:1.0:1782759448.459642:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232877568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759448.459643:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878720 00000100:00100000:2.0:1782759448.459661:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879232 00000100:00100000:2.0:1782759448.459665:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879232 00002000:00000024:1.0:1782759448.459673:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759448.459680:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1782759448.459688:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232878592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459721:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232877568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.459729:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:1.0:1782759448.459754:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877952 00000100:00100000:1.0:1782759448.459758:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877952 00000100:00100000:3.0:1782759448.459778:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1782759448.459789:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232879104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459799:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878208 00000100:00100000:1.0:1782759448.459803:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878208 00000100:00100000:1.0:1782759448.459826:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:3.0:1782759448.459831:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232879104:12345-0@lo:400:kworker.0 Request processed in 42us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.459838:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232877952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759448.459842:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:3.0:1782759448.459861:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:3.0:1782759448.459875:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232878720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.459883:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232877952:12345-0@lo:400:kworker.0 Request processed in 48us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759448.459906:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232878720:12345-0@lo:400:kworker.0 Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759448.459912:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:3.0:1782759448.459921:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:3.0:1782759448.459926:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232879232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759448.459949:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232879232:12345-0@lo:400:kworker.0 Request processed in 22us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.459961:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:3.0:1782759448.459962:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:1.0:1782759448.459981:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:1.0:1782759448.459989:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232878208:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759448.460009:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759448.460015:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759448.460025:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232878208:12345-0@lo:400:kworker.0 Request processed in 37us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460038:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00000100:00100000:1.0:1782759448.460057:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878080 00000100:00100000:1.0:1782759448.460061:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878080 00000100:00100000:2.0:1782759448.460171:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232878592:12345-0@lo:400:kworker.0 Request processed in 484us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759448.460178:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1782759448.460196:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878464 00000100:00100000:1.0:1782759448.460201:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878464 00000100:00100000:1.0:1782759448.460230:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878976 00000100:00100000:1.0:1782759448.460233:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878976 00000100:00100000:1.0:1782759448.460244:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877824 00000100:00100000:1.0:1782759448.460246:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877824 00000100:00100000:1.0:1782759448.460253:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878336 00000100:00100000:1.0:1782759448.460255:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878336 00000100:00100000:1.0:1782759448.460266:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232878848 00000100:00080000:3.0:1782759448.460269:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759448.460270:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232878848 00000100:00080000:3.0:1782759448.460276:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759448.460279:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759448.460290:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4947 00000100:00100000:1.0:1782759448.460297:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232878080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460330:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232878080:12345-0@lo:400:kworker.0 Request processed in 33us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460336:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4947 00000100:00100000:1.0:1782759448.460348:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1782759448.460354:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232878464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460380:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232878464:12345-0@lo:400:kworker.0 Request processed in 27us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460385:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4948 00000100:00100000:1.0:1782759448.460395:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4949 00000100:00100000:1.0:1782759448.460400:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232878976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460472:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232878976:12345-0@lo:400:kworker.0 Request processed in 72us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460478:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4949 00000100:00100000:1.0:1782759448.460495:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950 00000100:00100000:1.0:1782759448.460500:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232877824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460524:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232877824:12345-0@lo:400:kworker.0 Request processed in 23us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460529:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950 00000100:00100000:1.0:1782759448.460539:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4951 00000100:00100000:1.0:1782759448.460545:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232878336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460568:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232878336:12345-0@lo:400:kworker.0 Request processed in 23us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460573:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4951 00000100:00100000:1.0:1782759448.460658:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4952 00000100:00100000:1.0:1782759448.460664:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232878848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460693:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232878848:12345-0@lo:400:kworker.0 Request processed in 28us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759448.460699:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4952 00000100:00100000:1.0:1782759448.460750:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232877824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460763:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232878336:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460772:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232878848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460782:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232877952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460791:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232878464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460800:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232878976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460839:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232878208:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460861:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232878720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460871:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232879232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460881:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232878080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460960:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232878592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460970:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232879104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759448.460985:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232877568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759448.461058:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232877696 00000100:00100000:0.0:1782759448.461062:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232877696 00000100:00100000:0.0:1782759448.461106:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:0.0:1782759448.461113:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232877696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759448.461152:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232877696:12345-0@lo:400:kworker.0 Request processed in 40us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759448.461158:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:1.0:1782759448.461164:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232877696:0@lo:400:kworker.0 00010000:00010000:2.0:1782759448.906781:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759448.970778:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232879360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759448.970854:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759448.970957:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879360 00000100:00100000:0.0:1782759448.970965:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879360 00000100:00100000:0.0:1782759448.971022:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1782759448.971032:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232879360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759448.971055:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759448.971113:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232879360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759448.971121:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1782759448.971198:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232879360:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1782759449.122886:0:142928:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff43f0bd80 20000000:00000080:2.0:1782759449.122904:0:142928:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf946800 uarg=0000000000000000 00010000:00010000:2.0:1782759449.123089:0:142928:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759449.123120:0:142928:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759449.123142:0:142928:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759449.123153:0:142928:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759449.123171:0:142928:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759449.123188:0:142928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759449.123204:0:142928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759449.123212:0:142928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759449.123249:0:142928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759449.123263:0:142928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 23 pid: 6526 timeout: 3639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759449.123277:0:142928:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142928:1869355232879488:0@lo:104: 00000100:00100000:2.0:1782759449.123337:0:142928:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759449.123381:0:142928:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759449.123469:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759449.123481:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879488 00000100:00100000:3.0:1782759449.123487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879488 00000100:00100000:3.0:1782759449.123532:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1782759449.123540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf956050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:142928:x1869355232879488:12345-0@lo:104: 00010000:00010000:3.0:1782759449.123552:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123624:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759449.123631:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf956050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:142928:x1869355232879488:12345-0@lo:104: Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759449.123637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00010000:00010000:3.0:1782759449.123676:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759449.123682:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123690:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759449.123693:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123701:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759449.123715:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759449.123720:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759449.123743:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123750:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759449.123768:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123776:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428800/0xd5b45c7f5c60c25b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c262 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123790:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759449.123792:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759449.123794:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759449.123804:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232879616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759449.123830:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759449.123858:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879616 00000100:00100000:3.0:1782759449.123862:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879616 00010000:00010000:3.0:1782759449.123876:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 24 pid: 6526 timeout: 3639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759449.123893:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1782759449.123899:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232879616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759449.123907:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759449.123912:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 24 pid: 6526 timeout: 3639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123927:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 24 pid: 6526 timeout: 3639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123941:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123948:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123960:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123966:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123973:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123979:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123984:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759449.123987:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.123994:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.124002:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.124018:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759449.124043:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232879616:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759449.124050:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1782759449.124080:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232879616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759449.124283:0:142928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60c262 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c25b expref: 23 pid: 6526 timeout: 3639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759449.124293:0:142928:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:142928:1869355232879488:0@lo:104: 00010000:00010000:0.0:1782759449.124306:0:142928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759449.124314:0:142928:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759449.124320:0:142928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759449.124326:0:142928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60c38f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759449.483295:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232879744:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759449.483366:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759449.483656:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879744 00000100:00100000:0.0:1782759449.483664:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879744 00000100:00100000:0.0:1782759449.483729:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3151 00000100:00100000:0.0:1782759449.483741:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232879744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759449.483779:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446195200 avail 1299955712 00000100:00100000:0.0:1782759449.483830:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232879744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759449.483839:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3151 00000100:00100000:0.0:1782759449.483910:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232879744:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1782759449.552571:0:142976:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc81eff460 20000000:00000080:3.0:1782759449.552615:0:142976:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf954c00 uarg=0000000000000000 00010000:00010000:3.0:1782759449.552845:0:142976:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759449.552861:0:142976:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759449.552884:0:142976:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759449.552895:0:142976:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759449.552914:0:142976:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759449.552932:0:142976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552946:0:142976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552955:0:142976:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552961:0:142976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552967:0:142976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552972:0:142976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552986:0:142976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759449.552990:0:142976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.552998:0:142976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.553009:0:142976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.553017:0:142976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759449.553022:0:142976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c396 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 142976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759449.829948:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759449.830039:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759449.830062:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759449.830102:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759449.830206:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759449.830245:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493056 00000100:00100000:0.0:1782759449.830257:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493056 00000100:00100000:0.0:1782759449.830318:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493184 00000100:00100000:0.0:1782759449.830320:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493184 00000100:00100000:0.0:1782759449.830339:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2845 00000100:00100000:0.0:1782759449.830348:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218493056:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759449.830424:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218493056:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 77us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759449.830429:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2845 00000100:00100000:0.0:1782759449.830451:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1058 00000100:00100000:0.0:1782759449.830455:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218493184:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:0.0:1782759449.830475:0:8600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60c1c1 00000100:00080000:0.0:1782759449.830484:0:8600:0:(import.c:65:import_set_state_nolock()) ffff8cddc44c1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782759449.830536:0:8600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967403 00000100:00100000:0.0:1782759449.830693:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+2:2401:x1869355218493184:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 237us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759449.830699:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1058 00000100:00080000:0.0:1782759449.830715:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759449.830717:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759449.830727:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759449.830798:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492800 00000100:00100000:1.0:1782759449.830802:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492800 00000100:00100000:1.0:1782759449.830842:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492928 00000100:00100000:1.0:1782759449.830845:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492928 00000100:00100000:1.0:1782759449.830870:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4953 00000100:00100000:1.0:1782759449.830878:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218492800:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759449.830910:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218492800:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759449.830917:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4953 00000100:00100000:1.0:1782759449.830930:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4954 00000100:00100000:1.0:1782759449.830935:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218492928:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759449.830953:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218492928:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 18us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759449.830957:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4954 00000100:00080000:0.0:1782759449.832158:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759449.832165:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759449.832297:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218492672 00000100:00100000:2.0:1782759449.832306:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218492672 00000100:00100000:2.0:1782759449.832408:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3180 00000100:00100000:2.0:1782759449.832420:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218492672:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759449.832501:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218492672:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 84us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759449.832510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3180 00010000:00010000:0.0:1782759449.932161:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759449.994843:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759449.994945:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759449.995207:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232879872 00000100:00100000:3.0:1782759449.995217:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232879872 00000100:00100000:3.0:1782759449.995280:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1782759449.995291:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232879872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759449.995339:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759449.995401:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232879872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759449.995409:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1782759449.995739:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759449.995754:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232880000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759449.995790:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759449.996880:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880000 00000100:00100000:1.0:1782759449.996891:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880000 00000100:00100000:1.0:1782759449.997562:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1782759449.997572:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232880000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759449.997623:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759449.997701:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232880000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759449.997709:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1782759449.997947:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232880000:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1782759450.104219:0:143024:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5e381d10 20000000:00000080:3.0:1782759450.104241:0:143024:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf954800 uarg=0000000000000000 00010000:00010000:3.0:1782759450.104465:0:143024:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759450.104481:0:143024:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759450.104502:0:143024:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759450.104513:0:143024:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759450.104534:0:143024:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759450.104558:0:143024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104598:0:143024:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104612:0:143024:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104620:0:143024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104628:0:143024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104636:0:143024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104642:0:143024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759450.104647:0:143024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104656:0:143024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104671:0:143024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104685:0:143024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.104693:0:143024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c39d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759450.186691:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759450.186702:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759450.186708:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759450.186763:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.186777:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.186790:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759450.186821:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232880128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759450.186911:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759450.186967:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759450.186999:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880128 00000100:00100000:0.0:1782759450.187007:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880128 00000100:00100000:0.0:1782759450.187066:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:0.0:1782759450.187076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232880128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759450.187124:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759450.187139:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c3a4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.187168:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.187180:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.187191:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dce00, rc 0) 00000100:00100000:0.0:1782759450.187231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232880128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759450.187238:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00100000:0.0:1782759450.187290:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232880128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759450.187306:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.187315:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759450.187337:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759450.187348:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759450.187356:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759450.956125:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759451.978789:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759452.556280:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232880256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759452.556351:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759452.556450:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880256 00000100:00100000:2.0:1782759452.556457:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880256 00000100:00100000:2.0:1782759452.556522:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3152 00000100:00100000:2.0:1782759452.556530:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232880256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759452.556556:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445896192 avail 1299656704 00000100:00100000:2.0:1782759452.556626:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232880256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759452.556632:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3152 00000100:00100000:2.0:1782759452.556675:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232880256:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1782759452.595860:0:143219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64d: Nodemap enforces byfid_ops RBAC roles ========================================================== 14:57:32 (1782759452) 00000100:00100000:0.0:1782759452.667761:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759452.667796:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493440 00000100:00100000:1.0:1782759452.667806:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493440 00000100:00100000:1.0:1782759452.667890:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2799 00000100:00100000:1.0:1782759452.667902:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:105637:x1869355218493440:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:1.0:1782759452.668012:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880384:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759452.668075:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759452.668100:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759452.668117:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880384 00000100:00100000:0.0:1782759452.668121:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880384 00000100:00100000:1.0:1782759452.668122:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.668171:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:0.0:1782759452.668179:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232880384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759452.668248:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232880384:12345-0@lo:1000:mdt00_000.0 Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759452.668255:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:1.0:1782759452.668268:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880384:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759452.668313:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880512:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759452.668337:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759452.668363:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.668562:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880512 00000100:00100000:0.0:1782759452.668566:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880512 00000100:00100000:0.0:1782759452.668613:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1782759452.668622:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232880512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759452.668696:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232880512:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759452.668704:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1782759452.668736:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880512:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782759452.668792:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.668807:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.669233:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759452.669248:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880640:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1782759452.669273:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759452.669299:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2629840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759452.669311:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880640 00000100:00100000:1.0:1782759452.669316:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880640 00000100:00100000:1.0:1782759452.669409:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:1.0:1782759452.669418:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232880640:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1782759452.669429:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759452.669448:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c3b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c3b2 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759452.669470:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c3b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3b2 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759452.669483:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c3b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3b2 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759452.669491:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759452.669494:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759452.669497:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759452.669537:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6531:x1869355232880640:12345-0@lo:101:mdt00_000.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759452.669543:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:2.0:1782759452.669567:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880640:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1782759452.669599:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759452.669610:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759452.669625:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1782759452.669649:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759452.669657:0:6531:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759452.669664:0:6531:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759452.669682:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880768:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1782759452.669708:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759452.669730:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880768 00000100:00100000:2.0:1782759452.669733:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759452.669736:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880768 00000100:00100000:1.0:1782759452.669811:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:1.0:1782759452.669818:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6531:x1869355232880768:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1782759452.669826:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759452.669837:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c3c7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c3c0 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759452.669852:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3c0 expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759452.669863:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c3c7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3c0 expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759452.669883:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99302703 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759452.669886:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759452.669889:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759452.669920:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232880768:12345-0@lo:101:mdt00_000.0 Request processed in 102us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759452.669926:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00100000:2.0:1782759452.672765:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880768:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1782759452.672833:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759452.672848:0:6531:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759452.672873:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1782759452.672914:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.672966:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759452.673049:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.676674:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232880896 00000100:00100000:0.0:1782759452.676687:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232880896 00000100:00100000:0.0:1782759452.676757:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3157 00000100:00100000:0.0:1782759452.676767:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232880896:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759452.676873:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232880896:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759452.676882:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3157 00000100:00100000:2.0:1782759452.676912:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232880896:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.676972:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.677012:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759452.677054:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.677087:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881024 00000100:00100000:0.0:1782759452.677092:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881024 00000100:00100000:2.0:1782759452.677227:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3158 00000100:00100000:2.0:1782759452.677242:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.677317:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881024:12345-0@lo:1000:mdt00_000.0 Request processed in 82us (305us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759452.677324:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3158 00000100:00100000:2.0:1782759452.677355:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.677918:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881152:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.677948:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759452.677975:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.678094:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881152 00000100:00100000:0.0:1782759452.678099:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881152 00000100:00100000:0.0:1782759452.678135:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:0.0:1782759452.678145:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759452.678247:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881152:12345-0@lo:1000:mdt00_000.0 Request processed in 104us (299us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759452.678249:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881152:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759452.678260:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:2.0:1782759452.678299:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.678324:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759452.678339:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759452.678356:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881280 00000100:00100000:2.0:1782759452.678359:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881280 00000100:00100000:2.0:1782759452.678390:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:2.0:1782759452.678400:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.678457:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881280:12345-0@lo:1000:mdt00_000.0 Request processed in 59us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759452.678463:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:2.0:1782759452.678493:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.678533:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881408:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.678556:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759452.678692:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.678778:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881408 00000100:00100000:0.0:1782759452.678788:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881408 00000100:00100000:0.0:1782759452.678846:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:0.0:1782759452.678854:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759452.678918:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881408:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759452.678925:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00100000:1.0:1782759452.679000:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881408:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759452.679053:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881536:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1782759452.679100:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759452.679119:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759452.679420:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881536 00000100:00100000:2.0:1782759452.679425:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881536 00000100:00100000:2.0:1782759452.679458:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:2.0:1782759452.679467:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881536:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782759452.679519:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6531:x1869355232881536:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759452.679526:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00100000:1.0:1782759452.680467:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232881536:0@lo:1000:mdt00_000.0 00000040:00080000:1.0:1782759452.681044:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].29, 992 off62760 00000040:00080000:1.0:1782759452.681141:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].30, 1144 off66680 00000004:00080000:1.0:1782759452.681149:0:6531:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc3c32f00 with version 60 00000004:00080000:1.0:1782759452.681168:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 60 rpc_version 60 00000020:00100000:1.0:1782759452.681193:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759452.681203:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cded3bd4000 x1869355232881792/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 3160/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759452.681221:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232881792:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759452.681271:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759452.681306:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759452.683411:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881792 00000100:00100000:0.0:1782759452.683420:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881792 00000100:00100000:0.0:1782759452.683481:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3163 00000100:00100000:0.0:1782759452.683491:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232881792:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759452.683960:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232881792:12345-0@lo:1000:osp_up0-1.0 Request processed in 470us (2687us total) trans 4294967963 rc 0/0 00000100:00100000:0.0:1782759452.683969:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3163 00000100:00100000:1.0:1782759452.684031:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232881792:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1782759452.685503:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685523:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685536:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759452.685553:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9495b18 reply state 0000000059d23242 transno 4294967674 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685564:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685571:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759452.685595:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759452.685606:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759452.685611:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x16:0x0]: returning size 4096 00000004:00080000:0.0:1782759452.685620:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1782759452.685631:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685640:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685647:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685666:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1782759452.685670:0:6531:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1782759452.685676:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685684:0:6531:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759452.685758:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105637:x1869355218493440:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 17857us (18003us total) trans 4294967674 rc 0/0 00000100:00100000:0.0:1782759452.685766:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2799 00010000:00010000:0.0:1782759452.685792:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759452.685798:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685807:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759452.685812:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759452.685828:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685859:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685866:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759452.685886:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685894:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c3b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.685907:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759452.685909:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759452.685912:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759452.685927:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232881920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759452.685968:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759452.686020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232881920 00000100:00100000:0.0:1782759452.686026:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232881920 00000100:00100000:0.0:1782759452.686959:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1782759452.686976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3664:x1869355232881920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759452.687127:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759452.687146:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c3b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3b2 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759452.687159:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759452.687222:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759452.687263:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3664:x1869355232881920:12345-0@lo:103:ldlm_bl.0 Request processed in 293us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759452.687270:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1782759452.687300:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232881920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759453.003240:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759453.579087:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232882432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579145:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232882176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579157:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759453.579191:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232882304:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579219:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579239:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232882944:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579267:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579286:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232883456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579314:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579338:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782759453.579344:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232882048:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579370:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579391:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232882560:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579419:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882432 00000100:00100000:2.0:1782759453.579426:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882432 00000100:00100000:3.0:1782759453.579439:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232882816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579462:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759453.579478:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232883328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579483:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882816 00000100:00100000:2.0:1782759453.579486:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882816 00000100:00100000:3.0:1782759453.579498:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579511:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883328 00000100:00100000:2.0:1782759453.579514:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883328 00000100:00100000:3.0:1782759453.579527:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4955 00000100:00100000:3.0:1782759453.579536:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232882432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579540:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956 00000100:00100000:2.0:1782759453.579545:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232882816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579603:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232882432:12345-0@lo:400:kworker.0 Request processed in 67us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.579603:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232882816:12345-0@lo:400:kworker.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.579611:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956 00000100:00100000:0.0:1782759453.579682:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882944 00000100:00100000:0.0:1782759453.579686:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882944 00000100:00100000:0.0:1782759453.579715:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883456 00000100:00100000:0.0:1782759453.579718:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883456 00000100:00100000:0.0:1782759453.579737:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:0.0:1782759453.579744:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232882944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579787:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4955 00000100:00100000:2.0:1782759453.579792:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:2.0:1782759453.579801:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232883328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579809:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759453.579829:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232882688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579835:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232883328:12345-0@lo:400:kworker.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.579841:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00000100:00100000:3.0:1782759453.579851:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579858:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882176 00000100:00100000:3.0:1782759453.579862:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232883200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579862:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882176 00000100:00100000:2.0:1782759453.579878:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882688 00000100:00100000:2.0:1782759453.579880:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882688 00000100:00100000:3.0:1782759453.579889:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579892:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883200 00000100:00100000:2.0:1782759453.579894:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883200 00000100:00100000:3.0:1782759453.579899:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232883712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759453.579908:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958 00000100:00100000:2.0:1782759453.579914:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232882176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579921:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.579940:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232882176:12345-0@lo:400:kworker.0 Request processed in 26us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.579945:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958 00000100:00100000:3.0:1782759453.579955:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232882176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.579955:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959 00000100:00100000:2.0:1782759453.579961:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232882688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.579980:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883712 00000100:00100000:3.0:1782759453.579982:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883712 00000100:00100000:2.0:1782759453.579993:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232882688:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.579999:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959 00000100:00100000:3.0:1782759453.580007:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1782759453.580008:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4960 00000100:00100000:3.0:1782759453.580013:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232883712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759453.580014:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232883200:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1782759453.580032:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759453.580041:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232883200:12345-0@lo:400:kworker.0 Request processed in 29us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.580047:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4960 00000100:00100000:3.0:1782759453.580076:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232883712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759453.580083:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1782759453.580083:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:2.0:1782759453.580091:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232883456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580112:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232882816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580125:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232883328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.580126:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232883456:12345-0@lo:400:kworker.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.580132:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:2.0:1782759453.580149:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882048 00000100:00100000:3.0:1782759453.580153:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232882688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759453.580158:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882048 00000100:00100000:3.0:1782759453.580161:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232883200:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580173:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232883712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759453.580187:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182 00000100:00100000:2.0:1782759453.580194:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232882048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580217:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882304 00000100:00100000:3.0:1782759453.580221:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882304 00000100:00100000:2.0:1782759453.580237:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232882048:12345-0@lo:400:kworker.0 Request processed in 44us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.580244:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182 00000100:00100000:3.0:1782759453.580268:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3164 00000100:00100000:3.0:1782759453.580274:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232882304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580319:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232882304:12345-0@lo:400:kworker.0 Request processed in 45us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759453.580335:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3164 00000100:00100000:2.0:1782759453.580344:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232882304:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580359:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.580379:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232882560 00000100:00100000:2.0:1782759453.580383:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232882560 00000100:00100000:3.0:1782759453.580386:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232883072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580411:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.580412:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:2.0:1782759453.580420:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232882560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580427:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232883584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580446:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759453.580459:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232882560:12345-0@lo:400:kworker.0 Request processed in 41us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.580464:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:3.0:1782759453.580467:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232882432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580478:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232882944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580488:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232883456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580511:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232882048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580517:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232882560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580530:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883072 00000100:00100000:3.0:1782759453.580532:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883072 00000100:00100000:3.0:1782759453.580546:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883584 00000100:00100000:3.0:1782759453.580548:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883584 00000100:00100000:3.0:1782759453.580554:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:3.0:1782759453.580558:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232883072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580608:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232883072:12345-0@lo:400:kworker.0 Request processed in 48us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759453.580614:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:2.0:1782759453.580619:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232883072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580627:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:3.0:1782759453.580633:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232883584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580665:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232883584:12345-0@lo:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759453.580675:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232883584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759453.580677:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:0.0:1782759453.580736:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232882944:12345-0@lo:400:kworker.0 Request processed in 993us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759453.580741:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00080000:0.0:1782759453.580754:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759453.580757:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759453.580758:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759453.580759:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759454.026704:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759454.090693:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759454.090712:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232883840:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759454.090772:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759454.090822:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883840 00000100:00100000:0.0:1782759454.090831:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883840 00000100:00100000:0.0:1782759454.090882:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1782759454.090890:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232883840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759454.090909:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759454.090955:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232883840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759454.090960:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1782759454.090991:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232883840:0@lo:13:osp-pre-1-1.0 00000020:00000080:2.0:1782759454.450864:0:143414:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6cec4f80 20000000:00000080:2.0:1782759454.450879:0:143414:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e57800 uarg=0000000000000000 10000000:01000000:2.0:1782759454.451035:0:143414:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759454.451066:0:143414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.451083:0:143414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.451091:0:143414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.451138:0:143414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.451152:0:143414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 23 pid: 6524 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759454.451165:0:143414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143414:1869355232883968:0@lo:104: 00000100:00100000:2.0:1782759454.451224:0:143414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759454.451361:0:143414:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759454.451387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232883968 00000100:00100000:0.0:1782759454.451394:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232883968 00000100:00100000:0.0:1782759454.451437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1782759454.451449:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:143414:x1869355232883968:12345-0@lo:104: 00010000:00010000:0.0:1782759454.451462:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451522:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759454.451529:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:143414:x1869355232883968:12345-0@lo:104: Request processed in 80us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759454.451536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00010000:00010000:1.0:1782759454.451560:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759454.451569:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759454.451599:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759454.451604:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759454.451614:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759454.451623:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759454.451629:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759454.451662:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759454.451669:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759454.451697:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759454.451705:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dda00/0xd5b45c7f5c60c3a4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c3ab expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759454.451709:0:143414:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143414:1869355232883968:0@lo:104: 00000100:00100000:3.0:1782759454.451726:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232884096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759454.451732:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759454.451736:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759454.451738:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759454.451745:0:143414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759454.451766:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759454.451812:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884096 00000100:00100000:0.0:1782759454.451817:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884096 00010000:00010000:0.0:1782759454.451833:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 24 pid: 6524 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759454.451853:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1782759454.451858:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232884096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759454.451866:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759454.451869:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 24 pid: 6524 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451876:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 24 pid: 6524 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451883:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c3ab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3a4 expref: 24 pid: 6524 timeout: 3644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451892:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451898:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451910:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451915:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451919:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451922:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451925:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759454.451928:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451932:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451942:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759454.451947:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759454.451965:0:143414:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759454.451974:0:143414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759454.451975:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232884096:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (209us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759454.451991:0:143414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c3d5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759454.451992:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1782759454.452027:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232884096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759454.602913:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232884224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759454.602986:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759454.603052:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884224 00000100:00100000:1.0:1782759454.603060:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884224 00000100:00100000:1.0:1782759454.603287:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:1.0:1782759454.603296:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232884224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759454.603326:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:1.0:1782759454.603419:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232884224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759454.603425:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1782759454.603475:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232884224:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1782759454.830802:0:143462:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffcef89680 20000000:00000080:3.0:1782759454.830818:0:143462:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4bbe400 uarg=0000000000000000 10000000:01000000:3.0:1782759454.830962:0:143462:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759454.830984:0:143462:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.830999:0:143462:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831009:0:143462:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831016:0:143462:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831023:0:143462:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831031:0:143462:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831232:0:143462:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759454.831237:0:143462:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831246:0:143462:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831258:0:143462:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831266:0:143462:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759454.831272:0:143462:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143462 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759454.941558:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759454.941655:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759454.941704:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759454.941713:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493568 00000100:00100000:1.0:1782759454.941725:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493568 00000100:00100000:0.0:1782759454.941747:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759454.941783:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3183 00000100:00100000:1.0:1782759454.941794:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218493568:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759454.941871:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218493568:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759454.941879:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3183 00000100:00100000:3.0:1782759454.941926:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493696 00000100:00100000:3.0:1782759454.941931:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493696 00000100:00100000:3.0:1782759454.941992:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493824 00000100:00100000:3.0:1782759454.941996:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493824 00000100:00100000:3.0:1782759454.942029:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4961 00000100:00100000:3.0:1782759454.942037:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218493696:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759454.942081:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218493696:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759454.942088:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4961 00000100:00100000:3.0:1782759454.942114:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4962 00000100:00100000:3.0:1782759454.942121:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218493824:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759454.942160:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218493824:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759454.942167:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4962 00000100:00080000:1.0:1782759454.942179:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759454.942184:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759454.942202:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218493952 00000100:00100000:3.0:1782759454.942206:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218493952 00000100:00100000:3.0:1782759454.942246:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2850 00000100:00080000:1.0:1782759454.942248:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759454.942256:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218493952:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759454.942282:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218493952:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759454.942288:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2850 00010000:00010000:3.0:1782759455.053096:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759455.114921:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232884352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759455.114990:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759455.115064:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884352 00000100:00100000:0.0:1782759455.115071:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884352 00000100:00100000:0.0:1782759455.115131:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1782759455.115138:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232884352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759455.115163:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759455.115195:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232884352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759455.115298:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00080000:0.0:1782759455.115320:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759455.115356:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232884352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759455.116296:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232884480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759455.116328:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759455.116373:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884480 00000100:00100000:3.0:1782759455.116379:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884480 00000100:00080000:0.0:1782759455.116408:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759455.116439:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:3.0:1782759455.116448:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232884480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759455.116461:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759455.116500:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232884480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759455.116507:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1782759455.116536:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232884480:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1782759455.631892:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:1.0:1782759455.631902:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc44c3000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:0.0:1782759455.632683:0:124598:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc44c3000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:0.0:1782759455.632726:0:124598:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc44c1800 for lustre-OST0001 00010000:00010000:3.0:1782759456.074709:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759456.307489:0:143610:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec33a6d90 20000000:00000080:3.0:1782759456.307517:0:143610:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4bbd000 uarg=0000000000000000 10000000:01000000:3.0:1782759456.308217:0:143610:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759456.308237:0:143610:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308254:0:143610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308273:0:143610:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308281:0:143610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308288:0:143610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308295:0:143610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308301:0:143610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759456.308306:0:143610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308314:0:143610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308327:0:143610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308334:0:143610:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.308341:0:143610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143610 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759456.331859:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759456.331866:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759456.331871:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759456.331908:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.331920:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.331936:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759456.331960:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232884608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759456.332027:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759456.332084:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759456.332275:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884608 00000100:00100000:1.0:1782759456.332283:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884608 00000100:00100000:1.0:1782759456.332345:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1782759456.332354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232884608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759456.332368:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759456.332381:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c3ea expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.332407:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.332423:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.332433:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759456.332478:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232884608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759456.332485:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1782759456.332529:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232884608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759456.332544:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.332552:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759456.332569:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759456.332590:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.332598:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759456.758833:0:143658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe33129a00 20000000:00000080:3.0:1782759456.758850:0:143658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4bbd000 uarg=0000000000000000 10000000:01000000:3.0:1782759456.759233:0:143658:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759456.759252:0:143658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.759270:0:143658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.759279:0:143658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.759318:0:143658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.759332:0:143658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 23 pid: 6524 timeout: 3647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759456.759347:0:143658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143658:1869355232884736:0@lo:104: 00000100:00100000:3.0:1782759456.759412:0:143658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759456.759463:0:143658:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759456.759538:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884736 00000100:00100000:0.0:1782759456.759546:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884736 00000100:00100000:0.0:1782759456.759611:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1782759456.759622:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:143658:x1869355232884736:12345-0@lo:104: 00010000:00010000:0.0:1782759456.759633:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.759685:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759456.759691:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:143658:x1869355232884736:12345-0@lo:104: Request processed in 72us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.759698:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00010000:00010000:1.0:1782759456.759717:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759456.759723:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.759731:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759456.759735:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.759750:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759456.759758:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759456.759764:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759456.759799:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.759806:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759456.759823:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759456.759829:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60c3ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c3f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759456.759834:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232884864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759456.759847:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759456.759848:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759456.759850:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759456.759860:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759456.759877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884864 00000100:00100000:1.0:1782759456.759881:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884864 00010000:00010000:1.0:1782759456.759900:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 24 pid: 6524 timeout: 3647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759456.760004:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:0.0:1782759456.760013:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232884864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759456.760024:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759456.760040:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 24 pid: 6524 timeout: 3647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760050:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 24 pid: 6524 timeout: 3647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760070:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760077:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760089:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760096:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760103:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760109:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760114:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759456.760118:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760125:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760131:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759456.760138:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759456.760174:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232884864:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759456.760186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1782759456.760205:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232884864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759456.760396:0:143658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60c3f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c3ea expref: 23 pid: 6524 timeout: 3647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759456.760406:0:143658:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143658:1869355232884736:0@lo:104: 00010000:00010000:3.0:1782759456.760418:0:143658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.760426:0:143658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.760432:0:143658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759456.760447:0:143658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c3f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.099773:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759457.308189:0:143706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff17e1e510 20000000:00000080:0.0:1782759457.308208:0:143706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecdb11000 uarg=0000000000000000 10000000:01000000:0.0:1782759457.308350:0:143706:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759457.308370:0:143706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308386:0:143706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308396:0:143706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308403:0:143706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308410:0:143706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308418:0:143706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308424:0:143706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759457.308428:0:143706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308436:0:143706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308449:0:143706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308467:0:143706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759457.308474:0:143706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c3ff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759457.675035:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232884992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759457.675120:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759457.675230:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232884992 00000100:00100000:3.0:1782759457.675237:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232884992 00000100:00100000:3.0:1782759457.675318:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:3.0:1782759457.675330:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232884992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759457.675366:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1782759457.675423:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232884992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759457.675431:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:0.0:1782759457.675653:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232884992:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1782759457.843923:0:143755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca39ef970 20000000:00000080:3.0:1782759457.843940:0:143755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4bbf400 uarg=0000000000000000 10000000:01000000:3.0:1782759457.844155:0:143755:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759457.844177:0:143755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844193:0:143755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844203:0:143755:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844209:0:143755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844216:0:143755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844234:0:143755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844240:0:143755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759457.844244:0:143755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844253:0:143755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844266:0:143755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844274:0:143755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.844281:0:143755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c406 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759457.855686:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967963 is committed 10000000:01000000:1.0:1782759457.995286:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759457.995295:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759457.995300:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759457.995350:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759457.995361:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759457.995372:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759457.995397:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232885120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759457.995463:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759457.995547:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759457.995840:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885120 00000100:00100000:3.0:1782759457.995847:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885120 00000100:00100000:3.0:1782759457.995903:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:3.0:1782759457.995914:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232885120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759457.995927:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759457.995940:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c40d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.995964:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.995982:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759457.995991:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759457.996055:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232885120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759457.996063:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:2.0:1782759457.996140:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232885120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759457.996157:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.996176:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759457.996195:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759457.996201:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759457.996209:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.123753:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759458.303593:0:143803:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc803ed7b0 20000000:00000080:1.0:1782759458.303611:0:143803:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc54c8c00 uarg=0000000000000000 00010000:00010000:1.0:1782759458.303804:0:143803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759458.303821:0:143803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759458.303843:0:143803:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759458.303854:0:143803:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759458.303866:0:143803:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759458.303883:0:143803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.303899:0:143803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.303908:0:143803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.303941:0:143803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.303965:0:143803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 23 pid: 6525 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759458.303978:0:143803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143803:1869355232885248:0@lo:104: 00000100:00100000:1.0:1782759458.304048:0:143803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.304094:0:143803:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759458.307178:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885248 00000100:00100000:2.0:1782759458.307191:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885248 00000100:00100000:2.0:1782759458.307300:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:2.0:1782759458.307313:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:143803:x1869355232885248:12345-0@lo:104: 00010000:00010000:2.0:1782759458.307330:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.307423:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759458.307429:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:143803:x1869355232885248:12345-0@lo:104: Request processed in 121us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.307437:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00010000:00010000:3.0:1782759458.307460:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782759458.307460:0:143803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143803:1869355232885248:0@lo:104: 00010000:00010000:3.0:1782759458.307470:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307480:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759458.307484:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.307487:0:143803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307496:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759458.307506:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759458.307512:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759458.307605:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307610:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759458.307633:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307651:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c40d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c414 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759458.307660:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232885376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759458.307668:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759458.307671:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759458.307673:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759458.307699:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759458.307841:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885376 00000100:00100000:3.0:1782759458.307846:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885376 00010000:00010000:3.0:1782759458.307866:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 24 pid: 6525 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759458.307897:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1782759458.307905:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232885376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759458.307915:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759458.307920:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 24 pid: 6525 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307929:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 24 pid: 6525 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307942:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60c414 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c40d expref: 24 pid: 6525 timeout: 3648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307955:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307962:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307985:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307992:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.307997:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.308002:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.308008:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759458.308011:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.308035:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.308117:0:143803:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.308125:0:143803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.311716:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.311735:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60c41b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759458.311754:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759458.311895:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232885376:12345-0@lo:103:ldlm_bl.0 Request processed in 3987us (4192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759458.311906:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:1.0:1782759458.311999:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232885376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759458.698811:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232885504:0@lo:400:kworker.0 00000100:00100000:2.0:1782759458.699058:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232885632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.699294:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232885760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.699331:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759458.699375:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232886272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.699401:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759458.699419:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232886784:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.699439:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759458.699475:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885760 00000100:00100000:0.0:1782759458.699481:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885760 00000100:00100000:0.0:1782759458.699525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1782759458.699535:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232885760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.699566:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.699800:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232886016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.699825:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.699842:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232886528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.699863:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.699887:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232887040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759458.699911:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.699928:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759458.699934:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232885888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.699957:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.699975:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232886400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.700748:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232885760:12345-0@lo:400:kworker.0 Request processed in 1211us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.700757:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4963 00000100:00100000:0.0:1782759458.700777:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885504 00000100:00100000:0.0:1782759458.700781:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885504 00000100:00100000:0.0:1782759458.700805:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886016 00000100:00100000:0.0:1782759458.700814:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886016 00000100:00100000:0.0:1782759458.700835:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886528 00000100:00100000:0.0:1782759458.700837:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886528 00000100:00100000:0.0:1782759458.700859:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4964 00000100:00100000:0.0:1782759458.700864:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232885504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.700903:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232885504:12345-0@lo:400:kworker.0 Request processed in 38us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.700909:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4964 00000100:00100000:0.0:1782759458.700921:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965 00000100:00100000:0.0:1782759458.700926:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.701032:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232886016:12345-0@lo:400:kworker.0 Request processed in 105us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.701039:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965 00000100:00100000:0.0:1782759458.701051:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4966 00000100:00100000:0.0:1782759458.701056:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.701087:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232886528:12345-0@lo:400:kworker.0 Request processed in 31us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.701094:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4966 00000100:00100000:2.0:1782759458.701105:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759458.701119:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886272 00000100:00100000:0.0:1782759458.701124:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886272 00000100:00100000:2.0:1782759458.701138:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232886144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.701154:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886784 00000100:00100000:0.0:1782759458.701159:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886784 00000100:00100000:2.0:1782759458.701168:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759458.701191:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232886656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759458.701219:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759458.701245:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885888 00000100:00100000:2.0:1782759458.701249:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885888 00000100:00100000:2.0:1782759458.701292:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232885632 00000100:00100000:2.0:1782759458.701295:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232885632 00000100:00100000:2.0:1782759458.701312:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:2.0:1782759458.701319:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232885888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759458.701353:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232885888:12345-0@lo:400:kworker.0 Request processed in 35us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.701359:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:2.0:1782759458.701374:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3169 00000100:00100000:2.0:1782759458.701382:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1869355232885632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759458.701412:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3664:x1869355232885632:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.701418:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3169 00000100:00100000:2.0:1782759458.701451:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967963 gen 2 00000004:00080000:2.0:1782759458.701457:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967963 committed transno 4294967963 00000100:00100000:2.0:1782759458.701481:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232885632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759458.701503:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886144 00000100:00100000:2.0:1782759458.701506:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886144 00000100:00100000:2.0:1782759458.701522:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886656 00000100:00100000:2.0:1782759458.701524:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886656 00000100:00100000:2.0:1782759458.701544:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4967 00000100:00100000:2.0:1782759458.701551:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232886144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759458.701602:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232886144:12345-0@lo:400:kworker.0 Request processed in 52us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.701610:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4967 00000100:00100000:1.0:1782759458.701783:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759458.701811:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232886912:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.701831:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886400 00000100:00100000:1.0:1782759458.701837:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759458.701838:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886400 00000100:00100000:0.0:1782759458.701859:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232886912 00000100:00100000:1.0:1782759458.701863:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232886016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.701864:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232886912 00000100:00100000:1.0:1782759458.701882:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232886528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.701888:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1782759458.701898:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232886272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.701900:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232885504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.701929:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232885888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.702027:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232886272:12345-0@lo:400:kworker.0 Request processed in 130us (2624us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.702035:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:0.0:1782759458.702048:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1782759458.702056:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.702084:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232886784:12345-0@lo:400:kworker.0 Request processed in 30us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.702089:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:0.0:1782759458.702164:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1782759458.702237:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232886400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.702275:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232886400:12345-0@lo:400:kworker.0 Request processed in 104us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.702282:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1782759458.702293:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:0.0:1782759458.702299:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232886912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.702327:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232886912:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.702332:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:3.0:1782759458.702427:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232886144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759458.702485:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887040 00000100:00100000:3.0:1782759458.702490:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887040 00000100:00100000:3.0:1782759458.702516:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1782759458.702522:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232887040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759458.702541:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759458.702603:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232887040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759458.702610:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1782759458.702633:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232886400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.702650:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232886912:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.702664:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232887040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782759458.702710:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759458.702714:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759458.702717:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759458.702719:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759458.702726:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968 00000100:00100000:0.0:1782759458.702736:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.702780:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232886656:12345-0@lo:400:kworker.0 Request processed in 46us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759458.702787:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968 00000100:00100000:1.0:1782759458.702812:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232885760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759458.702833:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232886656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.702838:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232886272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759458.702852:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232886784:0@lo:400:kworker.0 00010000:00010000:1.0:1782759458.704337:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759458.704355:0:7461:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.704389:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759458.704396:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759458.704414:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648600/0xd5b45c7f5c60c3c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c3c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759458.704430:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967674 is committed 00000020:00080000:1.0:1782759458.704437:0:7461:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc3c32180 refcount 2 committed 0 result 0 batchid 29 00000020:00080000:1.0:1782759458.704440:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd467e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc3c32f00 00000020:00080000:1.0:1782759458.704444:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].30 00000020:00080000:1.0:1782759458.704446:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecd467300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4ab9a00 00000020:00080000:1.0:1782759458.704449:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].29 00000100:00100000:1.0:1782759458.704470:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232887168:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:1.0:1782759458.704515:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759458.704649:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704658:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704665:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704671:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759458.704675:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704681:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704693:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:2.0:1782759458.704696:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759458.704700:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704706:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c3ce lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759458.704732:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 29 committed batchid 28 00000020:00080000:2.0:1782759458.704791:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 28 00000100:00100000:2.0:1782759458.704805:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887168 00000100:00100000:2.0:1782759458.704810:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887168 00000100:00100000:2.0:1782759458.704847:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782759458.704857:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3664:x1869355232887168:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1782759458.704868:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759458.704899:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c3c7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60c3c0 expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759458.704919:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99302703 (ffff8cddc34fe300) 00010000:00010000:2.0:1782759458.704927:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759458.704963:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232887168:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 108us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759458.704970:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1782759458.705003:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232887168:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1782759459.150207:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759459.213823:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759459.213847:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232887296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759459.213913:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759459.214297:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887296 00000100:00100000:0.0:1782759459.214305:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887296 00000100:00100000:0.0:1782759459.214391:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:0.0:1782759459.214402:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232887296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759459.214426:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759459.214496:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232887296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759459.214504:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1782759459.214590:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232887296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759459.723885:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759459.723904:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232887424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759459.723970:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759459.724065:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887424 00000100:00100000:1.0:1782759459.724073:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887424 00000100:00100000:1.0:1782759459.724156:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3170 00000100:00100000:1.0:1782759459.724165:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232887424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759459.724200:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:1.0:1782759459.724297:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232887424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759459.724304:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3170 00000100:00100000:0.0:1782759459.724312:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232887424:0@lo:41:osp-pre-1-0.0 10000000:01000000:1.0:1782759459.786876:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759459.786883:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759459.786887:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759459.786931:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.786942:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.786953:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759459.786978:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232887552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759459.787053:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759459.787116:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf715000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759459.787176:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887552 00000100:00100000:0.0:1782759459.787184:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887552 00000100:00100000:0.0:1782759459.787233:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:0.0:1782759459.787243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232887552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759459.787256:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759459.787269:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c422 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.787291:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.787301:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759459.787310:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:0.0:1782759459.787350:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232887552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759459.787354:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:1.0:1782759459.787779:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232887552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759459.787795:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.787803:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759459.787821:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759459.787832:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759459.787840:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759460.060811:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759460.060858:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759460.060898:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759460.060942:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759460.060979:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494208 00000100:00100000:1.0:1782759460.060989:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494208 00000100:00100000:1.0:1782759460.061050:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494336 00000100:00100000:1.0:1782759460.061053:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494336 00000100:00100000:1.0:1782759460.061068:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4969 00000100:00100000:1.0:1782759460.061074:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218494208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759460.061152:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218494208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759460.061166:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4969 00000100:00100000:1.0:1782759460.061183:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4970 00000100:00100000:1.0:1782759460.061190:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218494336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759460.061222:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218494336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759460.061227:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4970 00000100:00080000:1.0:1782759460.061239:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759460.061241:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759460.061498:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494464 00000100:00100000:0.0:1782759460.061503:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494464 00000100:00100000:0.0:1782759460.061557:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2855 00000100:00100000:0.0:1782759460.061567:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218494464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759460.061640:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218494464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759460.061775:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2855 00000100:00100000:2.0:1782759460.061831:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494080 00000100:00100000:2.0:1782759460.061835:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494080 00000100:00100000:2.0:1782759460.061910:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3187 00000100:00100000:2.0:1782759460.061919:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218494080:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759460.061957:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218494080:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759460.061964:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3187 00000100:00080000:1.0:1782759460.062157:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759460.171936:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759460.234847:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759460.234870:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232887680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759460.234992:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232887808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759460.235173:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759460.235229:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887680 00000100:00100000:2.0:1782759460.235237:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887680 00000100:00100000:2.0:1782759460.235312:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:2.0:1782759460.235324:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232887680:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782759460.235332:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759460.235352:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1782759460.235353:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759460.235406:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232887680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759460.235413:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1782759460.235423:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887808 00000100:00100000:1.0:1782759460.235427:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887808 00000100:00080000:2.0:1782759460.235457:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759460.235501:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232887680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759460.235830:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:0.0:1782759460.235840:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232887808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759460.235852:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759460.235893:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232887808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759460.235900:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1782759460.235965:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232887808:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1782759460.359337:0:143998:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf0500620 20000000:00000080:3.0:1782759460.359353:0:143998:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c75c00 uarg=0000000000000000 00010000:00010000:3.0:1782759460.359520:0:143998:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759460.359536:0:143998:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759460.359558:0:143998:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759460.359569:0:143998:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759460.359651:0:143998:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759460.359670:0:143998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759460.359696:0:143998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759460.359704:0:143998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759460.359744:0:143998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759460.359757:0:143998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 23 pid: 6524 timeout: 3650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759460.360304:0:143998:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143998:1869355232887936:0@lo:104: 00000100:00100000:3.0:1782759460.360369:0:143998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759460.360426:0:143998:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759460.360470:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232887936 00000100:00100000:0.0:1782759460.360479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232887936 00000100:00100000:0.0:1782759460.360523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1782759460.360533:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:143998:x1869355232887936:12345-0@lo:104: 00010000:00010000:0.0:1782759460.360547:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.360618:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759460.360623:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:143998:x1869355232887936:12345-0@lo:104: Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759460.360630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00010000:00010000:1.0:1782759460.360642:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759460.360651:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759460.360659:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759460.360664:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759460.360672:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759460.360679:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759460.360685:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759460.360722:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759460.360729:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759460.360755:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759460.360763:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c422 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c429 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759460.360769:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232888064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759460.360781:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759460.360784:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759460.360793:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759460.360797:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759460.360829:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888064 00000100:00100000:0.0:1782759460.360832:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888064 00010000:00010000:0.0:1782759460.360844:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 24 pid: 6524 timeout: 3650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759460.360908:0:143998:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:143998:1869355232887936:0@lo:104: 00010000:00010000:3.0:1782759460.360986:0:143998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759460.361064:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1782759460.361070:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232888064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759460.361079:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759460.361083:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 24 pid: 6524 timeout: 3650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361090:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 24 pid: 6524 timeout: 3650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361100:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c429 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c422 expref: 24 pid: 6524 timeout: 3650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361109:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361115:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361123:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361127:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361139:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361143:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361146:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759460.361148:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361153:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361167:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759460.361173:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759460.361203:0:143998:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759460.361204:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232888064:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759460.361218:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00010000:00010000:3.0:1782759460.361221:0:143998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759460.361230:0:143998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60c430 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 143998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759460.361268:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232888064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759461.195687:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759461.824432:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759461.824526:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494592 00000100:00100000:3.0:1782759461.824543:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494592 00000100:00100000:3.0:1782759461.824646:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2800 00000100:00100000:3.0:1782759461.824657:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:105949:x1869355218494592:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759461.824675:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759461.824693:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27288 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.824754:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.824779:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.824790:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.824804:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.824810:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.824816:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759461.824926:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232888192:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759461.824982:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759461.825040:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759461.825062:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888192 00000100:00100000:3.0:1782759461.825065:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888192 00000100:00100000:3.0:1782759461.825109:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1782759461.825123:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6533:x1869355232888192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759461.825189:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6533:x1869355232888192:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759461.825197:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:3.0:1782759461.825236:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232888192:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1782759461.825293:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c44c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825302:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c44c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825309:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c44c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759461.825334:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c44c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825347:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825353:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825359:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825366:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825372:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759461.825376:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825390:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825402:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759461.825405:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759461.825410:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825417:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c43e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825430:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825436:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825442:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825446:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759461.825449:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825454:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825460:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99302703 (ffff8cded3a3b200) 00010000:00010000:3.0:1782759461.825462:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759461.825465:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825478:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c445 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99302703 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825507:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27288 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825518:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c44c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27288 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.825525:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759461.825527:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759461.825529:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759461.825568:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105949:x1869355218494592:12345-192.168.202.31@tcp:101:touch.0 Request processed in 914us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759461.825573:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2800 00000100:00100000:0.0:1782759461.827965:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759461.828337:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494720 00000100:00100000:2.0:1782759461.828347:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494720 00000100:00100000:2.0:1782759461.831365:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2801 00000100:00100000:2.0:1782759461.831406:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:105949:x1869355218494720:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759461.831429:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759461.831454:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c453 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2728f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.831519:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c45a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.831534:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c45a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.831546:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c45a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759461.831615:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x16:0x0]: returning size 4096 00000004:00200000:2.0:1782759461.831619:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759461.831660:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c453 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2728f expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.831674:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c45a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2728f expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.831682:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:2.0:1782759461.831685:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1782759461.831689:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759461.831766:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105949:x1869355218494720:12345-192.168.202.31@tcp:101:touch.0 Request processed in 389us (3808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.831783:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2801 00000100:00100000:3.0:1782759461.833882:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759461.833954:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218494976 00000100:00100000:0.0:1782759461.833963:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218494976 00000100:00100000:0.0:1782759461.834028:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2802 00000100:00100000:0.0:1782759461.834047:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105949:x1869355218494976:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759461.834069:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759461.834098:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c461 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27296 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.834211:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.834224:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.834234:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.834271:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.834279:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.834285:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759461.834433:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232888320:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759461.834504:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759461.834556:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdecb3fb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759461.834791:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888320 00000100:00100000:2.0:1782759461.834796:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888320 00000100:00100000:2.0:1782759461.834863:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:2.0:1782759461.834873:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232888320:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759461.834956:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232888320:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.834963:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:0.0:1782759461.835439:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232888320:0@lo:1000:mdt00_003.0 00000004:00080000:0.0:1782759461.835876:0:8593:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x14:0x0], index 0: 0 00010000:00010000:0.0:1782759461.836200:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c476 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836212:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c476 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836231:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c476 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836267:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836274:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836280:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836287:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836293:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759461.836297:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836304:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836315:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:0.0:1782759461.836317:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759461.836321:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836328:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c468 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759461.836338:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f993d9d reply state 0000000092b1cf02 transno 4294967675 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836355:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836361:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc3502a00) 00010000:00010000:0.0:1782759461.836363:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759461.836365:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759461.836398:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c461 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27296 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836409:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c476 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27296 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.836414:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cddc3502400) 00010000:00010000:0.0:1782759461.836415:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759461.836417:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759461.836492:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105949:x1869355218494976:12345-192.168.202.31@tcp:101:touch.0 Request processed in 2456us (2617us total) trans 4294967675 rc 0/0 00000100:00100000:0.0:1782759461.836498:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2802 00000100:00100000:2.0:1782759461.843156:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759461.843341:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218495232 00000100:00100000:3.0:1782759461.843351:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218495232 00000100:00100000:3.0:1782759461.843418:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2803 00000100:00100000:3.0:1782759461.843429:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105949:x1869355218495232:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:3.0:1782759461.843485:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759461.843513:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c476 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27296 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.843532:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cddc3502400) 00010000:00010000:3.0:1782759461.843546:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759461.843736:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.843751:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.843762:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759461.843867:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002397649d reply state 000000005ea9bdec transno 4294967676 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.843880:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.843887:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:3.0:1782759461.843890:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759461.843892:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759461.844091:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:105949:x1869355218495232:12345-192.168.202.31@tcp:36:touch.0 Request processed in 662us (943us total) trans 4294967676 rc 0/0 00000100:00100000:3.0:1782759461.844100:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2803 00000100:00100000:2.0:1782759461.846150:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.846264:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218495360 00000100:00100000:1.0:1782759461.846273:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218495360 00000100:00100000:1.0:1782759461.846330:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2804 00000100:00100000:1.0:1782759461.846341:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:105949:x1869355218495360:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759461.846365:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759461.846383:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c48b lrc: 2/0,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2729d expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.846433:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c48b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2729d expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.846448:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c48b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2729d expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.846466:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:1.0:1782759461.846470:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759461.846473:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759461.846531:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:105949:x1869355218495360:12345-192.168.202.31@tcp:101:touch.0 Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.846538:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2804 00000100:00100000:3.0:1782759461.851605:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759461.851643:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218495488 00000100:00100000:3.0:1782759461.851652:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218495488 00000100:00100000:3.0:1782759461.851705:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1059 00000100:00100000:3.0:1782759461.851716:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218495488:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:3.0:1782759461.851949:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218495488:12345-192.168.202.31@tcp:2:touch.0 Request processed in 233us (373us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1782759461.851958:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1059 00000100:00100000:1.0:1782759461.856185:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.856218:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218495744 00000100:00100000:1.0:1782759461.856226:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218495744 00000100:00100000:1.0:1782759461.856286:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 316 00000100:00100000:1.0:1782759461.856298:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:105949:x1869355218495744:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:1.0:1782759461.856656:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:105949:x1869355218495744:12345-192.168.202.31@tcp:35:touch.0 Request processed in 359us (479us total) trans 4294967677 rc 0/0 00000100:00100000:1.0:1782759461.856666:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 316 00000100:00100000:2.0:1782759461.870040:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.870080:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218495872 00000100:00100000:1.0:1782759461.870089:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218495872 00000100:00100000:1.0:1782759461.870144:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2805 00000100:00100000:1.0:1782759461.870151:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:105950:x1869355218495872:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759461.870171:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759461.870186:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c492 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272a4 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870238:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870252:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870264:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870275:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870282:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870288:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870364:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870382:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870389:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759461.870430:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x17:0x0]: returning size 0 00000004:00200000:1.0:1782759461.870434:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759461.870463:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870475:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870484:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870491:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870497:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870503:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870509:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759461.870513:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870521:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870539:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:1.0:1782759461.870541:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759461.870545:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870549:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c499 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870558:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870561:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870565:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870567:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759461.870569:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870572:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870596:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc3502a00) 00010000:00010000:1.0:1782759461.870598:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759461.870601:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870604:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4a0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870632:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c492 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 14 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870642:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.870646:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:1.0:1782759461.870648:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759461.870649:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428800, rc 0) 00000100:00100000:1.0:1782759461.870701:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:105950:x1869355218495872:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 549us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.870707:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2805 00000100:00100000:3.0:1782759461.884408:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.884832:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218496000 00000100:00100000:1.0:1782759461.884842:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218496000 00000100:00100000:1.0:1782759461.884899:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2806 00000100:00100000:1.0:1782759461.884909:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:105951:x1869355218496000:12345-192.168.202.31@tcp:53:lfs.0 00000004:00000080:1.0:1782759461.884940:0:6532:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x240000405:0x17:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782759461.885547:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:105951:x1869355218496000:12345-192.168.202.31@tcp:53:lfs.0 Request processed in 638us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.885556:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2806 00000100:00100000:3.0:1782759461.890545:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.890657:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218496128 00000100:00100000:1.0:1782759461.890667:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218496128 00000100:00100000:1.0:1782759461.890733:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2807 00000100:00100000:1.0:1782759461.890743:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105491:x1869355218496128:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1782759461.890766:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759461.890801:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c4ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272ab expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890861:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890875:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890886:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890902:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890909:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890916:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890976:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c4c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.890998:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891006:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759461.891046:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759461.891050:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759461.891071:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891089:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891095:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891102:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891109:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891117:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759461.891121:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891128:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891141:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759461.891144:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759461.891149:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891156:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c4b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891170:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891176:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891189:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891194:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759461.891197:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891203:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891211:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cded88bf500) 00010000:00010000:1.0:1782759461.891213:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759461.891216:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891222:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891262:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c4ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ab expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891278:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ab expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.891285:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cded88bf100) 00010000:00010000:1.0:1782759461.891288:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759461.891290:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759461.891356:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218496128:12345-192.168.202.31@tcp:101:bash.0 Request processed in 614us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.891372:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2807 00000100:00100000:2.0:1782759461.893192:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759461.893920:0:123455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218496256 00000100:00100000:0.0:1782759461.893929:0:123455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218496256 00000100:00100000:0.0:1782759461.893979:0:123455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 112 00000100:00100000:0.0:1782759461.894002:0:123455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218496256:12345-192.168.202.31@tcp:900:bash.0 00000100:00100000:0.0:1782759461.894188:0:123455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218496256:12345-192.168.202.31@tcp:900:bash.0 Request processed in 189us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.894196:0:123455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 112 00000100:00100000:3.0:1782759461.895440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759461.895485:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218496512 00000100:00100000:0.0:1782759461.895502:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218496512 00000100:00100000:0.0:1782759461.895545:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2808 00000100:00100000:0.0:1782759461.895556:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218496512:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1782759461.895570:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759461.895631:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c4ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272b2 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895700:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895714:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895725:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895739:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895747:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895754:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759461.895844:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1782759461.895924:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895932:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895948:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895954:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895960:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759461.895964:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895971:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.895997:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cded88bf100) 00010000:00010000:0.0:1782759461.896000:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759461.896006:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896012:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c4d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896025:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896097:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896104:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896115:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759461.896128:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896135:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896143:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cddc3502e00) 00010000:00010000:0.0:1782759461.896146:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759461.896149:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896155:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c4d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896192:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c4ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272b2 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896202:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cded88bf100) 00010000:00010000:0.0:1782759461.896204:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759461.896208:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c4ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272b2 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.896216:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759461.896393:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:105491:x1869355218496512:12345-192.168.202.31@tcp:101:bash.0 Request processed in 840us (955us total) trans 4294967964 rc 301/301 00000100:00100000:0.0:1782759461.896402:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2808 00000100:00100000:2.0:1782759461.900473:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759461.900523:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218496640 00000100:00100000:3.0:1782759461.900532:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218496640 00000100:00100000:3.0:1782759461.900610:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2809 00000100:00100000:3.0:1782759461.900622:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:105491:x1869355218496640:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1782759461.900649:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759461.900669:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c4e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272b9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.900750:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c4ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.900762:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.900777:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759461.900801:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1782759461.900805:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759461.900823:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c4ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.900850:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c4e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272b9 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.900864:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c4ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272b9 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.900889:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cded3a3b000) 00010000:00010000:3.0:1782759461.900892:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759461.900896:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759461.900948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105491:x1869355218496640:12345-192.168.202.31@tcp:101:bash.0 Request processed in 329us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759461.900955:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2809 00000100:00100000:0.0:1782759461.904714:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759461.904769:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218496768 00000100:00100000:2.0:1782759461.904777:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218496768 00000100:00100000:2.0:1782759461.904841:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 317 00000100:00100000:2.0:1782759461.904851:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105491:x1869355218496768:12345-192.168.202.31@tcp:37:bash.0 00000100:00100000:2.0:1782759461.908190:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105491:x1869355218496768:12345-192.168.202.31@tcp:37:bash.0 Request processed in 3330us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.908204:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 317 00000100:00100000:3.0:1782759461.911155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.911209:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218497024 00000100:00100000:1.0:1782759461.911218:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218497024 00000100:00100000:1.0:1782759461.911274:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 318 00000100:00100000:1.0:1782759461.911284:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105491:x1869355218497024:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:1.0:1782759461.911548:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:105491:x1869355218497024:12345-192.168.202.31@tcp:35:bash.0 Request processed in 264us (401us total) trans 4294967965 rc 0/0 00000100:00100000:1.0:1782759461.911556:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 318 00000100:00100000:0.0:1782759461.916689:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.916745:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218497152 00000100:00100000:1.0:1782759461.916765:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218497152 00000100:00100000:1.0:1782759461.916823:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2810 00000100:00100000:1.0:1782759461.916833:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:105952:x1869355218497152:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:1.0:1782759461.916858:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759461.916876:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c4f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272c0 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.916929:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.916940:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.916948:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.916958:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.916976:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.916980:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917047:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c509 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917053:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c509 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917058:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c509 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759461.917088:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1782759461.917092:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759461.917113:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c509 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917125:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917131:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 4/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917142:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917152:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917168:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759461.917172:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917180:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 5/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917190:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cded88bf100) 00010000:00010000:1.0:1782759461.917192:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759461.917195:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 3/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917200:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c4fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917210:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917214:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917217:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917220:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759461.917222:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917225:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917236:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cded88bf500) 00010000:00010000:1.0:1782759461.917238:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759461.917240:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917243:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c502 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917263:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c4f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272c0 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917271:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c509 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272c0 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.917276:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cded3a3b000) 00010000:00010000:1.0:1782759461.917278:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759461.917279:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759461.917325:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:105952:x1869355218497152:12345-192.168.202.31@tcp:101:cat.0 Request processed in 494us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.917330:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2810 00000100:00100000:3.0:1782759461.919929:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.920000:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218497408 00000100:00100000:1.0:1782759461.920012:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218497408 00000100:00100000:1.0:1782759461.920078:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2811 00000100:00100000:1.0:1782759461.920090:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:105952:x1869355218497408:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:1.0:1782759461.920109:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759461.920175:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c510 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272c7 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.920287:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c517 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.920302:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c517 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.920313:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c517 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759461.920323:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x17:0x0]: returning size 0 00010000:00010000:1.0:1782759461.920473:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c510 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272c7 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.920494:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c517 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272c7 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.920501:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:1.0:1782759461.920504:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759461.920507:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759461.920559:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:105952:x1869355218497408:12345-192.168.202.31@tcp:101:cat.0 Request processed in 472us (637us total) trans 4294967678 rc 0/0 00000100:00100000:1.0:1782759461.920565:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2811 00000100:00100000:3.0:1782759461.922955:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759461.923305:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759461.923368:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218497664 00000100:00100000:1.0:1782759461.923378:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218497664 00000100:00100000:0.0:1782759461.923393:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218497536 00000100:00100000:0.0:1782759461.923399:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218497536 00000100:00100000:1.0:1782759461.923445:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1060 00000100:00100000:1.0:1782759461.923455:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218497664:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:1.0:1782759461.923470:0:8445:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1782759461.923471:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 391 00000100:00100000:0.0:1782759461.923481:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2405:x1869355218497536:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759461.923496:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759461.923502:0:8445:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272ce expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759461.923518:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c517 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272c7 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759461.923528:0:8445:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x6a42c026, atime: 0x6a42c026, ctime: 0x6a42c026, blocks: 0x0 00010000:00010000:0.0:1782759461.923535:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:0.0:1782759461.923540:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759461.923547:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=3502s v=(0 0) 00010000:00010000:1.0:1782759461.923552:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759461.923562:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759461.923607:0:8445:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 8 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759461.923618:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2405:x1869355218497536:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 136us (680us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759461.923621:0:8445:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:0.0:1782759461.923629:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 391 00000100:00100000:1.0:1782759461.923662:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218497664:12345-192.168.202.31@tcp:101:cat.0 Request processed in 209us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759461.923671:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1060 00000100:00100000:3.0:1782759461.925892:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759461.926696:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218497792 00000100:00100000:0.0:1782759461.926706:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218497792 00002000:00100000:0.0:1782759461.926770:0:8450:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff8cddc4482a00 x1869355218497792/t0(0) o3->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:622/0 lens 488/0 e 0 to 0 dl 1782759472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759461.926781:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cddc4482a00 with x1869355218497792 ext(0->4095) 00002000:00010000:0.0:1782759461.926787:0:8450:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cddc4482a00 00000100:00100000:0.0:1782759461.926812:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 45 00000100:00100000:0.0:1782759461.926822:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218497792:12345-192.168.202.31@tcp:3:cat.0 00000100:00100000:0.0:1782759461.927024:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218497792:12345-192.168.202.31@tcp:3:cat.0 Request processed in 203us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759461.927032:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 45 00002000:00100000:0.0:1782759461.927040:0:8450:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000400:0x14:0x0] (0->4095) req@ffff8cddc4482a00 x1869355218497792/t0(0) o3->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:622/0 lens 488/440 e 0 to 0 dl 1782759472 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782759461.927047:0:8450:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cddc4482a00 with x1869355218497792 ext(0->4095) 00002000:00010000:0.0:1782759461.927055:0:8450:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cddc4482a00 00000100:00100000:0.0:1782759461.929700:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759461.929813:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218498048 00000100:00100000:2.0:1782759461.929823:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218498048 00000100:00100000:2.0:1782759461.929883:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 319 00000100:00100000:2.0:1782759461.929894:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:105952:x1869355218498048:12345-192.168.202.31@tcp:35:cat.0 00000100:00100000:2.0:1782759461.930147:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:105952:x1869355218498048:12345-192.168.202.31@tcp:35:cat.0 Request processed in 255us (453us total) trans 4294967679 rc 0/0 00000100:00100000:2.0:1782759461.930166:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 319 00000100:00100000:1.0:1782759461.940653:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759461.940829:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218498176 00000100:00100000:3.0:1782759461.940840:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218498176 00000100:00100000:3.0:1782759461.940907:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2812 00000100:00100000:3.0:1782759461.940923:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:105953:x1869355218498176:12345-192.168.202.31@tcp:62:lfs.0 00010000:00010000:3.0:1782759461.941041:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.941059:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.941072:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941146:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941164:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941176:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941244:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941255:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941261:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 4/0,1 mode: --/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941287:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.941296:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 15 pid: 12673 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.941377:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232888448:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759461.941452:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759461.942624:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355232888448:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759461.942673:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759461.942720:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759461.942828:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218498304 00000100:00100000:2.0:1782759461.942833:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218498304 00010000:00010000:2.0:1782759461.942860:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 16 pid: 12673 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.942892:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 775 00000100:00100000:2.0:1782759461.942904:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:2402:x1869355218498304:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759461.942918:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759461.942925:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 16 pid: 12673 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.942937:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 16 pid: 12673 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.942953:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c4a7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272a4 expref: 16 pid: 12673 timeout: 3602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.942968:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:2.0:1782759461.942973:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.942980:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.943001:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759461.943032:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759461.943056:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943064:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759461.943121:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2402:x1869355218498304:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 218us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759461.943128:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 775 00000040:00080000:3.0:1782759461.943281:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:3.0:1782759461.943289:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3502219710673ns, next at 3503219709266ns, rc = 0 00010000:00010000:3.0:1782759461.943367:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943376:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943383:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943389:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759461.943393:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943400:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943410:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:3.0:1782759461.943413:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759461.943417:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943423:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60c53a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x17:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943436:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943442:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943458:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943463:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943467:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759461.943471:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943477:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943485:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:3.0:1782759461.943488:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759461.943491:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943497:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c52c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943507:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943512:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943518:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943523:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759461.943532:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943543:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943551:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc3502a00) 00010000:00010000:3.0:1782759461.943554:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759461.943557:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759461.943563:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c533 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759461.943640:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:105953:x1869355218498176:12345-192.168.202.31@tcp:62:lfs.0 Request processed in 2725us (2997us total) trans 4294967680 rc 0/0 00000100:00100000:3.0:1782759461.943646:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2812 00010000:00010000:3.0:1782759462.218833:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759462.224211:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759462.224221:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759462.224227:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759462.224278:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.224291:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.224303:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759462.224344:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232888576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759462.224417:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759462.224478:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759462.224564:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888576 00000100:00100000:0.0:1782759462.224572:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888576 00000100:00100000:0.0:1782759462.224747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188 00000100:00100000:0.0:1782759462.224757:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232888576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759462.224771:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759462.224785:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c541 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.224809:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.224819:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759462.224828:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759462.224875:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232888576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759462.224882:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188 00000100:00100000:1.0:1782759462.224953:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232888576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759462.224969:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.224978:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759462.225007:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759462.225013:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.225020:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759462.329967:0:144194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffceacc8600 20000000:00000080:3.0:1782759462.329997:0:144194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c76000 uarg=0000000000000000 00010000:00010000:3.0:1782759462.330162:0:144194:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1782759462.330194:0:144194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cded3a3b000) 00010000:00010000:3.0:1782759462.330198:0:144194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759462.330208:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c4ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272b9 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330226:0:144194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759462.330229:0:144194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759462.330233:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c44c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27288 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330262:0:144194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cded3a3b000) 00010000:00010000:3.0:1782759462.330265:0:144194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759462.330268:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c509 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272c0 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330283:0:144194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cded88bf100) 00010000:00010000:3.0:1782759462.330285:0:144194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759462.330289:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c4c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ab expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330300:0:144194:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1782759462.330325:0:144194:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782759462.330341:0:144194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34ff600) 00010000:00010000:3.0:1782759462.330344:0:144194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1782759462.330348:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c45a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2728f expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330364:0:144194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:3.0:1782759462.330367:0:144194:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759462.330370:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c48b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2729d expref: 13 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330380:0:144194:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 2 locks, left on hash table 0. 10000000:01000000:3.0:1782759462.330395:0:144194:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759462.330408:0:144194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330442:0:144194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330450:0:144194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330485:0:144194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759462.330497:0:144194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 23 pid: 6524 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759462.330509:0:144194:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144194:1869355232888704:0@lo:104: 00000100:00100000:3.0:1782759462.330567:0:144194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759462.330639:0:144194:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759462.330722:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888704 00000100:00100000:2.0:1782759462.330729:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888704 00000100:00100000:2.0:1782759462.330788:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1782759462.330798:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:144194:x1869355232888704:12345-0@lo:104: 00010000:00010000:2.0:1782759462.330810:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.330871:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759462.330876:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:144194:x1869355232888704:12345-0@lo:104: Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759462.330883:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00010000:00010000:2.0:1782759462.330901:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759462.330906:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.330913:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759462.330916:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.330924:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759462.330930:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759462.330945:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759462.330971:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.330978:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759462.331009:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331015:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c541 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c548 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331027:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759462.331028:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759462.331030:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759462.331048:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232888832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759462.331075:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759462.331105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888832 00000100:00100000:2.0:1782759462.331109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888832 00010000:00010000:2.0:1782759462.331124:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 24 pid: 6524 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759462.331146:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1782759462.331153:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232888832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759462.331162:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759462.331167:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 24 pid: 6524 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331177:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 24 pid: 6524 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331195:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331202:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331213:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331221:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331228:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331234:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331240:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759462.331244:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331251:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331260:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759462.331269:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759462.331297:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232888832:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759462.331309:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:2.0:1782759462.331368:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232888832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759462.331433:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd800/0xd5b45c7f5c60c548 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c541 expref: 23 pid: 6524 timeout: 3652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759462.331443:0:144194:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144194:1869355232888704:0@lo:104: 00010000:00010000:1.0:1782759462.331454:0:144194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.331462:0:144194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.331477:0:144194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759462.331483:0:144194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60c54f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759462.795458:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759462.795550:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232888960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759462.795942:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759462.796058:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232888960 00000100:00100000:3.0:1782759462.796067:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232888960 00000100:00100000:3.0:1782759462.796156:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173 00000100:00100000:3.0:1782759462.796166:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232888960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759462.796200:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:3.0:1782759462.796319:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232888960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 154us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759462.796326:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173 00000100:00100000:2.0:1782759462.796396:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232888960:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759463.244245:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759463.754710:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759463.754716:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759463.754719:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759463.754761:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.754772:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.754783:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759463.754807:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232889088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759463.754870:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.754920:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759463.755027:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889088 00000100:00100000:2.0:1782759463.755035:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889088 00000100:00100000:2.0:1782759463.755096:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:2.0:1782759463.755107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232889088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759463.755120:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759463.755134:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c556 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.755156:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.755165:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.755174:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759463.755279:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232889088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759463.755286:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:0.0:1782759463.755395:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232889088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759463.755407:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.755416:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759463.755439:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759463.755443:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.755450:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759463.818792:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232889216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759463.818861:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759463.818919:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759463.818925:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232889344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759463.818952:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889216 00000100:00100000:0.0:1782759463.818952:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759463.818961:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889216 00000100:00100000:0.0:1782759463.818997:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889344 00000100:00100000:0.0:1782759463.819001:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889344 00000100:00080000:3.0:1782759463.819034:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759463.819039:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1782759463.819050:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971 00000100:00100000:2.0:1782759463.819060:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232889216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759463.819061:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232889344:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1782759463.819096:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759463.819139:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232889344:12345-0@lo:400:kworker.0 Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.819147:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971 00000100:00100000:2.0:1782759463.819153:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232889216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759463.819161:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1782759463.819184:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232889344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.819195:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232889216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759463.819392:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232889856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.819433:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232889472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.819434:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.819464:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232890368:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.819492:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.819498:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.819770:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1782759463.819771:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232889984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.819780:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232889728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.819818:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.819823:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759463.819836:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232890496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.819859:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232890240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.819865:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759463.819893:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759463.819898:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759463.819904:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232889600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.819931:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889856 00000100:00100000:0.0:1782759463.819936:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.819938:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889856 00000100:00100000:0.0:1782759463.819958:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232890112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.819990:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232890368 00000100:00100000:1.0:1782759463.819994:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232890368 00000100:00100000:0.0:1782759463.820002:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.820015:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889984 00000100:00100000:1.0:1782759463.820019:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889984 00000100:00100000:1.0:1782759463.820033:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232890496 00000100:00100000:1.0:1782759463.820035:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232890496 00000100:00100000:1.0:1782759463.820051:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889600 00000100:00100000:1.0:1782759463.820053:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889600 00000100:00100000:1.0:1782759463.820070:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972 00000100:00100000:1.0:1782759463.820077:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232889856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820091:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232890624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820126:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759463.820127:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232889856:12345-0@lo:400:kworker.0 Request processed in 47us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.820137:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972 00000100:00100000:1.0:1782759463.820154:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973 00000100:00100000:1.0:1782759463.820163:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232890368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820171:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:0.0:1782759463.820180:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232889984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.820197:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232890368:12345-0@lo:400:kworker.0 Request processed in 35us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.820204:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973 00000100:00100000:1.0:1782759463.820222:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4975 00000100:00100000:0.0:1782759463.820227:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232889984:12345-0@lo:400:kworker.0 Request processed in 47us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.820232:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232890496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820239:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00000100:00100000:0.0:1782759463.820257:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976 00000100:00100000:0.0:1782759463.820265:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232889600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.820286:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232890496:12345-0@lo:400:kworker.0 Request processed in 56us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.820292:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4975 00000100:00100000:0.0:1782759463.820307:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232889600:12345-0@lo:400:kworker.0 Request processed in 42us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.820316:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976 00000100:00100000:1.0:1782759463.820319:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889472 00000100:00100000:1.0:1782759463.820329:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889472 00000100:00100000:0.0:1782759463.820341:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232889728 00000100:00100000:0.0:1782759463.820354:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232889728 00000100:00100000:1.0:1782759463.820375:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:0.0:1782759463.820387:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3175 00000100:00100000:0.0:1782759463.820397:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232889728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820426:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232889728:12345-0@lo:400:kworker.0 Request processed in 33us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.820436:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3175 00000100:00100000:0.0:1782759463.820457:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232890240 00000100:00100000:0.0:1782759463.820460:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232890240 00000100:00100000:0.0:1782759463.820501:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232890112 00000100:00100000:0.0:1782759463.820505:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232890112 00000100:00100000:0.0:1782759463.820530:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:0.0:1782759463.820539:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820622:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232890240:12345-0@lo:400:kworker.0 Request processed in 85us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.820629:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:0.0:1782759463.820639:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232890624 00000100:00100000:0.0:1782759463.820643:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232890624 00000100:00100000:0.0:1782759463.820667:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1782759463.820673:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232890112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820710:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232890112:12345-0@lo:400:kworker.0 Request processed in 37us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.820717:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:0.0:1782759463.820729:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1782759463.820737:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232890624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820770:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232890624:12345-0@lo:400:kworker.0 Request processed in 34us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759463.820776:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:3.0:1782759463.820808:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232889600:0@lo:400:kworker.0 00000100:00080000:0.0:1782759463.820810:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759463.820816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759463.820819:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759463.820821:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759463.820827:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232890112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820841:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232889728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759463.820856:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232890624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820864:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232890240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759463.820877:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232889984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820879:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232889856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759463.820897:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232890368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759463.820904:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232890496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.821549:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232889472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.821625:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232889472:12345-0@lo:400:kworker.0 Request processed in 1241us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.821632:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000001:00080000:1.0:1782759463.822380:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967965 is committed 00000100:00100000:2.0:1782759463.823149:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232889472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759463.946790:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759463.948982:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218498560 00000100:00100000:0.0:1782759463.948994:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218498560 00000100:00100000:0.0:1782759463.949072:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2813 00000100:00100000:0.0:1782759463.949082:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:106026:x1869355218498560:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759463.949105:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759463.949126:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c564 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272d5 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949222:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949236:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949247:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949257:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949265:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949272:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759463.949572:0:12673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x14:0x0], index 1: 0 00010000:00010000:0.0:1782759463.949738:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c579 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949747:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c579 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949755:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c579 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949789:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949796:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949801:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949808:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949814:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759463.949818:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949825:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949836:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc3502c00) 00010000:00010000:0.0:1782759463.949839:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759463.949850:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949857:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c56b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759463.949870:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff2f8566 reply state 000000000bfaeba0 transno 4294967681 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949880:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.949885:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc3502a00) 00010000:00010000:0.0:1782759463.949887:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759463.949889:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1782759463.950043:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759463.950254:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c564 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272d5 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.950273:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c579 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272d5 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759463.950280:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc3502f00) 00010000:00010000:0.0:1782759463.950283:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759463.950285:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc400, rc 0) 00000100:00100000:0.0:1782759463.950461:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:106026:x1869355218498560:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1380us (3680us total) trans 4294967681 rc 0/0 00000100:00100000:0.0:1782759463.950469:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2813 00000100:00100000:2.0:1782759463.954432:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759463.954715:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218498816 00000100:00100000:3.0:1782759463.954725:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218498816 00000100:00100000:3.0:1782759463.954921:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2814 00000100:00100000:3.0:1782759463.954933:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:106026:x1869355218498816:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:3.0:1782759463.954993:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759463.955018:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c579 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272d5 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.955033:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc3502f00) 00010000:00010000:3.0:1782759463.955042:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759463.955091:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.955103:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.955111:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759463.955218:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ff5d9a7 reply state 00000000bac7d9a5 transno 4294967682 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.955231:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.955244:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759463.955246:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759463.955248:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759463.955333:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:106026:x1869355218498816:12345-192.168.202.31@tcp:36:touch.0 Request processed in 402us (910us total) trans 4294967682 rc 0/0 00000100:00100000:3.0:1782759463.955340:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2814 00000100:00100000:2.0:1782759463.958012:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759463.958050:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218498944 00000100:00100000:2.0:1782759463.958061:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218498944 00000100:00100000:2.0:1782759463.958183:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2815 00000100:00100000:2.0:1782759463.958195:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:106026:x1869355218498944:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759463.958298:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759463.958319:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60c58e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272dc expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.958372:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60c58e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272dc expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.958387:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60c58e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272dc expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.958407:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:2.0:1782759463.958410:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759463.958413:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759463.958460:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106026:x1869355218498944:12345-192.168.202.31@tcp:101:touch.0 Request processed in 268us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759463.958465:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2815 00000001:00080000:0.0:1782759463.960072:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967681 is committed 00000004:00080000:0.0:1782759463.960084:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 87 committed 00010000:00010000:2.0:1782759463.960109:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759463.960109:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 29 batchid updated 00010000:00010000:2.0:1782759463.960128:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960136:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960142:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759463.960147:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960155:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960169:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc3502a00) 00010000:00010000:2.0:1782759463.960172:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759463.960176:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960182:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c46f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759463.960204:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 29 00010000:00010000:2.0:1782759463.960210:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960218:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960224:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960229:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759463.960240:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960248:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759463.960254:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc26299c0 with version 61 00010000:00010000:2.0:1782759463.960258:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x17:0x0].0x0 (ffff8cded3a3b200) 00010000:00010000:2.0:1782759463.960262:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759463.960266:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759463.960266:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 29 cancel update log [0x200000401:0x2:0x0].30: rc = 0 00010000:00010000:2.0:1782759463.960278:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c484 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960298:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960305:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960311:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960317:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759463.960320:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960326:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759463.960328:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 29 cancel update log [0x240000400:0x2:0x0].29: rc = 0 00000020:00080000:0.0:1782759463.960340:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 29 00010000:00010000:2.0:1782759463.960342:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc3502a00) 00010000:00010000:2.0:1782759463.960346:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759463.960356:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759463.960357:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232890752:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1782759463.960369:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c572 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759463.960414:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782759463.960478:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 61 rpc_version 61 00000020:00100000:0.0:1782759463.960494:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759463.960502:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc208d880 x1869355232891008/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759463.960518:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232890752 00000100:00100000:0.0:1782759463.960519:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232891008:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759463.960527:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232890752 00000100:00100000:0.0:1782759463.960552:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759463.960569:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c966c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759463.960600:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891008 00000100:00100000:2.0:1782759463.960601:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1782759463.960605:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891008 00000100:00100000:2.0:1782759463.960616:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232890752:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1782759463.960640:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:20 count 1 00000100:00100000:0.0:1782759463.960645:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1782759463.960653:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355232891008:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1782759463.960660:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960680:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 7 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960689:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782759463.960694:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759463.960698:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960726:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 7 pid: 8445 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.960740:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 7 pid: 8445 timeout: 3604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759463.960767:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1869355232891136:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759463.960770:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232891008:12345-0@lo:1000:osp_up0-1.0 Request processed in 114us (215us total) trans 4294967966 rc 0/0 00000100:00100000:0.0:1782759463.960780:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3176 00000100:00100000:0.0:1782759463.960831:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232891008:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759463.960834:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759463.961963:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759463.962204:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218499072 00000100:00100000:1.0:1782759463.962211:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218499072 00000100:00100000:1.0:1782759463.962273:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1062 00000100:00100000:1.0:1782759463.962281:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1869355218499072:12345-192.168.202.31@tcp:8:touch.0 00010000:00080000:1.0:1782759463.962311:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp t0 exp 0000000000000000 cur 3504 last 0 00000020:00000080:1.0:1782759463.962340:0:8446:0:(genops.c:1406:class_connect()) connect: client e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0, cookie 0xd5b45c7f5c60c59c 00002000:00100000:1.0:1782759463.962354:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0/ffff8cded3bdc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759463.962365:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759463.962434:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782759463.962459:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cded3bdd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759463.962545:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2401:x1869355218499072:12345-192.168.202.31@tcp:8:touch.0 Request processed in 262us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.962553:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1062 00000100:00100000:0.0:1782759463.963545:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759463.963643:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218499328 00000100:00100000:1.0:1782759463.963648:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218499328 00010000:00010000:1.0:1782759463.963683:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 8 pid: 8445 timeout: 3604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759463.963747:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 777 00000100:00100000:1.0:1782759463.963762:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218499328:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759463.963775:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759463.963781:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 8 pid: 8445 timeout: 3604 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.963793:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 8 pid: 8445 timeout: 3604 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.963816:0:9534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759463.963821:0:9534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759463.963825:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.963834:0:9534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.963851:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759463.963887:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218499328:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 126us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759463.963895:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 777 00000100:00080000:0.0:1782759463.964024:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759463.964202:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60c525 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ce expref: 7 pid: 8445 timeout: 3604 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759463.964212:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8447:1869355232891136:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759463.964234:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.964244:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.964252:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.964261:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.964269:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759463.964304:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782759463.964441:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232890752:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3830us (4027us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1782759463.964449:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00010000:00010000:1.0:1782759463.964516:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759463.964522:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.964531:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759463.964535:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.964550:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.964562:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.964569:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000493cece1/0xd5b45c7f5c60c595 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759463.964617:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759463.964619:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759463.964622:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759463.964716:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000004:00080000:0.0:1782759463.964768:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc208ce00/2, rc 0, transno 4294967411 00000100:00100000:0.0:1782759463.964774:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232890752:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1782759463.964818:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218499200 00000100:00100000:1.0:1782759463.964823:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218499200 00000100:00080000:0.0:1782759463.964901:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759463.964931:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1063 00000100:00100000:1.0:1782759463.964940:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:0:x1869355218499200:12345-192.168.202.31@tcp:2:touch.0 00000001:00080000:1.0:1782759463.976064:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967404 is committed 00000001:00100000:1.0:1782759463.976078:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000100:00100000:0.0:1782759463.978444:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:0:x1869355218499200:12345-192.168.202.31@tcp:2:touch.0 Request processed in 13497us (13719us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1782759463.978457:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1063 00000100:00100000:1.0:1782759463.980941:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759463.980996:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218499584 00000100:00100000:0.0:1782759463.981006:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218499584 00000100:00100000:0.0:1782759463.981057:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 320 00000100:00100000:0.0:1782759463.981066:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9344c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:106026:x1869355218499584:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:0.0:1782759463.981326:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9344c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:106026:x1869355218499584:12345-192.168.202.31@tcp:35:touch.0 Request processed in 260us (388us total) trans 4294967683 rc 0/0 00000100:00100000:0.0:1782759463.981334:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 320 00000100:00100000:1.0:1782759463.993209:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759463.993273:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218499712 00000100:00100000:2.0:1782759463.993282:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218499712 00000100:00100000:2.0:1782759463.993348:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2816 00000100:00100000:2.0:1782759463.993359:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:106027:x1869355218499712:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759463.993382:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759463.993404:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5a3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272e3 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993462:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 3/1,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993476:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993487:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993500:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993506:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993512:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993634:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993644:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993651:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759463.993692:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x18:0x0]: returning size 0 00000004:00200000:2.0:1782759463.993697:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759463.993717:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993728:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993737:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993744:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993749:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993756:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993762:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759463.993766:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993788:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993800:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:2.0:1782759463.993803:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759463.993808:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 3/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993815:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60c5aa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993828:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993833:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993838:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993843:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759463.993846:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993851:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993858:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc34fdb00) 00010000:00010000:2.0:1782759463.993860:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759463.993863:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993877:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60c5b1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993906:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5a3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272e3 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993921:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272e3 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759463.993929:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:2.0:1782759463.993931:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759463.993933:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759463.994003:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106027:x1869355218499712:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 645us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759463.994011:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2816 00000100:00100000:3.0:1782759464.007069:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759464.008206:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218499840 00000100:00100000:1.0:1782759464.008217:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218499840 00000100:00100000:1.0:1782759464.008287:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2817 00000100:00100000:1.0:1782759464.008298:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106028:x1869355218499840:12345-192.168.202.31@tcp:53:lfs.0 00000004:00000080:1.0:1782759464.008333:0:6533:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x240000405:0x18:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782759464.008471:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106028:x1869355218499840:12345-192.168.202.31@tcp:53:lfs.0 Request processed in 174us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759464.008479:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2817 00000100:00100000:1.0:1782759464.017947:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759464.018022:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218500096 00000100:00100000:2.0:1782759464.018032:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218500096 00000100:00080000:0.0:1782759464.018094:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759464.018119:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2818 00000100:00100000:2.0:1782759464.018142:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:105491:x1869355218500096:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1782759464.018163:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759464.018185:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272ea expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759464.018448:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1782759464.018526:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ea expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.018550:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:2.0:1782759464.018553:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759464.018556:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ea expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.018573:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759464.018680:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105491:x1869355218500096:12345-192.168.202.31@tcp:101:bash.0 Request processed in 550us (739us total) trans 4294967967 rc 301/301 00000100:00100000:2.0:1782759464.018688:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2818 00000100:00100000:0.0:1782759464.021427:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759464.021630:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218500352 00000100:00100000:2.0:1782759464.021639:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218500352 00000100:00100000:2.0:1782759464.021702:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 321 00000100:00100000:2.0:1782759464.021713:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105491:x1869355218500352:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:2.0:1782759464.021906:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218500352:12345-192.168.202.31@tcp:35:bash.0 Request processed in 195us (497us total) trans 4294967968 rc 0/0 00000100:00100000:2.0:1782759464.021911:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 321 00000100:00100000:3.0:1782759464.027620:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759464.028289:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218500608 00000100:00100000:2.0:1782759464.028300:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218500608 00000100:00100000:2.0:1782759464.028366:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2819 00000100:00100000:2.0:1782759464.028379:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106029:x1869355218500608:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:2.0:1782759464.028400:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759464.028421:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272f1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.028484:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5cd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f1 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.028510:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cddc34fd800) 00010000:00010000:2.0:1782759464.028513:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759464.028517:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60c5cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f1 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.028536:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759464.028623:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106029:x1869355218500608:12345-192.168.202.31@tcp:101:cat.0 Request processed in 247us (1048us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759464.028630:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2819 00000100:00100000:1.0:1782759464.038804:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759464.038918:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218500736 00000100:00100000:0.0:1782759464.038928:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218500736 00000100:00100000:0.0:1782759464.039025:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2820 00000100:00100000:0.0:1782759464.039036:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106030:x1869355218500736:12345-192.168.202.31@tcp:62:lfs.0 00000100:00100000:0.0:1782759464.039153:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106030:x1869355218500736:12345-192.168.202.31@tcp:62:lfs.0 Request processed in 118us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759464.039161:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2820 00000100:00100000:0.0:1782759464.049840:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759464.049903:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218500864 00000100:00100000:2.0:1782759464.049913:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218500864 00000100:00100000:2.0:1782759464.049992:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1064 00000100:00100000:2.0:1782759464.050005:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218500864:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759464.050022:0:8600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759464.050040:0:8600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272f8 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759464.050066:0:8600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x14:0x0] initial LVB size: 0, mtime: 0x6a42c028, atime: 0x6a42c028, ctime: 0x6a42c028, blocks: 0x0 00010000:00010000:2.0:1782759464.050084:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=3504s v=(0 0) 00010000:00010000:2.0:1782759464.050090:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759464.050099:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 6 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.050118:0:8600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 6 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.050150:0:8600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759464.050217:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218500864:12345-192.168.202.31@tcp:101:rm.0 Request processed in 216us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759464.050225:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1064 00000100:00100000:1.0:1782759464.052561:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759464.052829:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501120 00000100:00100000:3.0:1782759464.052838:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501120 00000100:00100000:3.0:1782759464.052899:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2821 00000100:00100000:3.0:1782759464.052910:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106031:x1869355218501120:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1782759464.052958:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782759464.052994:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c5b8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272e3 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053017:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60c58e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272dc expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053026:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759464.053031:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759464.053054:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053066:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053083:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053114:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053122:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053129:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053214:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053223:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053234:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759464.053439:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9536 00000004:00080000:3.0:1782759464.053449:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3504329871008ns, next at 3505329869145ns, rc = 0 00010000:00010000:3.0:1782759464.053490:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053499:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053507:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053515:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053532:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.053539:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054284:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759464.054307:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054314:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054321:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054328:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759464.054332:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054337:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759464.054339:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054347:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054354:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759464.054359:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759464.054363:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054366:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759464.054371:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c5e9 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054373:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054388:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054399:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054400:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:2.0:1782759464.054404:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759464.054407:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054423:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054424:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c5f0 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054441:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054448:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.054449:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759464.054453:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759464.054455:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759464.054456:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759464.054461:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054468:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054475:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34f4200) 00010000:00010000:3.0:1782759464.054477:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759464.054480:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054486:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c5db lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759464.054499:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003050b502 reply state 00000000b06684b6 transno 4294967684 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054510:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.054517:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759464.054524:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759464.054527:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759464.054629:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106031:x1869355218501120:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1719us (2083us total) trans 4294967684 rc 0/0 00000100:00100000:3.0:1782759464.054636:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2821 00010000:00010000:3.0:1782759464.266772:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759464.330824:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759464.330846:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232891264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759464.330927:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759464.331055:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891264 00000100:00100000:1.0:1782759464.331063:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891264 00000100:00100000:1.0:1782759464.331116:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1782759464.331125:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232891264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759464.331149:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759464.331194:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232891264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759464.331202:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:3.0:1782759464.331369:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232891264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759464.842873:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232891392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759464.842942:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759464.843006:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891392 00000100:00100000:1.0:1782759464.843023:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891392 00000100:00100000:1.0:1782759464.843083:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:1.0:1782759464.843093:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232891392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759464.843124:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:1.0:1782759464.843172:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232891392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759464.843179:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:2.0:1782759464.843211:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232891392:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1782759464.955632:0:144437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd1cd5850 20000000:00000080:2.0:1782759464.955650:0:144437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf850000 uarg=0000000000000000 00010000:00010000:2.0:1782759464.956377:0:144437:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759464.956390:0:144437:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759464.956404:0:144437:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759464.956412:0:144437:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759464.956438:0:144437:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759464.956452:0:144437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.956465:0:144437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.956472:0:144437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.956509:0:144437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.956523:0:144437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 23 pid: 6525 timeout: 3655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759464.956537:0:144437:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144437:1869355232891520:0@lo:104: 00000100:00100000:2.0:1782759464.956632:0:144437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759464.956726:0:144437:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759464.956768:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891520 00000100:00100000:3.0:1782759464.956775:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891520 00000100:00100000:3.0:1782759464.956862:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1782759464.956872:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:144437:x1869355232891520:12345-0@lo:104: 00010000:00010000:3.0:1782759464.956885:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759464.956936:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759464.956943:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:144437:x1869355232891520:12345-0@lo:104: Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759464.956950:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00010000:00010000:1.0:1782759464.956974:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759464.956980:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.956988:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759464.957001:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957009:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759464.957014:0:144437:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144437:1869355232891520:0@lo:104: 10000000:00010000:1.0:1782759464.957016:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759464.957021:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759464.957033:0:144437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957049:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957055:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759464.957082:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957089:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429000/0xd5b45c7f5c60c556 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c55d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957102:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759464.957103:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759464.957105:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759464.957106:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759464.957116:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232891648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759464.957147:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759464.957388:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891648 00000100:00100000:1.0:1782759464.957392:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891648 00010000:00010000:1.0:1782759464.957408:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 24 pid: 6525 timeout: 3655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759464.957427:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1782759464.957433:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232891648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759464.957443:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759464.957454:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 24 pid: 6525 timeout: 3655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957463:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 24 pid: 6525 timeout: 3655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957472:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c55d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c556 expref: 24 pid: 6525 timeout: 3655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957481:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957486:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957494:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957499:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957503:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957507:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957510:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759464.957513:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957517:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957711:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.957717:0:144437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759464.957721:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759464.957724:0:144437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759464.957730:0:144437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c5f7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759464.957760:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232891648:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759464.957766:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:3.0:1782759464.958062:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232891648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759465.184628:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759465.184671:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759465.184693:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759465.184714:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759465.184737:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759465.184781:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501760 00000100:00100000:1.0:1782759465.184791:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501760 00000100:00100000:1.0:1782759465.184846:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501632 00000100:00100000:1.0:1782759465.184849:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501632 00000100:00100000:1.0:1782759465.184872:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2859 00000100:00100000:1.0:1782759465.184882:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218501760:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759465.184948:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218501760:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.184969:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2859 00000100:00100000:1.0:1782759465.184986:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2860 00000100:00100000:1.0:1782759465.184994:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218501632:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759465.185022:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218501632:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.185028:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2860 00000100:00080000:1.0:1782759465.185170:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759465.185173:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759465.185183:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501248 00000100:00100000:1.0:1782759465.185187:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501248 00000100:00100000:1.0:1782759465.185211:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3190 00000100:00100000:1.0:1782759465.185218:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218501248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759465.185263:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218501248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.185269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3190 00000100:00100000:0.0:1782759465.190042:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501504 00000100:00100000:0.0:1782759465.190053:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501504 00000100:00100000:1.0:1782759465.190338:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501376 00000100:00100000:1.0:1782759465.190343:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501376 00000100:00100000:1.0:1782759465.190374:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4977 00000100:00100000:3.0:1782759465.190388:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4978 00000100:00100000:1.0:1782759465.190389:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2404:x1869355218501504:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759465.190401:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218501376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759465.190538:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218501376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 141us (5822us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759465.190552:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4978 00000100:00080000:0.0:1782759465.190614:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759465.192094:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2404:x1869355218501504:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1704us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759465.192106:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4977 00010000:00010000:2.0:1782759465.290853:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759465.354706:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232891776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759465.354778:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759465.354881:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891776 00000100:00100000:0.0:1782759465.354889:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891776 00000100:00100000:0.0:1782759465.354965:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1782759465.354975:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232891776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759465.355005:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759465.355059:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232891776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759465.355068:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00080000:0.0:1782759465.355097:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759465.355146:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232891776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759465.359077:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759465.359099:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232891904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759465.359228:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759465.359393:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232891904 00000100:00100000:3.0:1782759465.359400:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232891904 00000100:00080000:2.0:1782759465.359444:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759465.359542:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1782759465.359554:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232891904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759465.359601:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759465.359654:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232891904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759465.359662:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1782759465.359712:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232891904:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1782759465.421508:0:144485:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc21a28f60 20000000:00000080:2.0:1782759465.421526:0:144485:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf850400 uarg=0000000000000000 00010000:00010000:2.0:1782759465.421811:0:144485:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759465.421833:0:144485:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759465.421862:0:144485:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759465.421875:0:144485:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759465.421896:0:144485:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759465.421914:0:144485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.421930:0:144485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.421941:0:144485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.421968:0:144485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.421975:0:144485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.421982:0:144485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.421989:0:144485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759465.421994:0:144485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.422003:0:144485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.422016:0:144485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.422023:0:144485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759465.422030:0:144485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60c5fe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782759465.849853:0:144533:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe21d35080 20000000:00000080:0.0:1782759465.849869:0:144533:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4848800 uarg=0000000000000000 00010000:00010000:0.0:1782759465.850319:0:144533:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759465.850336:0:144533:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759465.850358:0:144533:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759465.850371:0:144533:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759465.850390:0:144533:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759465.850409:0:144533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850424:0:144533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850436:0:144533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850449:0:144533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850456:0:144533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850463:0:144533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850468:0:144533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759465.850472:0:144533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850481:0:144533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850494:0:144533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850502:0:144533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759465.850507:0:144533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c605 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759466.278842:0:144581:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc99e60ce0 20000000:00000080:3.0:1782759466.278857:0:144581:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12eb800 uarg=0000000000000000 00010000:00010000:3.0:1782759466.279037:0:144581:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759466.279048:0:144581:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759466.279068:0:144581:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759466.279075:0:144581:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759466.279089:0:144581:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759466.279112:0:144581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279127:0:144581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279138:0:144581:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279145:0:144581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279159:0:144581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279165:0:144581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279169:0:144581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759466.279172:0:144581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279177:0:144581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279187:0:144581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279192:0:144581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.279196:0:144581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c60c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759466.315845:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759466.891725:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759466.891731:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759466.891736:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759466.891780:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.891804:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.891816:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759466.891839:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232892032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759466.891906:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759466.891992:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892032 00000100:00100000:2.0:1782759466.892001:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892032 00000100:00100000:0.0:1782759466.892001:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759466.892074:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:2.0:1782759466.892086:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232892032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759466.892112:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759466.892126:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c613 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.892151:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.892162:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759466.892172:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759466.892211:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232892032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759466.892218:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:0.0:1782759466.892423:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232892032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759466.892437:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.892445:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759466.892460:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759466.892465:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759466.892471:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759467.342020:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759467.914793:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759467.914831:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232892160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759467.914910:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759467.914964:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892160 00000100:00100000:2.0:1782759467.914974:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892160 00000100:00100000:2.0:1782759467.915053:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00000100:00100000:2.0:1782759467.915067:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232892160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759467.915106:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:2.0:1782759467.915161:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232892160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759467.915168:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:1.0:1782759467.915216:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232892160:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1782759467.916111:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967411 is committed 00000001:00080000:0.0:1782759467.916121:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967410 is committed 00000020:00000080:3.0:1782759468.139372:0:144776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc896bdb0 20000000:00000080:3.0:1782759468.139386:0:144776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12e9400 uarg=0000000000000000 10000000:01000000:3.0:1782759468.139536:0:144776:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759468.139556:0:144776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.139599:0:144776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.139606:0:144776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.139635:0:144776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.139645:0:144776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 23 pid: 6525 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759468.139656:0:144776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144776:1869355232892288:0@lo:104: 00000100:00100000:3.0:1782759468.139704:0:144776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759468.139742:0:144776:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c5e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759468.139753:0:140593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759468.139766:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892288 00000100:00100000:2.0:1782759468.139772:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892288 00000100:00100000:2.0:1782759468.139825:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1782759468.139835:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:144776:x1869355232892288:12345-0@lo:104: 00010000:00010000:2.0:1782759468.139847:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759468.139914:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759468.139921:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:144776:x1869355232892288:12345-0@lo:104: Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759468.139928:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00010000:00010000:1.0:1782759468.139950:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759468.139959:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.139968:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759468.139972:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.139989:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759468.139997:0:144776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:144776:1869355232892288:0@lo:104: 10000000:00010000:1.0:1782759468.139998:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759468.140010:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759468.140020:0:144776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140058:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140066:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759468.140088:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759468.140094:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232892416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759468.140098:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c613 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c61a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140118:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759468.140121:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759468.140123:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759468.140127:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.140156:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892416 00000100:00100000:1.0:1782759468.140162:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892416 00010000:00010000:1.0:1782759468.140182:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 24 pid: 6525 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759468.140210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1782759468.140217:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232892416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759468.140227:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759468.140233:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 24 pid: 6525 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140249:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 24 pid: 6525 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140261:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c61a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c613 expref: 24 pid: 6525 timeout: 3658 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140272:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140280:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140293:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140300:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140306:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140312:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140318:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759468.140321:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140327:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140352:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759468.140361:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759468.140379:0:144776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.140386:0:144776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.140390:0:144776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c621 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759468.140403:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232892416:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.140412:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1782759468.140422:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232892416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759468.362807:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759468.553414:0:144824:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe805cd590 20000000:00000080:3.0:1782759468.553438:0:144824:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12e8400 uarg=0000000000000000 10000000:01000000:3.0:1782759468.553596:0:144824:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759468.553618:0:144824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553636:0:144824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553646:0:144824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553653:0:144824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553660:0:144824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553668:0:144824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553674:0:144824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759468.553678:0:144824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553687:0:144824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553699:0:144824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553707:0:144824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759468.553725:0:144824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c628 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759468.939135:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759468.939158:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232892544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759468.939246:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.941349:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892544 00000100:00100000:1.0:1782759468.941358:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892544 00000100:00080000:0.0:1782759468.941419:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759468.941433:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1782759468.941640:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232892672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.941691:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759468.941720:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232893184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.941745:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.941747:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232892544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759468.941762:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232893696:0@lo:400:kworker.0 00002000:00000024:1.0:1782759468.941782:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759468.941797:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.941820:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232892544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 379us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.941826:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1782759468.941832:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232892544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759468.941848:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782759468.941853:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232893056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.941876:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759468.941906:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232893568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.941944:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759468.941966:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232894080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.941969:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893056 00000100:00100000:1.0:1782759468.941973:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893056 00000100:00100000:0.0:1782759468.941986:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.942010:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4979 00000100:00100000:0.0:1782759468.942010:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232892800:0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942016:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232893056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942031:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.942047:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232893056:12345-0@lo:400:kworker.0 Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759468.942047:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232893312:0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942054:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4979 00000100:00100000:1.0:1782759468.942065:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892800 00000100:00100000:0.0:1782759468.942066:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.942068:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892800 00000100:00100000:2.0:1782759468.942078:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893696 00000100:00100000:2.0:1782759468.942084:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893696 00000100:00100000:0.0:1782759468.942086:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232893824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942087:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893312 00000100:00100000:1.0:1782759468.942091:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893312 00000100:00100000:0.0:1782759468.942106:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.942123:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893824 00000100:00100000:0.0:1782759468.942128:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759468.942132:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893568 00000100:00100000:1.0:1782759468.942132:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893824 00000100:00100000:0.0:1782759468.942135:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232892928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759468.942138:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893568 00000100:00100000:1.0:1782759468.942155:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4980 00000100:00100000:1.0:1782759468.942164:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232892800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759468.942175:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894080 00000100:00100000:2.0:1782759468.942181:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894080 00000100:00100000:0.0:1782759468.942181:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.942201:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232892800:12345-0@lo:400:kworker.0 Request processed in 39us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.942209:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4980 00000100:00100000:2.0:1782759468.942213:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759468.942216:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232893440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942225:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4981 00000100:00100000:2.0:1782759468.942229:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232893696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942237:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232893312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942239:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759468.942250:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232893952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942275:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759468.942279:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232893312:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.942284:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4981 00000100:00100000:2.0:1782759468.942290:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232893696:12345-0@lo:400:kworker.0 Request processed in 67us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.942294:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893440 00000100:00100000:1.0:1782759468.942298:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893440 00000100:00100000:0.0:1782759468.942298:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232892800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759468.942301:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759468.942311:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232893312:0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942315:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893952 00000100:00100000:1.0:1782759468.942317:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893952 00000100:00100000:2.0:1782759468.942332:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:1.0:1782759468.942336:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4982 00000100:00100000:0.0:1782759468.942344:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892672 00000100:00100000:0.0:1782759468.942348:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892672 00000100:00100000:2.0:1782759468.942349:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232893568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942349:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232893824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942372:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:0.0:1782759468.942378:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232892672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759468.942399:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232893568:12345-0@lo:400:kworker.0 Request processed in 58us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.942406:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232893824:12345-0@lo:400:kworker.0 Request processed in 60us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759468.942406:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232892672:12345-0@lo:400:kworker.0 Request processed in 27us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759468.942411:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1782759468.942419:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00100000:1.0:1782759468.942426:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4982 00000100:00100000:2.0:1782759468.942429:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:1.0:1782759468.942444:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4983 00000100:00100000:2.0:1782759468.942446:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232894080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942455:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942457:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232893184 00000100:00100000:0.0:1782759468.942461:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232893184 00000100:00100000:2.0:1782759468.942487:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232894080:12345-0@lo:400:kworker.0 Request processed in 43us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759468.942497:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1782759468.942497:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232892928 00000100:00100000:1.0:1782759468.942498:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232893440:12345-0@lo:400:kworker.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759468.942503:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232892928 00000100:00100000:1.0:1782759468.942507:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4983 00000100:00100000:1.0:1782759468.942521:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4984 00000100:00100000:0.0:1782759468.942521:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:1.0:1782759468.942527:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232893952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942527:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232893184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759468.942558:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232893952:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759468.942558:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232893184:12345-0@lo:400:kworker.0 Request processed in 32us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759468.942564:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4984 00000100:00100000:0.0:1782759468.942564:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:0.0:1782759468.942705:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:0.0:1782759468.942713:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3662:x1869355232892928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.942746:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3662:x1869355232892928:12345-0@lo:400:kworker.0 Request processed in 35us (567us total) trans 0 rc 0/0 00000100:00080000:3.0:1782759468.945084:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759468.945091:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759468.945093:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759468.945094:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759468.945308:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232893056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945318:0:3665:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967411 gen 2 00000004:00080000:3.0:1782759468.945321:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc208ce00, transno 4294967411 00000100:00100000:3.0:1782759468.945330:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232893568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945337:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232894080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945344:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232892672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945350:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232893184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945356:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232893696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945522:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232892928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945530:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232893440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945538:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232893952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759468.945546:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232893824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759468.945640:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000020:00000080:0.0:1782759468.960138:0:144872:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd19149130 20000000:00000080:0.0:1782759468.960156:0:144872:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c1b000 uarg=0000000000000000 00010000:00010000:0.0:1782759468.960334:0:144872:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759468.960351:0:144872:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759468.960375:0:144872:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759468.960387:0:144872:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759468.960406:0:144872:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759468.960427:0:144872:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960442:0:144872:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960453:0:144872:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960459:0:144872:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960466:0:144872:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960473:0:144872:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960479:0:144872:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759468.960483:0:144872:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960497:0:144872:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960510:0:144872:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960518:0:144872:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759468.960524:0:144872:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60c62f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 144872 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759468.961648:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967968 is committed 00000001:00080000:1.0:1782759468.961660:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967966 is committed 00010000:00010000:3.0:1782759469.387911:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782759469.450720:0:9996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3509727140400ns, next at 3510727137921ns, rc = 0 00000100:00100000:0.0:1782759469.450951:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759469.450973:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232894208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759469.451081:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759469.451183:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894208 00000100:00100000:1.0:1782759469.451190:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894208 00000100:00100000:1.0:1782759469.451275:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1782759469.451287:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232894208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759469.451309:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759469.451371:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232894208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759469.451377:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1782759469.451978:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232894208:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1782759469.457291:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 93 committed 00000001:00080000:2.0:1782759469.457333:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967684 is committed 00000004:00080000:2.0:1782759469.457339:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 92 committed 00010000:00010000:3.0:1782759469.457419:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457443:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457450:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457455:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759469.457460:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457467:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759469.457479:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232894336:0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1782759469.457482:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x18:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759469.457488:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759469.457492:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457497:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c587 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759469.457549:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759469.457570:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894336 00000100:00100000:2.0:1782759469.457597:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894336 00000100:00100000:2.0:1782759469.457646:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1782759469.457656:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232894336:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:2.0:1782759469.457682:0:82628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:20 count 1 00010000:00010000:2.0:1782759469.457702:0:82628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.457722:0:82628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 5 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.457729:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1782759469.457733:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759469.457737:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.457761:0:82628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 5 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.457774:0:82628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 5 pid: 8600 timeout: 3609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759469.457792:0:82628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:82628:1869355232894464:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759469.457850:0:82628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e36600 going to sleep for 11 seconds 00010000:00010000:3.0:1782759469.457900:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457908:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457914:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457929:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759469.457939:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457945:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457954:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759469.457957:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759469.457959:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759469.457965:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c5e2 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759469.460126:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759469.460239:0:82628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:82628:1869355232894464:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759469.460266:0:82628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759469.460321:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218501888 00000100:00100000:0.0:1782759469.460328:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218501888 00010000:00010000:0.0:1782759469.460368:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 6 pid: 8600 timeout: 3609 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759469.460402:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759469.460436:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 780 00000100:00100000:0.0:1782759469.460456:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218501888:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759469.460469:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759469.460475:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 6 pid: 8600 timeout: 3609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.460501:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 6 pid: 8600 timeout: 3609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.460520:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000728ee717/0xd5b45c7f5c60c5d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272f8 expref: 6 pid: 8600 timeout: 3609 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.460533:0:9534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759469.460537:0:9534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759469.460542:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.460551:0:9534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.460596:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759469.460646:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218501888:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 201us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759469.460654:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 780 00010000:00010000:2.0:1782759469.460695:0:82628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.460707:0:82628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.460717:0:82628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.460725:0:82628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.460744:0:82628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759469.460867:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759469.460875:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.460884:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759469.460888:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.460898:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.460937:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.460945:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493cece1/0xd5b45c7f5c60c636 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.460962:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759469.460965:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759469.460967:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759469.461135:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232894336:12345-0@lo:6:osp-syn-1-1.0 Request processed in 3480us (3592us total) trans 4294967405 rc 0/0 00000100:00100000:2.0:1782759469.461144:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000004:00080000:0.0:1782759469.461166:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc26c5500/2, rc 0, transno 4294967405 00000100:00100000:0.0:1782759469.461174:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232894336:0@lo:6:osp-syn-1-1.0 10000000:01000000:1.0:1782759469.642679:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759469.642686:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759469.642690:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759469.642731:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.642752:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759469.642763:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759469.642787:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232894592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759469.642856:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759469.642904:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759469.642916:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894592 00000100:00100000:0.0:1782759469.642936:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894592 00000100:00100000:0.0:1782759469.642990:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193 00000100:00100000:0.0:1782759469.643001:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232894592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759469.643038:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759469.643054:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c63d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.643077:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.643088:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759469.643097:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:0.0:1782759469.643144:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232894592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759469.643152:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193 00000100:00100000:2.0:1782759469.643172:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232894592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759469.643200:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.643211:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759469.643234:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759469.643240:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759469.643248:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759469.962791:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232894720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759469.962884:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759469.962967:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894720 00000100:00100000:3.0:1782759469.962975:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894720 00000100:00100000:3.0:1782759469.963058:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3181 00000100:00100000:3.0:1782759469.963071:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232894720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759469.963102:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:3.0:1782759469.963170:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232894720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759469.963178:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3181 00000100:00100000:2.0:1782759469.963213:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232894720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759470.236082:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759470.236126:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218502144 00000100:00100000:1.0:1782759470.236136:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218502144 00000100:00100000:1.0:1782759470.236201:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2822 00000100:00100000:1.0:1782759470.236236:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:106229:x1869355218502144:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759470.236256:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759470.236280:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c64b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb272ff expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236382:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236396:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236408:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236424:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236430:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236437:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759470.236820:0:42628:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x15:0x0], index 0: 0 00010000:00010000:1.0:1782759470.236982:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c660 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236989:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.236995:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c660 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237029:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237034:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237038:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237042:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237046:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759470.237049:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237054:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237062:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759470.237064:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759470.237067:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237071:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c652 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759470.237080:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000662ac816 reply state 000000002bc054b0 transno 4294967685 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237088:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237096:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:1.0:1782759470.237098:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759470.237100:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759470.237121:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c64b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ff expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237134:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c660 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ff expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.237139:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cded88bf500) 00010000:00010000:1.0:1782759470.237140:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759470.237141:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759470.237191:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:106229:x1869355218502144:12345-192.168.202.31@tcp:101:touch.0 Request processed in 962us (1120us total) trans 4294967685 rc 0/0 00000100:00100000:1.0:1782759470.237196:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2822 00000100:00080000:1.0:1782759470.237216:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759470.245146:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759470.245234:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218502400 00000100:00100000:0.0:1782759470.245242:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218502400 00000100:00100000:0.0:1782759470.245291:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2823 00000100:00100000:0.0:1782759470.245304:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:106229:x1869355218502400:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:0.0:1782759470.245359:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759470.245388:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c660 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb272ff expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.245406:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cded88bf500) 00010000:00010000:0.0:1782759470.245419:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759470.245474:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.245488:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.245505:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759470.245643:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c27bd405 reply state 000000000878df30 transno 4294967686 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.245658:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.245665:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759470.245668:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759470.245670:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759470.245750:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:106229:x1869355218502400:12345-192.168.202.31@tcp:36:touch.0 Request processed in 448us (610us total) trans 4294967686 rc 0/0 00000100:00100000:0.0:1782759470.245758:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2823 00000100:00100000:3.0:1782759470.250562:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759470.250666:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218502528 00000100:00100000:0.0:1782759470.250677:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218502528 00000100:00100000:0.0:1782759470.250728:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2824 00000100:00100000:0.0:1782759470.250737:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:106229:x1869355218502528:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759470.250760:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759470.250778:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c675 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27306 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.250826:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c675 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27306 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.250840:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c675 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27306 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.250870:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759470.250873:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759470.250875:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759470.250936:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106229:x1869355218502528:12345-192.168.202.31@tcp:101:touch.0 Request processed in 200us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759470.250943:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2824 00000100:00100000:0.0:1782759470.252758:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759470.252794:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218502656 00000100:00100000:1.0:1782759470.252801:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218502656 00000100:00080000:3.0:1782759470.252847:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759470.252855:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1066 00000100:00100000:1.0:1782759470.252864:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218502656:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:1.0:1782759470.253082:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218502656:12345-192.168.202.31@tcp:2:touch.0 Request processed in 219us (342us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1782759470.253088:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1066 00000100:00100000:3.0:1782759470.255095:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759470.255162:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218502912 00000100:00100000:0.0:1782759470.255172:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218502912 00000100:00100000:0.0:1782759470.255221:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 322 00000100:00100000:0.0:1782759470.255227:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106229:x1869355218502912:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:0.0:1782759470.255454:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:106229:x1869355218502912:12345-192.168.202.31@tcp:35:touch.0 Request processed in 226us (366us total) trans 4294967687 rc 0/0 00000100:00100000:0.0:1782759470.255459:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 322 00000100:00100000:3.0:1782759470.266350:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759470.266463:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218503040 00000100:00100000:1.0:1782759470.266473:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218503040 00000100:00100000:1.0:1782759470.266556:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2825 00000100:00100000:1.0:1782759470.266634:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:106230:x1869355218503040:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759470.266736:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759470.266758:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c67c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2730d expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267149:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267164:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267176:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267363:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267374:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267381:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267448:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267457:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267464:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759470.267504:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x19:0x0]: returning size 0 00000004:00200000:1.0:1782759470.267515:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759470.267540:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267551:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267561:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267568:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267574:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267603:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267609:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759470.267614:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267621:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267635:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759470.267638:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759470.267643:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267650:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c683 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267678:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267685:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267691:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267696:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759470.267699:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267705:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267714:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:1.0:1782759470.267716:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759470.267719:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267725:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c68a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267751:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c67c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2730d expref: 13 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267768:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2730d expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.267786:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:1.0:1782759470.267788:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759470.267790:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759470.267990:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:106230:x1869355218503040:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1420us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759470.267999:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2825 00000100:00100000:2.0:1782759470.302061:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759470.302114:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759470.302158:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759470.302203:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218503424 00000100:00100000:0.0:1782759470.302212:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218503424 00000100:00100000:0.0:1782759470.302263:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2864 00000100:00100000:0.0:1782759470.302271:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218503424:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759470.302343:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218503424:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759470.302349:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2864 00000100:00100000:1.0:1782759470.302955:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218503296 00000100:00100000:1.0:1782759470.302959:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218503296 00000100:00100000:1.0:1782759470.303024:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4985 00000100:00080000:2.0:1782759470.303032:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759470.303034:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218503296:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759470.303072:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218503296:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759470.303077:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4985 00000100:00100000:3.0:1782759470.303710:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218503168 00000100:00100000:3.0:1782759470.303715:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218503168 00000100:00100000:3.0:1782759470.303771:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3194 00000100:00100000:3.0:1782759470.303780:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218503168:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759470.303814:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218503168:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759470.303821:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3194 00010000:00010000:2.0:1782759470.410809:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759470.476754:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232894848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759470.476825:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759470.476869:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894848 00000100:00100000:2.0:1782759470.476877:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894848 00000100:00080000:3.0:1782759470.477258:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759470.477292:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1782759470.477418:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232894848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759470.477448:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759470.477455:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759470.477466:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232894976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759470.477502:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232894848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 199us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759470.477504:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759470.477514:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1782759470.477534:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232894976 00000100:00100000:3.0:1782759470.477538:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232894976 00000100:00100000:1.0:1782759470.477553:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232894848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759470.477605:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:1.0:1782759470.477614:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232894976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759470.477625:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1782759470.477655:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759470.477669:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232894976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759470.477683:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1782759470.477709:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232894976:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759470.676163:0:145068:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff0bd6ab0 20000000:00000080:0.0:1782759470.676180:0:145068:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3f3d400 uarg=0000000000000000 00010000:00010000:0.0:1782759470.676359:0:145068:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782759470.676399:0:145068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759470.676403:0:145068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759470.676881:0:145068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c675 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27306 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.676904:0:145068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759470.676908:0:145068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759470.676924:0:145068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c691 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2730d expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.676938:0:145068:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1782759470.676969:0:145068:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759470.676981:0:145068:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759470.677001:0:145068:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759470.677013:0:145068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.677024:0:145068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.677032:0:145068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.677066:0:145068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.677079:0:145068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 23 pid: 6525 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759470.677092:0:145068:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145068:1869355232895104:0@lo:104: 00000100:00100000:0.0:1782759470.677154:0:145068:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759470.677214:0:145068:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759470.677216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895104 00000100:00100000:3.0:1782759470.677225:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895104 00000100:00100000:3.0:1782759470.677268:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1782759470.677276:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:145068:x1869355232895104:12345-0@lo:104: 00010000:00010000:3.0:1782759470.677287:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677358:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759470.677365:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:145068:x1869355232895104:12345-0@lo:104: Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759470.677373:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1782759470.677377:0:145068:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145068:1869355232895104:0@lo:104: 00010000:00010000:1.0:1782759470.677385:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759470.677395:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759470.677398:0:145068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.677408:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759470.677412:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.677419:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759470.677425:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759470.677429:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759470.677457:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.677461:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759470.677496:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759470.677504:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428e00/0xd5b45c7f5c60c63d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c644 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759470.677508:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232895232:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759470.677523:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759470.677526:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759470.677529:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759470.677542:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759470.677596:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895232 00000100:00100000:3.0:1782759470.677600:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895232 00010000:00010000:3.0:1782759470.677624:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 24 pid: 6525 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759470.677651:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:3.0:1782759470.677659:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232895232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759470.677670:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759470.677675:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 24 pid: 6525 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677686:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 24 pid: 6525 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677698:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c644 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c63d expref: 24 pid: 6525 timeout: 3660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677710:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677719:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677732:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677738:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677742:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677746:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677755:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759470.677758:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677763:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677777:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759470.677785:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759470.677808:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232895232:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759470.677814:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1782759470.677817:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232895232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759470.677863:0:145068:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759470.677881:0:145068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759470.677888:0:145068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c698 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759471.434683:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759472.042141:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.042263:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218503552 00000100:00100000:1.0:1782759472.042273:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218503552 00000100:00100000:1.0:1782759472.042333:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2826 00000100:00100000:1.0:1782759472.042344:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106305:x1869355218503552:12345-192.168.202.31@tcp:53:lfs.0 00000004:00000080:1.0:1782759472.042377:0:6531:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x240000405:0x19:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782759472.042482:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106305:x1869355218503552:12345-192.168.202.31@tcp:53:lfs.0 Request processed in 141us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759472.042488:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2826 00000100:00080000:3.0:1782759472.042624:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759472.045436:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.045791:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218503808 00000100:00100000:1.0:1782759472.045801:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218503808 00000100:00100000:1.0:1782759472.045871:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2827 00000100:00100000:1.0:1782759472.045882:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:105491:x1869355218503808:12345-192.168.202.31@tcp:101:bash.0 00000100:00080000:3.0:1782759472.045999:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759472.046032:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759472.046055:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c69f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27314 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759472.046155:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1782759472.046275:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c69f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27314 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.046292:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cded88bfd00) 00010000:00010000:1.0:1782759472.046307:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759472.046313:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c69f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27314 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.046327:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759472.046386:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105491:x1869355218503808:12345-192.168.202.31@tcp:101:bash.0 Request processed in 507us (962us total) trans 4294967969 rc 301/301 00000100:00100000:1.0:1782759472.046397:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2827 00000100:00100000:1.0:1782759472.049699:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759472.049747:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218504064 00000100:00100000:3.0:1782759472.049758:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218504064 00000100:00100000:3.0:1782759472.049865:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 323 00000100:00100000:3.0:1782759472.049877:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:105491:x1869355218504064:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1782759472.050116:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218504064:12345-192.168.202.31@tcp:35:bash.0 Request processed in 241us (424us total) trans 4294967970 rc 0/0 00000100:00100000:3.0:1782759472.050125:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 323 00000100:00100000:3.0:1782759472.057765:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759472.058363:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218504320 00000100:00100000:0.0:1782759472.058374:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218504320 00000100:00100000:0.0:1782759472.058516:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2828 00000100:00100000:0.0:1782759472.058527:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:106306:x1869355218504320:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:0.0:1782759472.058549:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759472.058608:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c6ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2731b expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.058992:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c6b4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.059008:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.059021:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c6b4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759472.059033:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x19:0x0]: returning size 0 00010000:00010000:0.0:1782759472.059138:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c6ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2731b expref: 13 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.059163:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c6b4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2731b expref: 12 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.059171:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759472.059174:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759472.059178:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759472.060700:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:106306:x1869355218504320:12345-192.168.202.31@tcp:101:cat.0 Request processed in 2165us (2933us total) trans 4294967688 rc 0/0 00000100:00100000:0.0:1782759472.060712:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2828 00000100:00100000:1.0:1782759472.065804:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.065874:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759472.067343:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218504576 00000100:00100000:2.0:1782759472.067355:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218504576 00000100:00100000:2.0:1782759472.067435:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1067 00000100:00100000:2.0:1782759472.067451:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218504576:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:2.0:1782759472.067470:0:82628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759472.067491:0:82628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27322 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759472.067516:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x6a42c02f, atime: 0x6a42c02f, ctime: 0x6a42c02f, blocks: 0x0 00010000:00010000:2.0:1782759472.067536:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=3512s v=(0 0) 00010000:00010000:2.0:1782759472.067540:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759472.067549:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.067567:0:82628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759472.067754:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759472.067962:0:82628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759472.068036:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218504576:12345-192.168.202.31@tcp:101:cat.0 Request processed in 591us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759472.068053:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1067 00000100:00100000:2.0:1782759472.068077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218504448 00000100:00100000:2.0:1782759472.068082:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218504448 00000100:00100000:2.0:1782759472.068116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 392 00000100:00100000:2.0:1782759472.068123:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2404:x1869355218504448:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759472.068134:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759472.068157:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c6b4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2731b expref: 12 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.068172:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:2.0:1782759472.068177:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759472.069316:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:2404:x1869355218504448:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1185us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759472.069328:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 392 10000000:01000000:1.0:1782759472.077219:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759472.077227:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759472.077231:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759472.077284:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.077296:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.077308:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759472.077333:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232895360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759472.077523:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759472.077651:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895360 00000100:00100000:0.0:1782759472.077658:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895360 00000100:00100000:1.0:1782759472.078796:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759472.078865:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759472.078928:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218504704 00000100:00100000:3.0:1782759472.078950:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218504704 00000100:00100000:0.0:1782759472.079000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:0.0:1782759472.079012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232895360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759472.079031:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759472.079053:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c6c9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1782759472.079074:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff8cddc4ddbb80 x1869355218504704/t0(0) o3->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:633/0 lens 488/0 e 0 to 0 dl 1782759483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1782759472.079083:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1782759472.079093:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cddc4ddbb80 with x1869355218504704 ext(0->4095) 00002000:00010000:3.0:1782759472.079101:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cddc4ddbb80 00010000:00010000:0.0:1782759472.079102:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.079114:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:3.0:1782759472.079130:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 46 00000100:00100000:3.0:1782759472.079139:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218504704:12345-192.168.202.31@tcp:3:cat.0 00000100:00100000:0.0:1782759472.079173:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232895360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759472.079190:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00100000:1.0:1782759472.079265:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232895360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759472.079282:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.079292:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759472.079312:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759472.079324:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.079332:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759472.079440:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218504704:12345-192.168.202.31@tcp:3:cat.0 Request processed in 301us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759472.079447:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 46 00002000:00100000:3.0:1782759472.079454:0:8451:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000400:0x15:0x0] (0->4095) req@ffff8cddc4ddbb80 x1869355218504704/t0(0) o3->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:633/0 lens 488/440 e 0 to 0 dl 1782759483 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782759472.079461:0:8451:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cddc4ddbb80 with x1869355218504704 ext(0->4095) 00002000:00010000:3.0:1782759472.079465:0:8451:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cddc4ddbb80 00000100:00100000:0.0:1782759472.084072:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.084146:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218504960 00000100:00100000:1.0:1782759472.084156:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218504960 00000100:00100000:1.0:1782759472.084238:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 324 00000100:00100000:1.0:1782759472.084249:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:106306:x1869355218504960:12345-192.168.202.31@tcp:35:cat.0 00000100:00100000:1.0:1782759472.084478:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:106306:x1869355218504960:12345-192.168.202.31@tcp:35:cat.0 Request processed in 231us (413us total) trans 4294967689 rc 0/0 00000100:00100000:1.0:1782759472.084486:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 324 00000100:00100000:0.0:1782759472.095949:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.096069:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218505088 00000100:00100000:1.0:1782759472.096081:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218505088 00000100:00100000:1.0:1782759472.096148:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2829 00000100:00100000:1.0:1782759472.096159:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:106307:x1869355218505088:12345-192.168.202.31@tcp:62:lfs.0 00010000:00010000:1.0:1782759472.096286:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096305:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096318:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096330:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096357:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096364:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096442:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096460:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096467:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759472.096704:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00000004:00080000:1.0:1782759472.096715:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3512373136859ns, next at 3513373134262ns, rc = 0 00010000:00010000:1.0:1782759472.096767:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096774:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096782:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096788:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759472.096792:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096800:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096819:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:1.0:1782759472.096822:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782759472.096827:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096833:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c6e5 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096847:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096859:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096865:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096870:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096875:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759472.096878:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096888:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096895:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cded88bf600) 00010000:00010000:1.0:1782759472.096906:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759472.096909:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096925:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c6d7 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096938:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096944:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096950:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096955:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759472.096958:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096964:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096972:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:1.0:1782759472.096974:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759472.096977:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 2/0,0 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.096983:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c6de lrc: 0/0,0 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759472.097052:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:106307:x1869355218505088:12345-192.168.202.31@tcp:62:lfs.0 Request processed in 894us (1111us total) trans 4294967690 rc 0/0 00000100:00100000:1.0:1782759472.097060:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2829 00000100:00100000:2.0:1782759472.104675:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759472.104727:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218505344 00000100:00100000:0.0:1782759472.104737:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218505344 00000100:00100000:0.0:1782759472.104787:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2830 00000100:00100000:0.0:1782759472.104794:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:106308:x1869355218505344:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759472.104815:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759472.104835:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c6ec lrc: 2/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27329 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.105001:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c6ec lrc: 1/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27329 expref: 14 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.105071:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc3502b00) 00010000:00010000:0.0:1782759472.105073:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759472.105077:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c6ec lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27329 expref: 14 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.105092:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759472.105162:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:106308:x1869355218505344:12345-192.168.202.31@tcp:101:touch.0 Request processed in 367us (495us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759472.105170:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2830 00000100:00100000:0.0:1782759472.106703:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759472.106745:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218505600 00000100:00100000:3.0:1782759472.106753:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218505600 00000100:00100000:3.0:1782759472.106799:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2831 00000100:00100000:3.0:1782759472.106807:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:106308:x1869355218505600:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759472.106822:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759472.106838:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c6f3 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27330 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.106936:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 3/0,1 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.106950:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.106978:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.106987:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.106993:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.106997:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759472.107618:0:12673:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x15:0x0], index 1: 0 00010000:00010000:3.0:1782759472.107751:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c708 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107762:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c708 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107771:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c708 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107801:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107807:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107811:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107815:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107827:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759472.107831:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107836:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107846:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:3.0:1782759472.107850:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759472.107854:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 3/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107861:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c6fa lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759472.107874:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000867ea353 reply state 000000002918948b transno 4294967691 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107885:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107892:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:3.0:1782759472.107894:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759472.107906:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759472.107937:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c6f3 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27330 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107956:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c708 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27330 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.107974:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc34f4a00) 00010000:00010000:3.0:1782759472.107976:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759472.107979:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759472.108045:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:106308:x1869355218505600:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1238us (1349us total) trans 4294967691 rc 0/0 00000100:00100000:3.0:1782759472.108052:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2831 00000100:00100000:3.0:1782759472.110796:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759472.110884:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218505856 00000100:00100000:0.0:1782759472.110894:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218505856 00000100:00100000:0.0:1782759472.110973:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2832 00000100:00100000:0.0:1782759472.110982:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:106308:x1869355218505856:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:0.0:1782759472.111056:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759472.111084:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60c708 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27330 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.111102:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc34f4a00) 00010000:00010000:0.0:1782759472.111112:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759472.111164:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.111178:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.111187:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759472.111286:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000501fc1c0 reply state 000000001202e238 transno 4294967692 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.111299:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.111306:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:0.0:1782759472.111309:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759472.111312:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759472.111429:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:106308:x1869355218505856:12345-192.168.202.31@tcp:36:touch.0 Request processed in 448us (643us total) trans 4294967692 rc 0/0 00000100:00100000:0.0:1782759472.111436:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2832 00000100:00100000:2.0:1782759472.114458:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.114527:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218505984 00000100:00100000:1.0:1782759472.114535:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218505984 00000100:00100000:1.0:1782759472.114600:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2833 00000100:00100000:1.0:1782759472.114612:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:106308:x1869355218505984:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759472.114637:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759472.114664:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c71d lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27337 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.114721:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c71d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27337 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.114735:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c71d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27337 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.114754:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:1.0:1782759472.114756:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759472.114759:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759472.114809:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106308:x1869355218505984:12345-192.168.202.31@tcp:101:touch.0 Request processed in 201us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759472.114815:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2833 00000100:00100000:3.0:1782759472.118402:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759472.118475:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218506112 00000100:00100000:1.0:1782759472.118485:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218506112 00000100:00100000:1.0:1782759472.118563:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1068 00000100:00100000:1.0:1782759472.118602:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218506112:12345-192.168.202.31@tcp:2:touch.0 00000100:00080000:0.0:1782759472.118805:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759472.118858:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218506112:12345-192.168.202.31@tcp:2:touch.0 Request processed in 285us (473us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1782759472.118867:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1068 00000100:00100000:3.0:1782759472.123755:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759472.123820:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218506368 00000100:00100000:2.0:1782759472.123829:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218506368 00000100:00100000:2.0:1782759472.123961:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 325 00000100:00100000:2.0:1782759472.123974:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106308:x1869355218506368:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:2.0:1782759472.124285:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:106308:x1869355218506368:12345-192.168.202.31@tcp:35:touch.0 Request processed in 314us (538us total) trans 4294967693 rc 0/0 00000100:00100000:2.0:1782759472.124294:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 325 00000100:00100000:2.0:1782759472.133452:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759472.133526:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218506496 00000100:00100000:0.0:1782759472.133536:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218506496 00000100:00100000:0.0:1782759472.133616:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2834 00000100:00100000:0.0:1782759472.133626:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:106309:x1869355218506496:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759472.133649:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759472.133673:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c724 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2733e expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133759:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133774:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133787:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133798:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133806:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133818:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133924:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133933:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.133956:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759472.134012:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1782759472.134017:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759472.134038:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134049:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134058:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134064:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134085:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134092:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134097:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759472.134101:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134108:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134118:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc3502b00) 00010000:00010000:0.0:1782759472.134127:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759472.134131:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134138:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c72b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134152:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134157:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134163:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134167:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759472.134169:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134175:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134182:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:0.0:1782759472.134184:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759472.134187:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134193:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c732 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134217:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c724 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2733e expref: 21 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134239:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2733e expref: 20 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759472.134246:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:0.0:1782759472.134249:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759472.134251:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:0.0:1782759472.134309:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:106309:x1869355218506496:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 684us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759472.134316:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2834 00010000:00010000:2.0:1782759472.458875:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759472.535953:0:145263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc23982c0 20000000:00000080:2.0:1782759472.535971:0:145263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf851400 uarg=0000000000000000 00010000:00010000:2.0:1782759472.536134:0:145263:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759472.536160:0:145263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:2.0:1782759472.536163:0:145263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759472.536171:0:145263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c71d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27337 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.536184:0:145263:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:2.0:1782759472.536186:0:145263:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759472.536188:0:145263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c739 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2733e expref: 18 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.536196:0:145263:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1782759472.536217:0:145263:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759472.536230:0:145263:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759472.536251:0:145263:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759472.536263:0:145263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.536273:0:145263:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.536279:0:145263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.536307:0:145263:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.536317:0:145263:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 23 pid: 6525 timeout: 3662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759472.536332:0:145263:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145263:1869355232895488:0@lo:104: 00000100:00100000:2.0:1782759472.536379:0:145263:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759472.536449:0:145263:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec3932840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759472.536463:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895488 00000100:00100000:3.0:1782759472.536470:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895488 00000100:00100000:3.0:1782759472.536515:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1782759472.536526:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:145263:x1869355232895488:12345-0@lo:104: 00010000:00010000:3.0:1782759472.536538:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.536616:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759472.536624:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:145263:x1869355232895488:12345-0@lo:104: Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759472.536631:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1782759472.536636:0:145263:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145263:1869355232895488:0@lo:104: 00010000:00010000:2.0:1782759472.536661:0:145263:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.536676:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759472.536684:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.536693:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759472.536697:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.536705:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759472.536712:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759472.536718:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759472.536751:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.536757:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759472.536799:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232895616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759472.536842:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759472.536877:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895616 00000100:00100000:3.0:1782759472.536882:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895616 00010000:00010000:1.0:1782759472.536902:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.536909:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 24 pid: 6525 timeout: 3662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.536914:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429800/0xd5b45c7f5c60c6c9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c6d0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759472.536927:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759472.536929:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759472.536930:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759472.536943:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:3.0:1782759472.536951:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec77e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232895616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759472.536969:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759472.536975:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 24 pid: 6525 timeout: 3662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.536984:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 24 pid: 6525 timeout: 3662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.536994:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c6d0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c6c9 expref: 24 pid: 6525 timeout: 3662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537005:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537013:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537025:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537032:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537038:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537044:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537049:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759472.537066:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537083:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537095:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759472.537101:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759472.537124:0:145263:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759472.537132:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec77e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232895616:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (289us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759472.537139:0:145263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759472.537155:0:145263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649400/0xd5b45c7f5c60c740 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759472.537156:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:0.0:1782759472.537206:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232895616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759473.034819:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232895744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759473.034925:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759473.035079:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895744 00000100:00100000:0.0:1782759473.035088:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895744 00000100:00100000:0.0:1782759473.035207:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3182 00000100:00100000:0.0:1782759473.035220:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232895744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759473.036972:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:0.0:1782759473.037074:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232895744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1855us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759473.037085:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3182 00000100:00100000:1.0:1782759473.037395:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967966 gen 2 00000004:00080000:1.0:1782759473.037401:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967966 committed transno 4294967966 00000100:00100000:1.0:1782759473.037428:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232895744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759473.482870:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759473.611679:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759473.611686:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759473.611691:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759473.611734:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.611745:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.611756:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759473.611780:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232895872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759473.611851:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759473.611939:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759473.611982:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232895872 00000100:00100000:3.0:1782759473.611993:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232895872 00000100:00100000:3.0:1782759473.612051:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:3.0:1782759473.612061:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232895872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759473.612078:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759473.612092:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c747 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.612114:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.612125:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.612133:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759473.612178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232895872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759473.612186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:2.0:1782759473.612211:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232895872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759473.612225:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.612233:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759473.612248:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759473.612251:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759473.612256:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759473.773515:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759473.773560:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218506624 00000100:00100000:1.0:1782759473.773571:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218506624 00000100:00100000:2.0:1782759473.773649:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2835 00000100:00100000:2.0:1782759473.773677:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106382:x1869355218506624:12345-192.168.202.31@tcp:53:lfs.0 00000004:00000080:2.0:1782759473.773703:0:6532:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x240000405:0x1a:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782759473.773791:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106382:x1869355218506624:12345-192.168.202.31@tcp:53:lfs.0 Request processed in 121us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759473.773796:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2835 00000100:00100000:3.0:1782759473.777778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759473.777891:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218506880 00000100:00100000:0.0:1782759473.777901:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218506880 00000100:00100000:0.0:1782759473.777953:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2836 00000100:00100000:0.0:1782759473.777963:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:105491:x1869355218506880:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1782759473.777996:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759473.778019:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c755 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27345 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759473.778113:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1782759473.778209:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c755 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27345 expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759473.778225:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cddc3502900) 00010000:00010000:0.0:1782759473.778229:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759473.778234:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c755 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27345 expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759473.778249:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc000, rc 0) 00000100:00100000:0.0:1782759473.778347:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:105491:x1869355218506880:12345-192.168.202.31@tcp:101:bash.0 Request processed in 385us (577us total) trans 4294967971 rc 301/301 00000100:00100000:0.0:1782759473.778355:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2836 00000100:00100000:1.0:1782759473.779845:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759473.779916:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218507136 00000100:00100000:3.0:1782759473.779924:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218507136 00000100:00100000:3.0:1782759473.780108:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 326 00000100:00100000:3.0:1782759473.780119:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9346050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:105491:x1869355218507136:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1782759473.780280:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9346050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:105491:x1869355218507136:12345-192.168.202.31@tcp:35:bash.0 Request processed in 163us (439us total) trans 4294967972 rc 0/0 00000100:00100000:3.0:1782759473.780288:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 326 00000100:00100000:3.0:1782759473.787807:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759473.787835:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218507392 00000100:00100000:3.0:1782759473.787843:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218507392 00000100:00100000:3.0:1782759473.787899:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2837 00000100:00100000:3.0:1782759473.787911:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106383:x1869355218507392:12345-192.168.202.31@tcp:101:cat.0 00010000:00010000:3.0:1782759473.787930:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759473.787949:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c763 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2734c expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.788003:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c763 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2734c expref: 19 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.788013:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cddc34f4500) 00010000:00010000:3.0:1782759473.788015:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759473.788018:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c763 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2734c expref: 19 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759473.788030:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759473.788089:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106383:x1869355218507392:12345-192.168.202.31@tcp:101:cat.0 Request processed in 181us (291us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759473.788095:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2837 00000100:00100000:2.0:1782759473.799534:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759473.799892:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218507520 00000100:00100000:1.0:1782759473.799901:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218507520 00000100:00100000:1.0:1782759473.799955:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2838 00000100:00100000:1.0:1782759473.799967:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106384:x1869355218507520:12345-192.168.202.31@tcp:62:lfs.0 00000100:00100000:1.0:1782759473.800076:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:106384:x1869355218507520:12345-192.168.202.31@tcp:62:lfs.0 Request processed in 111us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759473.800083:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2838 00000100:00100000:3.0:1782759474.058825:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232896000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.058915:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759474.058977:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232896512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.059013:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759474.059044:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232897024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.059070:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759474.059088:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782759474.059094:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232896384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.059117:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759474.059145:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232896896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.059145:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232896128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.059211:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232896256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.059399:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897024 00000100:00100000:1.0:1782759474.059407:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897024 00000100:00100000:1.0:1782759474.059457:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:3.0:1782759474.059461:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.059471:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232897024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.059489:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232897536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.059526:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.059533:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232897024:12345-0@lo:400:kworker.0 Request processed in 64us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759474.059541:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:2.0:1782759474.059557:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759474.059561:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232897024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.059613:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232896640:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.059619:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896896 00000100:00100000:1.0:1782759474.059624:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896896 00000100:00100000:1.0:1782759474.059642:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897536 00000100:00100000:1.0:1782759474.059646:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897536 00000100:00100000:2.0:1782759474.059656:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.059664:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1782759474.059672:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232896896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.059681:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232897152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.059711:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232896896:12345-0@lo:400:kworker.0 Request processed in 39us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759474.059716:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.059735:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:2.0:1782759474.059742:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232897664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759474.059755:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:1.0:1782759474.059763:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232897536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.059771:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.059806:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232897536:12345-0@lo:400:kworker.0 Request processed in 43us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759474.059813:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00100000:3.0:1782759474.059824:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232897536:0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.059831:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897664 00000100:00100000:2.0:1782759474.059834:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897664 00000100:00100000:3.0:1782759474.059836:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232896896:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.059845:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896512 00000100:00100000:3.0:1782759474.059851:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759474.059851:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896512 00000100:00100000:3.0:1782759474.059860:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232897408:0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.059871:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1782759474.059889:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232897664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759474.059893:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.059908:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183 00002000:00000024:2.0:1782759474.059911:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759474.059919:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232896512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.059924:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897408 00000100:00100000:3.0:1782759474.059928:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897408 00000100:00100000:2.0:1782759474.059954:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232897664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759474.059961:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1782759474.059966:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1782759474.059977:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232896512:12345-0@lo:400:kworker.0 Request processed in 58us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759474.059978:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232897408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.059991:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183 00000100:00100000:2.0:1782759474.060008:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232897664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759474.060016:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896000 00000100:00100000:1.0:1782759474.060021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896000 00000100:00100000:3.0:1782759474.060026:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232897408:12345-0@lo:400:kworker.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759474.060045:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:2.0:1782759474.060053:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896384 00000100:00100000:1.0:1782759474.060054:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1782759474.060060:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896384 00000100:00100000:3.0:1782759474.060067:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896128 00000100:00100000:1.0:1782759474.060067:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232896000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.060071:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896128 00000100:00100000:2.0:1782759474.060089:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896640 00000100:00100000:2.0:1782759474.060092:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896640 00000100:00100000:3.0:1782759474.060093:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897152 00000100:00100000:3.0:1782759474.060095:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897152 00000100:00100000:1.0:1782759474.060111:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232896000:12345-0@lo:400:kworker.0 Request processed in 46us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759474.060112:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4986 00000100:00100000:3.0:1782759474.060120:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4987 00000100:00100000:1.0:1782759474.060124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1782759474.060125:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232896384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.060128:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232896128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.060181:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988 00000100:00100000:3.0:1782759474.060186:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232896128:12345-0@lo:400:kworker.0 Request processed in 57us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759474.060193:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232896640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.060196:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4987 00000100:00100000:3.0:1782759474.060216:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989 00000100:00100000:3.0:1782759474.060225:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232897152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.060233:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232896640:12345-0@lo:400:kworker.0 Request processed in 42us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759474.060241:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988 00000100:00100000:3.0:1782759474.060263:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232897152:12345-0@lo:400:kworker.0 Request processed in 39us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759474.060270:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989 00000100:00080000:1.0:1782759474.060276:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759474.060282:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759474.060285:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759474.060318:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232897408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.060331:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232896128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.060335:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232896384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.060352:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232896640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.060356:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232896512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.060370:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232897152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759474.060373:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232896000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.061008:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759474.061030:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232896768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.061062:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759474.061090:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232897280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.061108:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759474.061134:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896768 00000100:00100000:0.0:1782759474.061138:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896768 00000100:00100000:0.0:1782759474.061167:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897280 00000100:00100000:0.0:1782759474.061178:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897280 00000100:00100000:0.0:1782759474.061200:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4990 00000100:00100000:0.0:1782759474.061205:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232896768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.061238:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232896768:12345-0@lo:400:kworker.0 Request processed in 32us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759474.061243:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4990 00000100:00100000:0.0:1782759474.061255:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991 00000100:00100000:0.0:1782759474.061260:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232897280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.061284:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232897280:12345-0@lo:400:kworker.0 Request processed in 24us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759474.061289:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991 00000100:00080000:0.0:1782759474.061306:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759474.061321:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232896768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759474.061330:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232897280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759474.061689:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232896384:12345-0@lo:400:kworker.0 Request processed in 1566us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759474.061696:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4986 00000100:00100000:1.0:1782759474.062127:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232896256 00000100:00100000:1.0:1782759474.062133:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232896256 00000100:00100000:1.0:1782759474.062277:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1782759474.062286:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232896256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759474.062336:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232896256:12345-0@lo:400:kworker.0 Request processed in 52us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759474.062342:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00100000:0.0:1782759474.063087:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232896256:0@lo:400:kworker.0 00010000:00010000:2.0:1782759474.507810:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759474.570721:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232897792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759474.570788:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759474.570848:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897792 00000100:00100000:1.0:1782759474.570857:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897792 00000100:00100000:1.0:1782759474.570925:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1782759474.570935:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232897792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759474.570958:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759474.571013:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232897792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759474.571021:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:0.0:1782759474.571043:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232897792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759475.082794:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759475.082818:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232897920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759475.082899:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759475.082945:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232897920 00000100:00100000:0.0:1782759475.082955:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232897920 00000100:00100000:0.0:1782759475.083016:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:0.0:1782759475.083024:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232897920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759475.083054:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:0.0:1782759475.083098:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232897920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759475.083110:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:1.0:1782759475.083147:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232897920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759475.429644:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759475.429690:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759475.429721:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218507648 00000100:00100000:1.0:1782759475.429742:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218507648 00000100:00100000:3.0:1782759475.429749:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759475.429765:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218507904 00000100:00100000:0.0:1782759475.429773:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218507904 00000100:00100000:3.0:1782759475.429787:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759475.429807:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3198 00000100:00100000:1.0:1782759475.429822:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218507648:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759475.429831:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218507776 00000100:00100000:0.0:1782759475.429835:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218507776 00000100:00100000:3.0:1782759475.429841:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759475.429841:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508160 00000100:00100000:2.0:1782759475.429848:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508160 00000100:00100000:0.0:1782759475.429867:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4992 00000100:00100000:3.0:1782759475.429901:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508032 00000100:00100000:3.0:1782759475.429907:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508032 00000100:00100000:2.0:1782759475.429912:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2869 00000100:00100000:1.0:1782759475.429919:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218507648:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759475.429929:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3198 00000100:00100000:0.0:1782759475.429952:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2404:x1869355218507904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759475.429959:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2870 00000100:00100000:3.0:1782759475.429971:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218508032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759475.429993:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2404:x1869355218507904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759475.429997:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 4993 00000100:00100000:0.0:1782759475.430010:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4992 00000100:00100000:3.0:1782759475.430014:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218508032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 42us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759475.430015:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218507776:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759475.430030:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2870 00000100:00080000:0.0:1782759475.430050:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759475.430055:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759475.430060:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218507776:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 48us (270us total) trans 0 rc 0/0 00000100:00080000:0.0:1782759475.430061:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759475.430065:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759475.430073:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 4993 00000100:00100000:2.0:1782759475.432431:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218508160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759475.432519:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218508160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2597us (2770us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759475.432531:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2869 00010000:00010000:1.0:1782759475.530655:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759475.595086:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232898048:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782759475.595148:0:8592:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3515871569421ns, next at 3516871566410ns, rc = 0 00000100:00100000:1.0:1782759475.595181:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759475.595229:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898048 00000100:00100000:3.0:1782759475.595235:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898048 00000100:00100000:3.0:1782759475.595273:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1782759475.595281:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232898048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759475.595305:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759475.595354:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232898048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759475.595362:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:3.0:1782759475.595394:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759475.595403:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232898176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759475.595430:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759475.595459:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898176 00000100:00100000:3.0:1782759475.595464:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898176 00000100:00100000:3.0:1782759475.595490:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:3.0:1782759475.595497:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232898176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759475.595507:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759475.595549:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232898176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759475.595556:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1782759475.595684:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232898176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759475.595943:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232898048:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1782759475.596712:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 89 committed 00000001:00080000:2.0:1782759475.596744:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967693 is committed 00000004:00080000:2.0:1782759475.596759:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 88 committed 00010000:00010000:0.0:1782759475.596788:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596801:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596809:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596815:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759475.596820:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596828:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596850:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:0.0:1782759475.596854:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759475.596859:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596866:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c659 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596896:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596902:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596908:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596913:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759475.596915:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596921:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596929:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x19:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759475.596931:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759475.596934:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596940:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c66e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596968:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596974:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596980:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596985:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759475.596988:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.596994:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597002:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x75c56fc0 (ffff8cded88bff00) 00010000:00010000:0.0:1782759475.597005:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759475.597008:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597021:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c701 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x16:0x0].0x75c56fc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597033:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597038:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597043:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597053:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759475.597056:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597063:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597071:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1a:0x0].0x0 (ffff8cddc3502d00) 00010000:00010000:0.0:1782759475.597073:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759475.597076:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.597080:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c716 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759475.598020:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232898304:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1782759475.598108:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759475.598164:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898304 00000100:00100000:1.0:1782759475.598171:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898304 00000100:00100000:1.0:1782759475.598222:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1782759475.598232:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232898304:12345-0@lo:6:osp-syn-0-1.0 00000001:00080000:3.0:1782759475.598239:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967412 is committed 00002000:00080000:1.0:1782759475.598258:0:8600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:21 count 1 00010000:00010000:1.0:1782759475.598287:0:8600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.598308:0:8600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 6 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.598328:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1782759475.598338:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759475.598344:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.598364:0:8600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 6 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.598374:0:8600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 6 pid: 82628 timeout: 3615 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759475.598386:0:8600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8600:1869355232898432:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759475.598438:0:8600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1f00 going to sleep for 11 seconds 00000001:00080000:2.0:1782759475.600052:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967406 is committed 00000001:00080000:2.0:1782759475.600063:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967405 is committed 00000100:00100000:1.0:1782759475.601154:0:8600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8600:1869355232898432:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759475.601182:0:8600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759475.601295:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759475.601337:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508288 00000100:00100000:1.0:1782759475.601343:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508288 00010000:00010000:1.0:1782759475.601373:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 7 pid: 82628 timeout: 3615 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759475.601404:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 783 00000100:00100000:1.0:1782759475.601414:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218508288:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759475.601437:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759475.601443:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 7 pid: 82628 timeout: 3615 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.601456:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 7 pid: 82628 timeout: 3615 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.601478:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008484acd4/0xd5b45c7f5c60c6c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27322 expref: 7 pid: 82628 timeout: 3615 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.601492:0:140594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759475.601496:0:140594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759475.601501:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.601519:0:140594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759475.601545:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759475.601615:0:8600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759475.601624:0:8600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759475.601631:0:8600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759475.601635:0:8600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759475.601660:0:8600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782759475.601697:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218508288:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 282us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759475.601706:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 783 00010000:00010000:0.0:1782759475.601725:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759475.601731:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.601738:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759475.601740:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.601746:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.601763:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.601768:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60c76a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759475.601788:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759475.601789:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759475.601790:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759475.602004:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232898304:12345-0@lo:6:osp-syn-0-1.0 Request processed in 3772us (3895us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1782759475.602012:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000004:00080000:0.0:1782759475.602311:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc3741500/2, rc 0, transno 4294967413 00000100:00100000:0.0:1782759475.602316:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232898304:0@lo:6:osp-syn-0-1.0 00000020:00000080:2.0:1782759476.369134:0:145605:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf7aab300 20000000:00000080:2.0:1782759476.369151:0:145605:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec77d7000 uarg=0000000000000000 00010000:00010000:2.0:1782759476.369318:0:145605:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759476.369333:0:145605:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759476.369359:0:145605:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759476.369369:0:145605:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759476.369389:0:145605:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759476.369405:0:145605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.369421:0:145605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.369430:0:145605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.369466:0:145605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.369489:0:145605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 23 pid: 6524 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759476.369504:0:145605:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145605:1869355232898560:0@lo:104: 00000100:00100000:2.0:1782759476.369562:0:145605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759476.369627:0:145605:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d08e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759476.369634:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898560 00000100:00100000:0.0:1782759476.369642:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898560 00000100:00100000:0.0:1782759476.369697:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1782759476.369708:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:145605:x1869355232898560:12345-0@lo:104: 00010000:00010000:0.0:1782759476.369732:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759476.369793:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759476.369799:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:145605:x1869355232898560:12345-0@lo:104: Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759476.369807:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00010000:00010000:1.0:1782759476.369815:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759476.369824:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.369834:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759476.369846:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759476.369856:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759476.369877:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759476.369883:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1782759476.370084:0:145605:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145605:1869355232898560:0@lo:104: 00010000:00010000:2.0:1782759476.370104:0:145605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759476.370295:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759476.370304:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759476.370342:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759476.370351:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60c747 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c74e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759476.370368:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232898688:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759476.370369:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759476.370373:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759476.370377:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759476.370405:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759476.370450:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898688 00000100:00100000:3.0:1782759476.370456:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898688 00010000:00010000:3.0:1782759476.370478:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 24 pid: 6524 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759476.370507:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:3.0:1782759476.370514:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232898688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759476.370524:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759476.370535:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 24 pid: 6524 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370545:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 24 pid: 6524 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370556:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c74e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c747 expref: 24 pid: 6524 timeout: 3666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370567:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370573:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370615:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370621:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370627:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370633:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370639:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759476.370642:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370649:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370670:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.370679:0:145605:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 2/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.370689:0:145605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759476.370695:0:145605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60c771 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759476.370707:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759476.370746:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232898688:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759476.370754:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:0.0:1782759476.370840:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232898688:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1782759476.371764:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967972 is committed 00010000:00010000:1.0:1782759476.554676:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759477.579172:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759477.707755:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759477.707763:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759477.707768:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759477.707808:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759477.707820:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759477.707831:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759477.707866:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232898816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759477.707928:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759477.707976:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759477.708001:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898816 00000100:00100000:3.0:1782759477.708010:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898816 00000100:00100000:3.0:1782759477.708066:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:3.0:1782759477.708076:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232898816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759477.708090:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759477.708106:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c778 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.708128:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.708138:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.708147:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:3.0:1782759477.708188:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232898816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759477.708195:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:3.0:1782759477.708245:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232898816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759477.708260:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.708276:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759477.708294:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759477.708299:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759477.708307:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759478.154869:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759478.154889:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232898944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759478.154958:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759478.155001:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232898944 00000100:00100000:0.0:1782759478.155016:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232898944 00000100:00100000:0.0:1782759478.155095:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:0.0:1782759478.155114:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232898944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759478.155153:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00000100:00100000:0.0:1782759478.155209:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232898944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759478.155218:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00100000:0.0:1782759478.155263:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232898944:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1782759478.570280:0:145850:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0d275d00 20000000:00000080:3.0:1782759478.570298:0:145850:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4790c00 uarg=0000000000000000 00010000:00010000:3.0:1782759478.570470:0:145850:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759478.570481:0:145850:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759478.570492:0:145850:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759478.570499:0:145850:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759478.570512:0:145850:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759478.570525:0:145850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759478.570538:0:145850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759478.570544:0:145850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759478.570607:0:145850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759478.570630:0:145850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 23 pid: 6524 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759478.570645:0:145850:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145850:1869355232899072:0@lo:104: 00000100:00100000:3.0:1782759478.570705:0:145850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759478.570819:0:145850:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759478.570860:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899072 00000100:00100000:2.0:1782759478.570865:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899072 00000100:00100000:2.0:1782759478.570949:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:2.0:1782759478.570960:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:145850:x1869355232899072:12345-0@lo:104: 00010000:00010000:2.0:1782759478.570972:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759478.571045:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759478.571052:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:145850:x1869355232899072:12345-0@lo:104: Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759478.571059:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00010000:0.0:1782759478.571088:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759478.571096:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571105:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759478.571109:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759478.571127:0:145850:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:145850:1869355232899072:0@lo:104: 00010000:00010000:0.0:1782759478.571132:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759478.571146:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759478.571152:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759478.571157:0:145850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571181:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571186:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759478.571207:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571212:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c778 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c77f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759478.571219:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1782759478.571225:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759478.571228:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759478.571230:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759478.571232:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232899200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759478.571256:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759478.571431:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899200 00000100:00100000:0.0:1782759478.571435:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899200 00010000:00010000:0.0:1782759478.571455:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 24 pid: 6524 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759478.571482:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1782759478.571489:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232899200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759478.571499:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759478.571504:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 24 pid: 6524 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571519:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 24 pid: 6524 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571531:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60c77f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c778 expref: 24 pid: 6524 timeout: 3668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571542:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571549:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571559:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571566:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571572:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571604:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571610:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759478.571614:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571621:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571646:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.571656:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759478.571690:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232899200:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759478.571697:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1782759478.571713:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232899200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759478.571818:0:145850:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.571828:0:145850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.571834:0:145850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c786 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759478.602662:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759478.991705:0:145898:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe2131b160 20000000:00000080:0.0:1782759478.991723:0:145898:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd8a3000 uarg=0000000000000000 00010000:00010000:0.0:1782759478.991917:0:145898:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759478.991935:0:145898:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759478.991958:0:145898:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759478.991971:0:145898:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759478.991990:0:145898:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759478.992010:0:145898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992026:0:145898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992037:0:145898:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992044:0:145898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992051:0:145898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992069:0:145898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992075:0:145898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759478.992080:0:145898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992087:0:145898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992100:0:145898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992108:0:145898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759478.992114:0:145898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c78d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759479.178822:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759479.178959:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232899456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.179026:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759479.179080:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759479.179087:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232899584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.179122:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759479.179158:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899456 00000100:00100000:1.0:1782759479.179159:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899584 00000100:00100000:3.0:1782759479.179166:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899456 00000100:00100000:1.0:1782759479.179167:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899584 00000100:00100000:1.0:1782759479.179217:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3187 00000100:00100000:3.0:1782759479.179223:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4994 00000100:00100000:1.0:1782759479.179229:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232899584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.179237:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232899456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.179288:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232899584:12345-0@lo:400:kworker.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.179294:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232899456:12345-0@lo:400:kworker.0 Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.179297:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3187 00000100:00100000:3.0:1782759479.179316:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4994 00000100:00100000:1.0:1782759479.179343:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232899584:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.179355:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232899456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759479.179494:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232899712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759479.179517:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759479.179537:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232899328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759479.179557:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.179626:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899328 00000100:00100000:1.0:1782759479.179630:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899328 00000100:00100000:1.0:1782759479.179659:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1782759479.179666:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232899328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.179699:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232899328:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.179711:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:1.0:1782759479.179767:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759479.179791:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.179826:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899840 00000100:00100000:1.0:1782759479.179830:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899840 00000100:00100000:1.0:1782759479.179877:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:1.0:1782759479.179883:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232899840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759479.179887:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899712 00000100:00100000:3.0:1782759479.179892:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899712 00002000:00000024:1.0:1782759479.179900:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759479.179930:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4995 00000100:00100000:1.0:1782759479.179934:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232899840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.179941:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232899712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.179941:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00080000:1.0:1782759479.179960:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759479.179989:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232899712:12345-0@lo:400:kworker.0 Request processed in 52us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.179998:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4995 00000100:00100000:1.0:1782759479.179998:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759479.180049:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232899712:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180059:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232899328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180079:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232899968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180104:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759479.180112:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232900224:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180132:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232900480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180145:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.180170:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759479.180170:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232900096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180171:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232900736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180201:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.180218:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232899968 00000100:00100000:1.0:1782759479.180223:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232899968 00000100:00100000:3.0:1782759479.180229:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759479.180236:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232900352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180259:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3188 00000100:00100000:3.0:1782759479.180262:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.180271:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232899968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180284:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232900864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180318:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232899968:12345-0@lo:400:kworker.0 Request processed in 50us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.180327:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3188 00000100:00100000:3.0:1782759479.180328:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.180352:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900480 00000100:00100000:1.0:1782759479.180361:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900480 00000100:00100000:3.0:1782759479.180362:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900224 00000100:00100000:3.0:1782759479.180367:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900224 00000100:00100000:1.0:1782759479.180391:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900352 00000100:00100000:1.0:1782759479.180395:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900352 00000100:00100000:3.0:1782759479.180411:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900736 00000100:00100000:3.0:1782759479.180416:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900736 00000100:00100000:1.0:1782759479.180426:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900864 00000100:00100000:1.0:1782759479.180431:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900864 00000100:00100000:3.0:1782759479.180444:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4996 00000100:00100000:3.0:1782759479.180454:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232900224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180457:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1782759479.180467:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232900480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180500:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232900224:12345-0@lo:400:kworker.0 Request processed in 48us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.180507:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4996 00000100:00100000:1.0:1782759479.180513:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232900480:12345-0@lo:400:kworker.0 Request processed in 47us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.180521:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00100000:3.0:1782759479.180525:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4997 00000100:00100000:3.0:1782759479.180534:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232900736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180541:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:1.0:1782759479.180550:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232900352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180601:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232900352:12345-0@lo:400:kworker.0 Request processed in 54us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.180606:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1782759479.180611:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232900736:12345-0@lo:400:kworker.0 Request processed in 76us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.180618:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:3.0:1782759479.180622:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4997 00000100:00100000:1.0:1782759479.180629:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232900864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180661:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232900864:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.180662:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.180672:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:3.0:1782759479.180688:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232900608:0@lo:400:kworker.0 00000100:00080000:1.0:1782759479.180692:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759479.180697:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759479.180701:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759479.180715:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759479.180725:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232900480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759479.180738:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232899968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180748:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900096 00000100:00100000:3.0:1782759479.180753:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900096 00000100:00080000:1.0:1782759479.180773:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759479.180784:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900608 00000100:00100000:3.0:1782759479.180787:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900608 00000100:00080000:1.0:1782759479.180813:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759479.180819:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4998 00000100:00100000:3.0:1782759479.180828:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232900096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180876:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232900096:12345-0@lo:400:kworker.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759479.180883:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4998 00000100:00100000:1.0:1782759479.180890:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232900096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180900:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4999 00000100:00100000:3.0:1782759479.180909:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232900608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180941:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232900608:12345-0@lo:400:kworker.0 Request processed in 34us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759479.180947:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232900608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.180949:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4999 00000100:00100000:3.0:1782759479.180992:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232900352:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.181000:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967405 gen 2 00000004:00080000:3.0:1782759479.181005:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc26c5500, transno 4294967405 00000100:00100000:3.0:1782759479.181016:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232900864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.181028:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232900736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759479.181044:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232900224:0@lo:400:kworker.0 00000020:00000080:2.0:1782759479.347778:0:145946:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5274a340 20000000:00000080:2.0:1782759479.347795:0:145946:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc264fc00 uarg=0000000000000000 00010000:00010000:2.0:1782759479.347978:0:145946:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759479.347994:0:145946:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759479.348016:0:145946:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759479.348028:0:145946:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759479.348047:0:145946:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759479.348067:0:145946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348083:0:145946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348092:0:145946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348098:0:145946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348114:0:145946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348121:0:145946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348127:0:145946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759479.348131:0:145946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348140:0:145946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348151:0:145946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348159:0:145946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759479.348165:0:145946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c794 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 145946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.627845:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759479.702821:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232900992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759479.702905:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759479.703357:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232900992 00000100:00100000:2.0:1782759479.703365:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232900992 00000100:00100000:2.0:1782759479.703424:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1782759479.703434:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232900992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759479.703455:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759479.706177:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232900992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2738us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759479.706190:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232900992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759479.706208:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 10000000:01000000:1.0:1782759479.946658:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759479.946665:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759479.946669:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759479.946710:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.946720:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.946731:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759479.946754:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232901120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759479.946819:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759479.946866:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901120 00000100:00100000:0.0:1782759479.946874:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901120 00000100:00100000:1.0:1782759479.946875:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded18030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759479.946930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:0.0:1782759479.946940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232901120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759479.946957:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759479.946967:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c79b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.946984:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.946991:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759479.946997:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4ddc00, rc 0) 00000100:00100000:0.0:1782759479.947041:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232901120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759479.947051:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1782759479.947063:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232901120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759479.947078:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.947088:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759479.947114:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759479.947119:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759479.947125:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759480.203670:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232901248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759480.203752:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759480.203821:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901248 00000100:00100000:1.0:1782759480.203840:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901248 00000100:00100000:1.0:1782759480.203902:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:1.0:1782759480.203911:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232901248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759480.203957:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:1.0:1782759480.204002:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232901248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759480.204009:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:1.0:1782759480.204051:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232901248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759480.540012:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759480.540052:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759480.540077:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759480.540110:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508544 00000100:00100000:1.0:1782759480.540119:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508416 00000100:00100000:0.0:1782759480.540121:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508544 00000100:00100000:1.0:1782759480.540125:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508416 00000100:00100000:0.0:1782759480.540176:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508672 00000100:00100000:1.0:1782759480.540177:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3202 00000100:00100000:0.0:1782759480.540183:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508672 00000100:00100000:1.0:1782759480.540192:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218508416:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759480.540221:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5000 00000100:00100000:0.0:1782759480.540231:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218508544:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759480.540262:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218508416:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759480.540270:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218508544:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759480.540274:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3202 00000100:00100000:0.0:1782759480.540283:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5000 00000100:00080000:1.0:1782759480.540309:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759480.540309:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5001 00000100:00080000:1.0:1782759480.540316:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759480.540321:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218508672:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759480.540346:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218508672:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759480.540362:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5001 00000100:00100000:2.0:1782759480.540406:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759480.540455:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759480.540476:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508800 00000100:00100000:0.0:1782759480.540481:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508800 00000100:00100000:2.0:1782759480.540492:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218508928 00000100:00100000:2.0:1782759480.540498:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218508928 00000100:00100000:0.0:1782759480.540517:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2874 00000100:00100000:0.0:1782759480.540527:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218508800:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759480.540545:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2875 00000100:00100000:0.0:1782759480.540556:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218508800:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759480.540558:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218508928:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759480.540568:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2874 00000100:00100000:2.0:1782759480.540628:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218508928:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759480.540634:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2875 00000100:00080000:1.0:1782759480.540698:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759480.540701:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759480.651687:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759480.714723:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759480.714747:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232901376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759480.714813:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759480.714860:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901376 00000100:00100000:0.0:1782759480.714868:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901376 00000100:00100000:0.0:1782759480.714921:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1782759480.714933:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232901376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759480.714962:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759480.714976:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759480.714989:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232901504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759480.715012:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232901376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759480.715020:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1782759480.715032:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759480.715044:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232901376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759480.715047:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901504 00000100:00100000:0.0:1782759480.715052:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901504 00000100:00100000:0.0:1782759480.715086:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1782759480.715093:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232901504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759480.715104:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759480.715139:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232901504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759480.715145:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1782759480.715170:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232901504:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782759481.532721:0:146141:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64e: Nodemap enforces chlg_ops RBAC roles ========================================================== 14:58:01 (1782759481) 00000100:00100000:2.0:1782759481.599815:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759481.599863:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759481.599865:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509056 00000100:00100000:3.0:1782759481.599875:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509056 00000100:00100000:3.0:1782759481.599923:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509312 00000100:00100000:3.0:1782759481.599926:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509312 00000100:00100000:2.0:1782759481.599931:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2839 00000100:00100000:3.0:1782759481.599951:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2840 00000100:00100000:2.0:1782759481.599952:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218509056:12345-192.168.202.31@tcp:41:mkdir.0 00000100:00100000:3.0:1782759481.599958:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107138:x1869355218509312:12345-192.168.202.31@tcp:36:mkdir.0 00000004:00000024:2.0:1782759481.599992:0:42628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445888000 avail 1299648512 00010000:00010000:3.0:1782759481.600004:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759481.600008:0:6531:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60c086) 00010000:00010000:3.0:1782759481.600012:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759481.600080:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218509056:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 140us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759481.600088:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2839 00010000:00010000:3.0:1782759481.600107:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.600123:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.600136:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.600164:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.600172:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.600200:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601215:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601227:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601236:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759481.601253:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce423cb4 reply state 000000003ccdf363 transno 4294967973 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601266:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601273:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:3.0:1782759481.601276:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759481.601280:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759481.601285:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x17:0x0]: returning size 4096 00010000:00010000:3.0:1782759481.601293:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601300:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601307:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601314:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601327:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759481.601331:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601339:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601350:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759481.601353:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759481.601357:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601362:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759481.601371:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce423cb4 reply state 000000003ccdf363 transno 4294967973 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601377:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759481.601381:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc65a5b3 (ffff8cddc34f4700) 00010000:00010000:3.0:1782759481.601383:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759481.601384:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782759481.601441:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107138:x1869355218509312:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 1482us (1576us total) trans 4294967973 rc 0/0 00000100:00100000:3.0:1782759481.601449:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2840 00010000:00010000:1.0:1782759481.674710:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759481.740209:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967413 is committed 00010000:00010000:0.0:1782759482.698943:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759483.276001:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232901632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759483.276072:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759483.276124:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901632 00000100:00100000:2.0:1782759483.276132:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901632 00000100:00100000:2.0:1782759483.276208:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:2.0:1782759483.276221:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232901632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759483.276268:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445883904 avail 1299644416 00000100:00100000:2.0:1782759483.276326:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232901632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759483.276335:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:1.0:1782759483.276361:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232901632:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1782759483.287884:0:146336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdafb26d00 20000000:00000080:3.0:1782759483.287902:0:146336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4793400 uarg=0000000000000000 10000000:01000000:3.0:1782759483.288058:0:146336:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759483.288078:0:146336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.288097:0:146336:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.288107:0:146336:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.288145:0:146336:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.288159:0:146336:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 23 pid: 6526 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759483.288174:0:146336:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146336:1869355232901760:0@lo:104: 00000100:00100000:3.0:1782759483.288235:0:146336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759483.288326:0:146336:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759483.288403:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901760 00000100:00100000:1.0:1782759483.288410:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901760 00000100:00100000:1.0:1782759483.288454:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1782759483.288462:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:146336:x1869355232901760:12345-0@lo:104: 00010000:00010000:1.0:1782759483.288475:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759483.288567:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759483.288574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:146336:x1869355232901760:12345-0@lo:104: Request processed in 113us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759483.288621:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00010000:00010000:0.0:1782759483.288651:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759483.288660:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.288668:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759483.288673:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.288682:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759483.288690:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759483.288696:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759483.288723:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.288729:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759483.288768:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.288776:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428000/0xd5b45c7f5c60c79b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c7a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.288792:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759483.288794:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759483.288796:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759483.288840:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232901888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759483.288870:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759483.288908:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232901888 00000100:00100000:0.0:1782759483.288913:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232901888 00010000:00010000:0.0:1782759483.288933:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 24 pid: 6526 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759483.288963:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1782759483.288971:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232901888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759483.288982:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759483.288987:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 24 pid: 6526 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.288996:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 24 pid: 6526 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289012:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289021:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289034:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289041:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289049:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289056:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.289058:0:146336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c7a2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c79b expref: 24 pid: 6526 timeout: 3673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759483.289076:0:146336:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146336:1869355232901760:0@lo:104: 00010000:00010000:0.0:1782759483.289083:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759483.289089:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.289100:0:146336:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289100:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289120:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.289122:0:146336:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.289137:0:146336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759483.289137:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759483.289156:0:146336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7be lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759483.289184:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232901888:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759483.289192:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00100000:1.0:1782759483.289617:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232901888:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1782759483.703670:0:146384:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb6a82940 20000000:00000080:3.0:1782759483.703684:0:146384:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc264fc00 uarg=0000000000000000 10000000:01000000:3.0:1782759483.703831:0:146384:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759483.703853:0:146384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703869:0:146384:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703879:0:146384:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703886:0:146384:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703893:0:146384:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703900:0:146384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703906:0:146384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759483.703909:0:146384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703916:0:146384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703938:0:146384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703945:0:146384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.703951:0:146384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60c7c5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759483.705304:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967973 is committed 00010000:00010000:3.0:1782759483.705357:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705365:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705370:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705373:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759483.705376:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705380:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705392:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc65a5b3 (ffff8cddc34f4700) 00010000:00010000:3.0:1782759483.705394:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759483.705397:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705401:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c7b0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705419:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705423:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705426:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705428:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759483.705430:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705433:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705437:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:3.0:1782759483.705438:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759483.705440:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759483.705443:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60c7b7 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759483.722740:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759484.298779:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232902016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759484.298836:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232902144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.298858:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232902272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.298872:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759484.298882:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759484.298909:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759484.298924:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232902656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.298931:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232902528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.298936:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232902784:0@lo:400:kworker.0 00000100:00100000:0.0:1782759484.298958:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.298965:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759484.298974:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232902400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.298986:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232903040:0@lo:400:kworker.0 00000100:00100000:0.0:1782759484.298986:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232903168:0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.299005:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.299018:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759484.299027:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902144 00000100:00100000:0.0:1782759484.299034:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902144 00000100:00100000:1.0:1782759484.299038:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232902912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.299044:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232903552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.299070:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759484.299079:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902656 00000100:00100000:2.0:1782759484.299083:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902016 00000100:00100000:0.0:1782759484.299083:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902656 00000100:00100000:2.0:1782759484.299086:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902016 00000100:00100000:1.0:1782759484.299099:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232903424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759484.299112:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902400 00000100:00100000:0.0:1782759484.299116:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902400 00000100:00100000:2.0:1782759484.299121:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1782759484.299128:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.299132:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232902016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759484.299139:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5002 00000100:00100000:0.0:1782759484.299145:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232902144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.299181:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902272 00000100:00100000:1.0:1782759484.299187:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902272 00000100:00100000:2.0:1782759484.299188:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232902016:12345-0@lo:400:kworker.0 Request processed in 56us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759484.299188:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232902144:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.299199:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:0.0:1782759484.299199:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5002 00000100:00100000:0.0:1782759484.299217:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5003 00000100:00100000:0.0:1782759484.299223:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.299233:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5004 00000100:00100000:1.0:1782759484.299236:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902528 00000100:00100000:1.0:1782759484.299240:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902528 00000100:00100000:2.0:1782759484.299243:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232902400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759484.299250:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232902656:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759484.299257:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5003 00000100:00100000:2.0:1782759484.299284:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232902400:12345-0@lo:400:kworker.0 Request processed in 44us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.299290:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5004 00000100:00100000:0.0:1782759484.299300:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903040 00000100:00100000:0.0:1782759484.299303:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903040 00000100:00100000:2.0:1782759484.299307:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902912 00000100:00100000:2.0:1782759484.299309:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902912 00000100:00100000:0.0:1782759484.299326:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903424 00000100:00100000:0.0:1782759484.299328:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903424 00000100:00100000:1.0:1782759484.299350:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:1.0:1782759484.299358:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232902272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.299390:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232902272:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759484.299396:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:1.0:1782759484.299408:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:1.0:1782759484.299413:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232902528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759484.299433:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232902528:12345-0@lo:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759484.299439:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00080000:1.0:1782759484.299454:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759484.299457:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759484.299460:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759484.299598:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1782759484.299709:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232903040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.299740:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232903040:12345-0@lo:400:kworker.0 Request processed in 35us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.299746:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:2.0:1782759484.299758:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1782759484.299765:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232902912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.299847:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232902912:12345-0@lo:400:kworker.0 Request processed in 83us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.299853:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:2.0:1782759484.299864:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1782759484.299871:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232903424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.299894:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232903424:12345-0@lo:400:kworker.0 Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.299900:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:2.0:1782759484.300002:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.300042:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232902144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300053:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232902656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300079:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903168 00000100:00100000:2.0:1782759484.300083:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903168 00000100:00100000:2.0:1782759484.300120:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5005 00000100:00100000:2.0:1782759484.300127:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232903168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300158:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232903168:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.300164:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5005 00000100:00100000:2.0:1782759484.300188:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232903168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300205:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.300224:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232902016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300239:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232902528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300248:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232903040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300262:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903552 00000100:00100000:2.0:1782759484.300265:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903552 00000100:00100000:2.0:1782759484.300286:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1782759484.300292:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232903552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300320:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232903552:12345-0@lo:400:kworker.0 Request processed in 29us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.300326:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1782759484.300346:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232903552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300383:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232902400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300392:0:3665:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967413 gen 2 00000004:00080000:2.0:1782759484.300396:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc3741500, transno 4294967413 00000100:00100000:2.0:1782759484.300405:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232902912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300415:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232903424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300872:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.300894:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232903296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.300920:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.301016:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232902272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.301037:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232902784 00000100:00100000:2.0:1782759484.301040:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232902784 00000100:00100000:2.0:1782759484.301065:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903296 00000100:00100000:2.0:1782759484.301067:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903296 00000100:00100000:2.0:1782759484.301087:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006 00000100:00100000:2.0:1782759484.301094:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232902784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.301129:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232902784:12345-0@lo:400:kworker.0 Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.301136:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006 00000100:00100000:2.0:1782759484.301147:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007 00000100:00100000:2.0:1782759484.301154:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232903296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.301180:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232903296:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.301184:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007 00000100:00100000:2.0:1782759484.301383:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232902784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759484.301393:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232903296:0@lo:400:kworker.0 00000100:00080000:2.0:1782759484.301646:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759484.301650:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759484.301652:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759484.303007:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232903680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759484.303059:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759484.303109:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903680 00000100:00100000:1.0:1782759484.303116:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903680 00000100:00100000:1.0:1782759484.303154:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:1.0:1782759484.303163:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232903680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759484.303188:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759484.303231:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232903680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759484.303238:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1782759484.303258:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232903680:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1782759484.747682:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759484.747688:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759484.747693:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759484.747733:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.747745:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.747756:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759484.747782:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232903808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759484.747863:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759484.747907:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759484.747932:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903808 00000100:00100000:2.0:1782759484.747938:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903808 00000100:00100000:2.0:1782759484.747991:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:2.0:1782759484.748001:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232903808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759484.748015:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759484.748029:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c7cc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.748051:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.748061:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.748082:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759484.748121:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232903808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759484.748127:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:2.0:1782759484.748186:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232903808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759484.748201:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.748210:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759484.748227:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759484.748232:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759484.748240:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759484.748458:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759484.811101:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759484.811126:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232903936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759484.811198:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759484.811310:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232903936 00000100:00100000:3.0:1782759484.811319:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232903936 00000100:00100000:3.0:1782759484.811375:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1782759484.811386:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232903936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759484.811409:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759484.811462:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232903936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759484.811477:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:0.0:1782759484.811536:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232903936:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1782759485.176263:0:146532:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc75a123d0 20000000:00000080:0.0:1782759485.176279:0:146532:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6e400 uarg=0000000000000000 10000000:01000000:0.0:1782759485.176604:0:146532:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759485.176622:0:146532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.176640:0:146532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.176649:0:146532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.176687:0:146532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.176710:0:146532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 23 pid: 6525 timeout: 3675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759485.176725:0:146532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146532:1869355232904064:0@lo:104: 00000100:00100000:0.0:1782759485.176782:0:146532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759485.176894:0:146532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759485.176936:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904064 00000100:00100000:3.0:1782759485.176944:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904064 00000100:00100000:3.0:1782759485.176993:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:3.0:1782759485.177002:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:146532:x1869355232904064:12345-0@lo:104: 00010000:00010000:3.0:1782759485.177014:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.177102:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759485.177108:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:146532:x1869355232904064:12345-0@lo:104: Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.177115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00010000:00010000:1.0:1782759485.177129:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759485.177138:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.177148:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759485.177152:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.177162:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759485.177170:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759485.177176:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759485.177211:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.177219:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759485.177240:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.177247:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60c7cc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c7d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759485.177263:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759485.177264:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759485.177266:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759485.177277:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232904192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759485.177305:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759485.177345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904192 00000100:00100000:2.0:1782759485.177350:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904192 00010000:00010000:2.0:1782759485.177380:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 24 pid: 6525 timeout: 3675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759485.177404:0:146532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:146532:1869355232904064:0@lo:104: 00000100:00100000:2.0:1782759485.177408:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1782759485.177416:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232904192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759485.177421:0:146532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177424:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759485.177434:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 24 pid: 6525 timeout: 3675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177444:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 24 pid: 6525 timeout: 3675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177456:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60c7d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7cc expref: 24 pid: 6525 timeout: 3675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177469:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177477:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177489:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177496:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177502:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177506:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177510:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759485.177512:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177517:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177534:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759485.177544:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759485.177552:0:146532:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.177559:0:146532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.177565:0:146532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60c7da lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.177600:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232904192:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.177607:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:1.0:1782759485.177632:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232904192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759485.322846:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759485.322871:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232904320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759485.322941:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759485.323143:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904320 00000100:00100000:1.0:1782759485.323151:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904320 00000100:00100000:1.0:1782759485.323211:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3193 00000100:00100000:1.0:1782759485.323220:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232904320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759485.323252:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:1.0:1782759485.323302:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232904320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759485.323309:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3193 00000100:00100000:3.0:1782759485.323625:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232904320:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1782759485.566060:0:146580:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcafb50f50 20000000:00000080:3.0:1782759485.566075:0:146580:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4793400 uarg=0000000000000000 10000000:01000000:3.0:1782759485.566266:0:146580:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759485.566284:0:146580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566299:0:146580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566309:0:146580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566327:0:146580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566334:0:146580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566342:0:146580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566348:0:146580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759485.566353:0:146580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566361:0:146580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566374:0:146580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566382:0:146580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759485.566390:0:146580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60c7e1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759485.660345:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759485.660383:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759485.660415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759485.660418:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509440 00000100:00100000:0.0:1782759485.660426:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509568 00000100:00100000:3.0:1782759485.660430:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509440 00000100:00100000:0.0:1782759485.660433:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509568 00000100:00100000:2.0:1782759485.660438:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759485.660461:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759485.660488:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509824 00000100:00100000:2.0:1782759485.660493:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509824 00000100:00100000:3.0:1782759485.660494:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3205 00000100:00100000:0.0:1782759485.660495:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509696 00000100:00100000:0.0:1782759485.660502:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509696 00000100:00100000:3.0:1782759485.660511:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218509440:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759485.660536:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218509952 00000100:00100000:2.0:1782759485.660541:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218509952 00000100:00100000:0.0:1782759485.660545:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5008 00000100:00100000:0.0:1782759485.660557:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218509568:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759485.660606:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2880 00000100:00100000:2.0:1782759485.660618:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218509824:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759485.660637:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218509568:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.660638:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218509440:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 126us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.660649:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218509824:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759485.660649:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5008 00000100:00100000:2.0:1782759485.660656:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2880 00000100:00100000:2.0:1782759485.660675:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2881 00000100:00100000:2.0:1782759485.660682:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218509952:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759485.660686:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5009 00000100:00100000:0.0:1782759485.660698:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218509696:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759485.660707:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3205 00000100:00100000:2.0:1782759485.660721:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218509952:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.660729:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2881 00000100:00100000:0.0:1782759485.660746:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218509696:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 51us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759485.660755:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5009 00000100:00080000:2.0:1782759485.660769:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759485.660775:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759485.660779:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759485.660781:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759485.770711:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759485.834741:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232904448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759485.834825:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759485.834939:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904448 00000100:00100000:3.0:1782759485.834946:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904448 00000100:00100000:3.0:1782759485.835002:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1782759485.835012:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232904448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759485.835040:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759485.835085:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232904448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759485.835092:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:1.0:1782759485.835173:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232904448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759485.835709:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759485.835804:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232904576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759485.835834:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759485.835983:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904576 00000100:00100000:2.0:1782759485.835988:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904576 00000100:00100000:2.0:1782759485.836065:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:2.0:1782759485.836075:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232904576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759485.836090:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759485.836137:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232904576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759485.836144:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1782759485.836199:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232904576:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759485.968160:0:146628:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffeed67480 20000000:00000080:0.0:1782759485.968174:0:146628:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6cc00 uarg=0000000000000000 10000000:01000000:0.0:1782759485.968292:0:146628:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759485.968312:0:146628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968328:0:146628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968338:0:146628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968342:0:146628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968347:0:146628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968352:0:146628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968355:0:146628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759485.968358:0:146628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968371:0:146628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968380:0:146628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968384:0:146628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759485.968388:0:146628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dde00/0xd5b45c7f5c60c7e8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759486.312250:0:146676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc411f7d50 20000000:00000080:2.0:1782759486.312266:0:146676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e81400 uarg=0000000000000000 10000000:01000000:2.0:1782759486.312401:0:146676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759486.312421:0:146676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312436:0:146676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312446:0:146676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312452:0:146676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312459:0:146676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312466:0:146676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312478:0:146676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759486.312482:0:146676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312490:0:146676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312501:0:146676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312509:0:146676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.312515:0:146676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60c7ef lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759486.661542:0:146724:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6e852860 20000000:00000080:2.0:1782759486.661559:0:146724:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e82800 uarg=0000000000000000 00010000:00010000:2.0:1782759486.661810:0:146724:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759486.661827:0:146724:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759486.661853:0:146724:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759486.661866:0:146724:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759486.661882:0:146724:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759486.661900:0:146724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661915:0:146724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661937:0:146724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661944:0:146724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661952:0:146724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661959:0:146724:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661966:0:146724:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759486.661969:0:146724:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661977:0:146724:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661990:0:146724:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.661998:0:146724:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.662005:0:146724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c7f6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 146724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759486.794817:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759486.795356:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759486.795359:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759486.795363:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759486.795403:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.795411:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.795419:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759486.795443:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232904704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759486.795498:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759486.795545:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759486.795674:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904704 00000100:00100000:2.0:1782759486.795682:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904704 00000100:00100000:2.0:1782759486.795754:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:2.0:1782759486.795765:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232904704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759486.795794:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759486.795807:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c7fd expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.795830:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.795840:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759486.795849:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759486.795893:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232904704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759486.795900:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:3.0:1782759486.795936:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232904704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759486.795958:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.795967:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759486.795985:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759486.795990:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759486.795997:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759487.819003:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759488.394735:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232904832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759488.394812:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759488.394862:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904832 00000100:00100000:2.0:1782759488.394870:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904832 00000100:00100000:2.0:1782759488.394944:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3194 00000100:00100000:2.0:1782759488.394955:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232904832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759488.394990:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445883904 avail 1299644416 00000100:00100000:2.0:1782759488.395045:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232904832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759488.395052:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3194 00000100:00100000:0.0:1782759488.395113:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232904832:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1782759488.657467:0:146967:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759488.657475:0:146967:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759488.658093:0:146967:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1782759488.658104:0:146967:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:2.0:1782759488.843867:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759489.014283:0:147015:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007fffa436eaf0 00000004:00000080:1.0:1782759489.014300:0:147015:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b1 len=576 karg=ffff8cddc3103000 uarg=0000000000000000 00000004:00000080:1.0:1782759489.014343:0:147015:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b1 len=576 karg=ffff8cddc3103000 00000040:00080000:1.0:1782759489.014421:0:147015:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 80 off8352 00000004:00000080:1.0:1782759489.014451:0:147015:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0000: registered changelog user 'cl2', mask 0x0 00000004:02000000:1.0:1782759489.014455:0:147015:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0000: changelog on 00000100:00100000:2.0:1782759489.418704:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232905216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.418705:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232905088:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.418773:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232905344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.418794:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759489.418802:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759489.418809:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759489.418837:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355232905856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.418845:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232905728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.418861:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232905472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.418873:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759489.418889:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905216 00000100:00100000:2.0:1782759489.418895:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905216 00000100:00100000:3.0:1782759489.418898:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355232906368:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.418905:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759489.418927:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759489.418934:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232905984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.418961:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905856 00000100:00100000:2.0:1782759489.418965:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905856 00000100:00100000:1.0:1782759489.418969:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759489.418979:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905344 00000100:00100000:3.0:1782759489.418984:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905344 00000100:00100000:1.0:1782759489.418995:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232906496:0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.418997:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905472 00000100:00100000:2.0:1782759489.419002:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905472 00000100:00100000:2.0:1782759489.419019:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906368 00000100:00100000:2.0:1782759489.419021:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906368 00000100:00100000:3.0:1782759489.419024:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:3.0:1782759489.419033:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232905344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.419042:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010 00000100:00100000:1.0:1782759489.419044:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759489.419051:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232905216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419071:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1782759489.419081:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232904960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759489.419096:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232905344:12345-0@lo:400:kworker.0 Request processed in 63us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759489.419096:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232905216:12345-0@lo:400:kworker.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.419105:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00100000:2.0:1782759489.419105:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010 00000100:00100000:1.0:1782759489.419117:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759489.419125:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5011 00000100:00100000:3.0:1782759489.419131:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012 00000100:00100000:2.0:1782759489.419134:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355232905856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419136:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232905472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419158:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232905600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419172:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232905472:12345-0@lo:400:kworker.0 Request processed in 35us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759489.419172:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355232905856:12345-0@lo:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759489.419180:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5011 00000100:00100000:3.0:1782759489.419183:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012 00000100:00100000:1.0:1782759489.419189:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759489.419193:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5013 00000100:00100000:2.0:1782759489.419203:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355232906368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419211:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905600 00000100:00100000:1.0:1782759489.419214:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232906112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419216:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905600 00000100:00100000:2.0:1782759489.419240:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355232906368:12345-0@lo:400:kworker.0 Request processed in 40us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.419245:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:3.0:1782759489.419257:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232905600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419259:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759489.419267:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5013 00000100:00100000:1.0:1782759489.419290:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232906624:0@lo:400:kworker.0 00000100:00080000:2.0:1782759489.419293:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759489.419300:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232905600:12345-0@lo:400:kworker.0 Request processed in 47us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.419307:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:1.0:1782759489.419329:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759489.419334:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759489.419350:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232905344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.419359:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232906240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419368:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355232905856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419368:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232905472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419387:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355232906368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.419402:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759489.419405:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232905600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419424:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905728 00000100:00100000:3.0:1782759489.419428:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905728 00000100:00100000:2.0:1782759489.419443:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232905216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419446:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905088 00000100:00100000:1.0:1782759489.419451:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905088 00000100:00100000:3.0:1782759489.419461:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906240 00000100:00100000:3.0:1782759489.419465:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906240 00000100:00100000:1.0:1782759489.419490:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:3.0:1782759489.419495:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5014 00000100:00100000:2.0:1782759489.419503:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5015 00000100:00100000:1.0:1782759489.419503:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232905088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419504:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232905728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759489.419513:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232906240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419557:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232905088:12345-0@lo:400:kworker.0 Request processed in 58us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.419563:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232905728:12345-0@lo:400:kworker.0 Request processed in 58us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759489.419563:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232906240:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.419569:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:2.0:1782759489.419574:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5015 00000100:00100000:3.0:1782759489.419608:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5014 00000100:00080000:2.0:1782759489.419615:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759489.419637:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232905984 00000100:00100000:3.0:1782759489.419647:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232905728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419649:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232905984 00000100:00100000:3.0:1782759489.419662:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232906240:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419695:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906496 00000100:00100000:1.0:1782759489.419698:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906496 00000100:00100000:3.0:1782759489.419705:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906112 00000100:00100000:3.0:1782759489.419711:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906112 00000100:00100000:1.0:1782759489.419718:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906624 00000100:00100000:1.0:1782759489.419722:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906624 00000100:00100000:3.0:1782759489.419743:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1782759489.419762:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1782759489.419772:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232905984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419774:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232906496:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759489.419815:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759489.419820:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232905984:12345-0@lo:400:kworker.0 Request processed in 68us (853us total) trans 0 rc 0/0 00000100:00080000:2.0:1782759489.419820:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759489.419831:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1782759489.419832:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232906496:12345-0@lo:400:kworker.0 Request processed in 58us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.419842:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00100000:3.0:1782759489.419848:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:3.0:1782759489.419857:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232906112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.419863:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:1.0:1782759489.419872:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232906624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759489.419893:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232906112:12345-0@lo:400:kworker.0 Request processed in 36us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759489.419901:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:1.0:1782759489.419910:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232906624:12345-0@lo:400:kworker.0 Request processed in 39us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.419917:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:1.0:1782759489.419940:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232904960 00000100:00100000:1.0:1782759489.419943:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232904960 00000100:00100000:1.0:1782759489.419969:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1782759489.419974:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232904960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759489.419991:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759489.420019:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232904960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.420024:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:1.0:1782759489.420078:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232904960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759489.420087:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232906112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.420094:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232906624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.420111:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232905984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.420119:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232906496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759489.420126:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232905088:0@lo:400:kworker.0 00000040:00080000:0.0:1782759489.843737:0:147111:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782759489.843745:0:147111:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:0.0:1782759489.844317:0:147111:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1782759489.844327:0:147111:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:0.0:1782759489.867675:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759489.930701:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759489.930721:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232906752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759489.930802:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759489.930854:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906752 00000100:00100000:1.0:1782759489.930860:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906752 00000100:00100000:1.0:1782759489.930903:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1782759489.930912:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232906752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759489.930933:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759489.930976:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232906752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759489.930984:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1782759489.931013:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232906752:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1782759490.242489:0:147159:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b1 len=0 uarg=00007ffc6658c3c0 00000004:00000080:1.0:1782759490.242505:0:147159:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=424066b1 len=576 karg=ffff8cddc3101800 uarg=0000000000000000 00000004:00000080:1.0:1782759490.242549:0:147159:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b1 len=576 karg=ffff8cddc3101800 00000040:00080000:1.0:1782759490.242666:0:147159:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 80 off8352 00000004:00000080:1.0:1782759490.242691:0:147159:0:(mdd_device.c:1853:mdd_changelog_user_register()) lustre-MDD0001: registered changelog user 'cl2', mask 0x0 00000004:02000000:1.0:1782759490.242693:0:147159:0:(mdd_device.c:469:mdd_changelog_on()) lustre-MDD0001: changelog on 00000100:00100000:3.0:1782759490.442782:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232906880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759490.442867:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759490.442938:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232906880 00000100:00100000:1.0:1782759490.442946:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232906880 00000100:00100000:1.0:1782759490.443014:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:1.0:1782759490.443025:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232906880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759490.443058:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:1.0:1782759490.443115:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232906880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759490.443129:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:2.0:1782759490.443162:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232906880:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1782759490.616626:0:147207:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759490.616630:0:147207:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1782759490.616644:0:147207:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:1.0:1782759490.616649:0:147207:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:1.0:1782759490.782176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759490.782229:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759490.782251:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510080 00000100:00100000:2.0:1782759490.782262:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510080 00000100:00100000:2.0:1782759490.782326:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3208 00000100:00100000:2.0:1782759490.782338:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218510080:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759490.782422:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218510080:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759490.782430:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3208 00000100:00100000:3.0:1782759490.782515:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510336 00000100:00100000:3.0:1782759490.782521:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510336 00000100:00080000:0.0:1782759490.782559:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759490.782606:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5016 00000100:00100000:3.0:1782759490.782619:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218510336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759490.782635:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759490.782663:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510592 00000100:00100000:2.0:1782759490.782668:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510592 00000100:00100000:3.0:1782759490.782675:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218510336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759490.782698:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5016 00000100:00100000:2.0:1782759490.782727:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2886 00000100:00100000:2.0:1782759490.782753:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218510592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:0.0:1782759490.782754:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759490.782793:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759490.782803:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218510592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 67us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759490.782812:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2886 00000100:00100000:0.0:1782759490.782835:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510208 00000100:00100000:0.0:1782759490.782841:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510208 00000100:00080000:2.0:1782759490.782886:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759490.782944:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759490.782945:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5017 00000100:00100000:0.0:1782759490.782954:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218510208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759490.782989:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510464 00000100:00100000:2.0:1782759490.783003:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510464 00000100:00100000:0.0:1782759490.783003:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218510208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 49us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759490.783014:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5017 00000100:00100000:2.0:1782759490.783067:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2887 00000100:00100000:2.0:1782759490.783077:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218510464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759490.783106:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218510464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759490.783126:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2887 00000100:00080000:3.0:1782759490.783144:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759490.890707:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759490.955117:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232907008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759490.955171:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759490.955210:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759490.955214:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232907136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759490.955226:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759490.955256:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907008 00000100:00100000:1.0:1782759490.955261:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907008 00000100:00100000:1.0:1782759490.955290:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907136 00000100:00100000:1.0:1782759490.955292:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907136 00000100:00100000:1.0:1782759490.955310:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1782759490.955424:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232907008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759490.955452:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759490.955496:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232907008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759490.955504:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:1.0:1782759490.955522:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1782759490.955530:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232907136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759490.955551:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1782759490.955606:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232907136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759490.955613:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1782759490.955674:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232907136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759490.955691:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232907008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759491.206944:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759491.207718:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510720 00000100:00100000:3.0:1782759491.207728:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510720 00000100:00100000:3.0:1782759491.207793:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2841 00000100:00100000:3.0:1782759491.207855:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:107518:x1869355218510720:12345-192.168.202.31@tcp:101:mkdir.0 00010000:00010000:3.0:1782759491.207875:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759491.207895:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c80b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27353 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.207950:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c812 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.207964:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.207974:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759491.208022:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759491.208025:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759491.208053:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.208075:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c80b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27353 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.208090:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27353 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.208104:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759491.208106:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759491.208110:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759491.208169:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107518:x1869355218510720:12345-192.168.202.31@tcp:101:mkdir.0 Request processed in 363us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759491.208176:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2841 00000100:00100000:1.0:1782759491.212188:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759491.212214:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510848 00000100:00100000:0.0:1782759491.212224:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510848 00000100:00100000:0.0:1782759491.212286:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2842 00000100:00100000:0.0:1782759491.212299:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107518:x1869355218510848:12345-192.168.202.31@tcp:101:mkdir.0 00010000:00010000:0.0:1782759491.212319:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759491.212336:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c819 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2735a expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212398:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212417:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212433:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212449:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212456:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212470:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212624:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c82e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212631:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c82e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212637:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c82e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759491.212669:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x17:0x0]: returning size 4096 00000004:00200000:0.0:1782759491.212672:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759491.212694:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c82e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212707:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212713:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212720:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212726:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212731:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759491.212734:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212757:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212766:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759491.212768:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759491.212771:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212775:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60c820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212785:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212789:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212794:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212800:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759491.212851:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212857:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212863:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfc65a5b3 (ffff8cddc3502200) 00010000:00010000:0.0:1782759491.212865:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759491.212867:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212878:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c827 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfc65a5b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212900:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c819 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2735a expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212910:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c82e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2735a expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.212915:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502600) 00010000:00010000:0.0:1782759491.212917:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759491.212918:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759491.212967:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107518:x1869355218510848:12345-192.168.202.31@tcp:101:mkdir.0 Request processed in 672us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759491.212972:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2842 00000100:00100000:2.0:1782759491.214726:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.214775:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218510976 00000100:00100000:2.0:1782759491.214782:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.214786:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218510976 00000100:00100000:3.0:1782759491.215282:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218511232 00000100:00100000:3.0:1782759491.215287:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218511232 00000100:00100000:1.0:1782759491.215293:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2843 00000100:00100000:1.0:1782759491.215307:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218510976:12345-192.168.202.31@tcp:41:mkdir.0 00000100:00100000:3.0:1782759491.215323:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2844 00000100:00100000:3.0:1782759491.215335:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107518:x1869355218511232:12345-192.168.202.31@tcp:36:mkdir.0 00000004:00000024:1.0:1782759491.215415:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446191104 avail 1299951616 00000100:00100000:3.0:1782759491.215447:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782759491.215502:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759491.215530:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218510976:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 225us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759491.215538:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2843 00000100:00100000:3.0:1782759491.215550:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc263a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759491.215573:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907264 00000100:00100000:3.0:1782759491.215663:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907264 00000100:00100000:3.0:1782759491.215765:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:3.0:1782759491.215773:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1782759491.215950:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907264:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759491.215957:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:2.0:1782759491.216023:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907264:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759491.216106:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759491.216136:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759491.216169:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc68273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759491.216622:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907392 00000100:00100000:1.0:1782759491.216628:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907392 00000100:00100000:1.0:1782759491.216667:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3199 00000100:00100000:1.0:1782759491.216676:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759491.216770:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907392:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759491.216777:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3199 00000100:00100000:2.0:1782759491.217634:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907392:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759491.217754:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759491.217782:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759491.217817:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc68273c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759491.217831:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907520 00000100:00100000:2.0:1782759491.217834:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907520 00000100:00100000:2.0:1782759491.217880:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3200 00000100:00100000:2.0:1782759491.217887:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759491.217955:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907520:12345-0@lo:1000:mdt00_003.0 Request processed in 68us (172us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759491.217960:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3200 00000100:00100000:0.0:1782759491.217988:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907520:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1782759491.218037:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.218046:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.218053:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759491.218061:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907648:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1782759491.218080:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.218131:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759491.218157:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907648 00000100:00100000:1.0:1782759491.218160:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907648 00000100:00100000:1.0:1782759491.218214:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1782759491.218221:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:8593:x1869355232907648:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1782759491.218228:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759491.218245:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c83c lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c835 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.218264:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c83c lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c835 expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.218274:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c83c lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c835 expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.218281:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502600) 00010000:00010000:1.0:1782759491.218283:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759491.218285:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759491.218316:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:8593:x1869355232907648:12345-0@lo:101:mdt00_003.0 Request processed in 96us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759491.218320:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:0.0:1782759491.218414:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907648:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1782759491.218425:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.218435:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759491.218449:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:0.0:1782759491.218471:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.218476:0:8593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.218482:0:8593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759491.218490:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907776:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1782759491.218515:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.218719:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759491.218784:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907776 00000100:00100000:2.0:1782759491.218789:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907776 00000100:00100000:2.0:1782759491.218832:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202 00000100:00100000:2.0:1782759491.218842:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:8593:x1869355232907776:12345-0@lo:101:mdt00_003.0 00010000:00010000:2.0:1782759491.218850:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759491.218904:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c843 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.218922:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c843 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.218931:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c843 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759491.218936:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759491.218937:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759491.218939:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759491.218993:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232907776:12345-0@lo:101:mdt00_003.0 Request processed in 155us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759491.218998:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202 00000100:00100000:0.0:1782759491.219111:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907776:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1782759491.219120:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.219126:0:8593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759491.219134:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00000100:00100000:0.0:1782759491.219158:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907904:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.219182:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.219222:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759491.219248:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232907904 00000100:00100000:2.0:1782759491.219253:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232907904 00000100:00100000:2.0:1782759491.219317:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:2.0:1782759491.219326:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232907904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1782759491.219387:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232907904:12345-0@lo:1000:mdt00_003.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759491.219393:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1782759491.219441:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232907904:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759491.219480:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908032:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1782759491.219509:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759491.219729:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.219769:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908032 00000100:00100000:0.0:1782759491.219773:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908032 00000100:00100000:0.0:1782759491.219798:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:0.0:1782759491.219812:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.219877:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908032:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (367us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759491.219884:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:0.0:1782759491.219911:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908032:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.219978:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220004:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.220019:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.220031:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908160 00000100:00100000:0.0:1782759491.220033:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908160 00000100:00100000:0.0:1782759491.220053:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3205 00000100:00100000:0.0:1782759491.220059:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220110:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908160:12345-0@lo:1000:mdt00_003.0 Request processed in 51us (105us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759491.220117:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3205 00000100:00100000:0.0:1782759491.220142:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908160:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220186:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220209:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.220222:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.220233:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908288 00000100:00100000:0.0:1782759491.220242:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908288 00000100:00100000:0.0:1782759491.220262:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3206 00000100:00100000:0.0:1782759491.220267:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220316:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908288:12345-0@lo:1000:mdt00_003.0 Request processed in 47us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759491.220322:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3206 00000100:00100000:0.0:1782759491.220345:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908288:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220379:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220403:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.220416:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.220427:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908416 00000100:00100000:0.0:1782759491.220430:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908416 00000100:00100000:0.0:1782759491.220452:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:0.0:1782759491.220457:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220515:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908416:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759491.220521:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:0.0:1782759491.220691:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908416:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220728:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220765:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.220778:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.220789:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908544 00000100:00100000:0.0:1782759491.220792:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908544 00000100:00100000:0.0:1782759491.220821:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:0.0:1782759491.220828:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908544:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.220881:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908544:12345-0@lo:1000:mdt00_003.0 Request processed in 54us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759491.220894:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:0.0:1782759491.220920:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908544:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.221412:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908672:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.221430:0:8593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.221445:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.221454:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908672 00000100:00100000:0.0:1782759491.221456:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908672 00000100:00100000:0.0:1782759491.221472:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:0.0:1782759491.221477:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1782759491.221618:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:8593:x1869355232908672:12345-0@lo:1000:mdt00_003.0 Request processed in 140us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759491.221624:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:0.0:1782759491.221650:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:8593:1869355232908672:0@lo:1000:mdt00_003.0 00000040:00080000:0.0:1782759491.221769:0:8593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782759491.221902:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1782759491.222091:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].30, 1000 off63760 00000040:00080000:0.0:1782759491.222141:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].31, 1152 off67832 00000004:00080000:0.0:1782759491.222146:0:8593:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc45c3540 with version 62 00000004:00080000:0.0:1782759491.222158:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 62 rpc_version 62 00000020:00100000:0.0:1782759491.222173:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759491.222179:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cded3b87480 x1869355232908928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759491.222189:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232908928:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759491.222211:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759491.222223:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759491.222237:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232908928 00000100:00100000:0.0:1782759491.222240:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232908928 00000100:00100000:0.0:1782759491.222256:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:0.0:1782759491.222260:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232908928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759491.222490:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232908928:12345-0@lo:1000:osp_up0-1.0 Request processed in 227us (275us total) trans 4294967974 rc 0/0 00000100:00100000:0.0:1782759491.222498:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:0.0:1782759491.225844:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232908928:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1782759491.226339:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226356:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226384:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759491.226405:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000452111a5 reply state 0000000004b77265 transno 4294967694 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226417:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226424:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:3.0:1782759491.226428:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759491.226432:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759491.226441:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1b:0x0]: returning size 4096 00000004:00080000:3.0:1782759491.226449:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:3.0:1782759491.226462:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226472:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226479:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226509:0:8593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782759491.226514:0:8593:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:3.0:1782759491.226519:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.226527:0:8593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.226545:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759491.226552:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 2/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.226562:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759491.226568:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759491.226610:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759491.226643:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107518:x1869355218511232:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 11307us (11859us total) trans 4294967694 rc 0/0 00010000:00010000:0.0:1782759491.226643:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.226657:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759491.226659:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2844 00010000:00010000:0.0:1782759491.226677:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 1/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.226684:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dde00/0xd5b45c7f5c60c835 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c83c expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.226712:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759491.226715:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759491.226716:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759491.229845:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232909056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759491.229907:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759491.230397:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909056 00000100:00100000:3.0:1782759491.230405:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909056 00000100:00100000:3.0:1782759491.230522:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1782759491.230533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3664:x1869355232909056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759491.230547:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759491.230570:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c83c lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60c835 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.230607:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502600) 00010000:00010000:3.0:1782759491.230611:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759491.230649:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3664:x1869355232909056:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759491.230658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1782759491.230676:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232909056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759491.238217:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.238343:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218511488 00000100:00100000:1.0:1782759491.238353:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218511488 00000100:00100000:1.0:1782759491.238451:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2845 00000100:00100000:1.0:1782759491.238461:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107519:x1869355218511488:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759491.238482:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759491.238500:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c858 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27361 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.238616:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.238636:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.238647:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.238662:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.238669:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.238675:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759491.239039:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x20:0x0], index 1: 0 00010000:00010000:1.0:1782759491.239216:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c86d lrc: 3/1,0 mode: --/PR res: [0x200000421:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239225:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c86d lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239232:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c86d lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759491.239299:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967975 00010000:00010000:1.0:1782759491.239338:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239346:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239363:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239370:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239376:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759491.239380:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239388:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239400:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502600) 00010000:00010000:1.0:1782759491.239403:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759491.239408:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239414:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c85f lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759491.239425:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d816fff5 reply state 000000001514d0a5 transno 4294967976 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239436:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239442:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe500) 00010000:00010000:1.0:1782759491.239444:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759491.239446:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759491.239473:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c858 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27361 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239494:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c86d lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27361 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.239501:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759491.239503:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759491.239505:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759491.239568:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:107519:x1869355218511488:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1109us (1357us total) trans 4294967976 rc 0/0 00000100:00100000:1.0:1782759491.239594:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2845 00000020:00080000:1.0:1782759491.239599:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782759491.242662:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.242759:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218511744 00000100:00100000:1.0:1782759491.242768:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218511744 00000100:00100000:1.0:1782759491.242811:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2846 00000100:00100000:1.0:1782759491.242819:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:107519:x1869355218511744:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:1.0:1782759491.242868:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759491.242894:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c86d lrc: 0/0,0 mode: --/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27361 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.242910:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759491.242919:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759491.242968:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,1 mode: --/PW res: [0x200000421:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.242981:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.242990:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759491.243128:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023d7e8c0 reply state 0000000066238d05 transno 4294967977 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.243140:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.243146:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:1.0:1782759491.243149:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759491.243151:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759491.243239:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107519:x1869355218511744:12345-192.168.202.31@tcp:36:touch.0 Request processed in 419us (583us total) trans 4294967977 rc 0/0 00000100:00100000:1.0:1782759491.243246:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2846 00000100:00100000:3.0:1782759491.244537:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.245042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218511872 00000100:00100000:1.0:1782759491.245049:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218511872 00000100:00100000:1.0:1782759491.245083:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2847 00000100:00100000:1.0:1782759491.245090:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107519:x1869355218511872:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759491.245106:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759491.245117:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c882 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27368 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.245152:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c882 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27368 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.245161:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c882 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27368 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.245173:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:1.0:1782759491.245179:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759491.245181:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759491.245215:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:107519:x1869355218511872:12345-192.168.202.31@tcp:101:touch.0 Request processed in 125us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759491.245220:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2847 00000100:00100000:2.0:1782759491.249765:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.249849:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512000 00000100:00100000:1.0:1782759491.249859:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512000 00000100:00100000:1.0:1782759491.249921:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1070 00000100:00100000:1.0:1782759491.249937:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218512000:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:1.0:1782759491.250166:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218512000:12345-192.168.202.31@tcp:2:touch.0 Request processed in 235us (410us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1782759491.250175:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1070 00000100:00100000:3.0:1782759491.252052:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759491.252132:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512256 00000100:00100000:1.0:1782759491.252140:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512256 00000100:00100000:1.0:1782759491.252193:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 327 00000100:00100000:1.0:1782759491.252202:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:107519:x1869355218512256:12345-192.168.202.31@tcp:35:touch.0 00000001:00080000:1.0:1782759491.252449:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967978 00000100:00100000:1.0:1782759491.252542:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107519:x1869355218512256:12345-192.168.202.31@tcp:35:touch.0 Request processed in 340us (509us total) trans 4294967979 rc 0/0 00000100:00100000:1.0:1782759491.252550:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 327 00000020:00080000:1.0:1782759491.252554:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00000080:3.0:1782759491.597158:0:147304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa0ad8dd0 20000000:00000080:3.0:1782759491.597175:0:147304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd710000 uarg=0000000000000000 00010000:00010000:3.0:1782759491.597349:0:147304:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1782759491.597381:0:147304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:3.0:1782759491.597384:0:147304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759491.597395:0:147304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c882 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27368 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597426:0:147304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759491.597428:0:147304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759491.597433:0:147304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c812 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27353 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597446:0:147304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502600) 00010000:00010000:3.0:1782759491.597448:0:147304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759491.597452:0:147304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c82e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2735a expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597468:0:147304:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1782759491.597495:0:147304:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759491.597507:0:147304:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759491.597519:0:147304:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759491.597531:0:147304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597544:0:147304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597551:0:147304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597620:0:147304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759491.597634:0:147304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 23 pid: 6526 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759491.597660:0:147304:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc56fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147304:1869355232909184:0@lo:104: 00000100:00100000:3.0:1782759491.597722:0:147304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759491.597776:0:147304:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec32d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759491.597786:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759491.597798:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909184 00000100:00100000:1.0:1782759491.597805:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909184 00000100:00100000:1.0:1782759491.597845:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1782759491.597854:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf851850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:147304:x1869355232909184:12345-0@lo:104: 00010000:00010000:1.0:1782759491.597867:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.597922:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759491.597928:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf851850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:147304:x1869355232909184:12345-0@lo:104: Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759491.597934:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:3.0:1782759491.597942:0:147304:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc56fd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147304:1869355232909184:0@lo:104: 00010000:00010000:0.0:1782759491.597951:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759491.597959:0:147304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.597959:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.597974:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759491.597978:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.597985:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759491.597990:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759491.597994:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759491.598017:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759491.598021:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759491.598049:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759491.598057:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1782759491.598057:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60c7fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c804 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759491.598072:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232909312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759491.598074:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759491.598084:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759491.598086:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759491.598108:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759491.598163:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909312 00000100:00100000:1.0:1782759491.598169:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909312 00010000:00010000:1.0:1782759491.598188:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 24 pid: 6526 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759491.598221:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1782759491.598228:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5714450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232909312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759491.598238:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759491.598244:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 24 pid: 6526 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598253:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 24 pid: 6526 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598264:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60c804 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c7fd expref: 24 pid: 6526 timeout: 3681 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598276:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598283:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598294:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598311:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598326:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598337:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598342:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759491.598346:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598353:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598371:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759491.598380:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759491.598423:0:147304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759491.598429:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5714450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232909312:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (319us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759491.598437:0:147304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759491.598442:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00010000:00010000:3.0:1782759491.598450:0:147304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60c889 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759491.599100:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232909312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759491.914691:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759492.844168:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.844222:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512384 00000100:00100000:2.0:1782759492.844232:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512384 00000100:00080000:3.0:1782759492.844289:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759492.844323:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2848 00000100:00100000:2.0:1782759492.844343:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512384:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759492.844542:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512384:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 209us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.844552:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2848 00000100:00100000:2.0:1782759492.845660:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.845743:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512512 00000100:00100000:1.0:1782759492.845750:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512512 00000100:00100000:1.0:1782759492.845829:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2849 00000100:00100000:1.0:1782759492.845840:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512512:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000040:00080000:1.0:1782759492.845921:0:6531:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1782759492.846004:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512512:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.846013:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2849 00000100:00100000:3.0:1782759492.849381:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759492.849425:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512640 00000100:00100000:3.0:1782759492.849475:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512640 00000100:00100000:3.0:1782759492.849527:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2850 00000100:00100000:3.0:1782759492.849537:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512640:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1782759492.849631:0:8593:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1782759492.849703:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512640:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 167us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.849713:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2850 00000100:00100000:2.0:1782759492.853176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.853272:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512768 00000100:00100000:0.0:1782759492.853282:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512768 00000100:00100000:0.0:1782759492.853343:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2851 00000100:00100000:0.0:1782759492.853354:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512768:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:0.0:1782759492.853430:0:6532:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1782759492.853508:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512768:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 155us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.853516:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2851 00000100:00100000:3.0:1782759492.855395:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.855611:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218512896 00000100:00100000:2.0:1782759492.855621:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218512896 00000100:00100000:2.0:1782759492.855685:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2852 00000100:00100000:2.0:1782759492.855696:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512896:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759492.855804:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218512896:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 110us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.855811:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2852 00000100:00100000:2.0:1782759492.857165:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759492.857219:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513024 00000100:00100000:3.0:1782759492.857226:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513024 00000100:00100000:3.0:1782759492.857277:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2853 00000100:00100000:3.0:1782759492.857286:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218513024:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1782759492.857402:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218513024:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 116us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.857422:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2853 00000100:00100000:3.0:1782759492.858358:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.858403:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513152 00000100:00100000:2.0:1782759492.858410:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513152 00000100:00100000:2.0:1782759492.858459:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2854 00000100:00100000:2.0:1782759492.858470:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218513152:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1782759492.858632:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218513152:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.858642:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2854 00000100:00100000:2.0:1782759492.861693:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759492.861909:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513280 00000100:00100000:3.0:1782759492.861920:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513280 00000100:00100000:3.0:1782759492.861985:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2855 00000100:00100000:3.0:1782759492.861999:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218513280:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1782759492.862143:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107595:x1869355218513280:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.862152:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2855 00000100:00100000:3.0:1782759492.882147:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.882207:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513408 00000100:00100000:0.0:1782759492.882215:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513408 00000100:00100000:0.0:1782759492.882287:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2856 00000100:00100000:0.0:1782759492.882298:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513408:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00080000:3.0:1782759492.882311:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759492.882476:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513408:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 179us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.882484:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2856 00000100:00100000:2.0:1782759492.883846:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.883947:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513536 00000100:00100000:0.0:1782759492.883953:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513536 00000100:00100000:0.0:1782759492.883985:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2857 00000100:00100000:0.0:1782759492.883991:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513536:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1782759492.884063:0:6532:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1782759492.884119:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513536:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 126us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.884126:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2857 00000100:00100000:3.0:1782759492.885468:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.885524:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513664 00000100:00100000:2.0:1782759492.885532:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513664 00000100:00100000:2.0:1782759492.885625:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2858 00000100:00100000:2.0:1782759492.885638:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513664:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1782759492.885709:0:42628:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759492.886069:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513664:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 434us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.886078:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2858 00000100:00100000:3.0:1782759492.887417:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.889182:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513792 00000100:00100000:1.0:1782759492.889196:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513792 00000100:00100000:1.0:1782759492.889263:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2859 00000100:00100000:1.0:1782759492.889274:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513792:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:1.0:1782759492.889364:0:8593:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:1.0:1782759492.889438:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513792:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 164us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.889446:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2859 00000100:00100000:3.0:1782759492.891393:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.891452:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218513920 00000100:00100000:2.0:1782759492.891460:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218513920 00000100:00100000:2.0:1782759492.891520:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2860 00000100:00100000:2.0:1782759492.891531:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513920:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759492.891869:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218513920:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 340us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.891875:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2860 00000100:00100000:3.0:1782759492.895774:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.895912:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514048 00000100:00100000:1.0:1782759492.895920:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514048 00000100:00100000:1.0:1782759492.895965:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2861 00000100:00100000:1.0:1782759492.895972:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218514048:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1782759492.896091:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218514048:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.896099:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2861 00000100:00100000:3.0:1782759492.897605:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.898594:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514176 00000100:00100000:0.0:1782759492.898615:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514176 00000100:00100000:0.0:1782759492.898672:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2862 00000100:00100000:0.0:1782759492.898681:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218514176:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1782759492.898837:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218514176:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 156us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.898846:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2862 00000100:00100000:3.0:1782759492.900979:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.901031:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514304 00000100:00100000:0.0:1782759492.901039:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514304 00000100:00100000:0.0:1782759492.901084:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2863 00000100:00100000:0.0:1782759492.901091:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218514304:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1782759492.901196:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107600:x1869355218514304:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.901202:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2863 00000100:00100000:3.0:1782759492.938242:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.938396:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514432 00000100:00100000:2.0:1782759492.938406:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514432 00000100:00100000:2.0:1782759492.938472:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2864 00000100:00100000:2.0:1782759492.938485:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107609:x1869355218514432:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:2.0:1782759492.938524:0:42628:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff8cdefab97868 uarg=0000000000000000 00000004:00000080:2.0:1782759492.938623:0:42628:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff8cdefab97868 00000004:00000080:2.0:1782759492.938631:0:42628:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:2.0:1782759492.938670:0:42628:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759492.938675:0:42628:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1782759492.938694:0:42628:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 7 00010000:00010000:0.0:1782759492.938701:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782759492.938759:0:42628:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:2.0:1782759492.938769:0:42628:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1782759492.938773:0:42628:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:2.0:1782759492.938789:0:42628:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759492.938792:0:42628:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1782759492.938853:0:42628:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 7 count 1 00000040:00080000:2.0:1782759492.938858:0:42628:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:2.0:1782759492.938954:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107609:x1869355218514432:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 468us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.938963:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2864 00000100:00100000:3.0:1782759492.950048:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.950112:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514560 00000100:00100000:1.0:1782759492.950121:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514560 00000100:00100000:1.0:1782759492.950177:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2865 00000100:00100000:1.0:1782759492.950189:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107611:x1869355218514560:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:1.0:1782759492.950229:0:8593:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff8cdefab97a48 uarg=0000000000000000 00000004:00000080:1.0:1782759492.950272:0:8593:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff8cdefab97a48 00000004:00000080:1.0:1782759492.950280:0:8593:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=2, endrec=0 00000040:00080000:1.0:1782759492.950318:0:8593:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759492.950334:0:8593:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1782759492.950357:0:8593:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl2 endrec = 1 00000040:00080000:1.0:1782759492.950413:0:8593:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:1.0:1782759492.950422:0:8593:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1782759492.950426:0:8593:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:1.0:1782759492.950439:0:8593:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759492.950442:0:8593:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1782759492.950478:0:8593:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1782759492.950483:0:8593:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1782759492.950572:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107611:x1869355218514560:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 385us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.950621:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2865 00000100:00100000:3.0:1782759492.957422:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.957501:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514688 00000100:00100000:0.0:1782759492.957510:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514688 00000100:00100000:0.0:1782759492.957566:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2866 00000100:00100000:0.0:1782759492.957602:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107612:x1869355218514688:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759492.957622:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759492.957644:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c890 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2736f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957703:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957718:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957760:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957773:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957783:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c843 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957792:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 4/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.957823:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c843 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.957840:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232909440:0@lo:104: 00000100:00100000:0.0:1782759492.957885:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759492.957927:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909440 00000100:00100000:2.0:1782759492.957931:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909440 00000100:00100000:0.0:1782759492.957940:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bf4780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759492.957973:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1782759492.957980:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6532:x1869355232909440:12345-0@lo:104: 00010000:00010000:2.0:1782759492.957991:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.958046:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759492.958052:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6532:x1869355232909440:12345-0@lo:104: Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.958060:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00010000:00010000:3.0:1782759492.958071:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759492.958078:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.958086:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759492.958091:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759492.958102:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.958104:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232909440:0@lo:104: 00010000:00010000:0.0:1782759492.958126:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.958137:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.958146:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759492.958179:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 1/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759492.958185:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232909568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759492.958188:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd4dda00/0xd5b45c7f5c60c843 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c84a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.958211:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759492.958214:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759492.958218:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759492.958219:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759492.958240:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909568 00000100:00100000:3.0:1782759492.958249:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909568 00010000:00010000:3.0:1782759492.958265:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c843 expref: 8 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.958285:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:3.0:1782759492.958291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355232909568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759492.958300:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1782759492.959745:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967979 is committed 00000001:00080000:1.0:1782759492.959760:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967974 is committed 00010000:00010000:0.0:1782759492.959788:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959799:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959813:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959819:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759492.959823:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959831:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959845:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe500) 00010000:00010000:3.0:1782759492.959848:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60c84a lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c843 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959850:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759492.959856:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.959862:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34ffa00) 00010000:00010000:0.0:1782759492.959864:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c866 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.959866:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.959882:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.959887:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 4/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959895:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959903:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.959908:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759492.959910:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959916:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759492.959920:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959935:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.959936:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.959949:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959952:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cddc34fe200) 00010000:00010000:0.0:1782759492.959956:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759492.959960:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.959966:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60c87b lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.959974:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232909568:12345-0@lo:103:ldlm_bl.0 Request processed in 1679us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.959983:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:2.0:1782759492.960018:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232909568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759492.960037:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232909696:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782759492.960075:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759492.960096:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759492.960111:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909696 00000100:00100000:0.0:1782759492.960118:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909696 00000100:00100000:0.0:1782759492.960176:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:0.0:1782759492.960185:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6532:x1869355232909696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759492.960255:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6532:x1869355232909696:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.960262:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00000100:00100000:1.0:1782759492.960297:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6532:1869355232909696:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1782759492.960378:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8a5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960387:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960403:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759492.960428:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960442:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960448:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960453:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960459:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960463:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759492.960466:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960471:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960479:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502200) 00010000:00010000:1.0:1782759492.960482:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759492.960485:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960490:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60c897 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960506:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960512:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960516:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960521:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759492.960523:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960528:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960535:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34ffa00) 00010000:00010000:1.0:1782759492.960537:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759492.960539:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960544:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60c89e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960594:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60c890 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2736f expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960613:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2736f expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.960631:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:1.0:1782759492.960634:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759492.960636:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428800, rc 0) 00000100:00100000:1.0:1782759492.960680:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107612:x1869355218514688:12345-192.168.202.31@tcp:101:rm.0 Request processed in 3106us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.960687:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2866 00000100:00100000:2.0:1782759492.962836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.962893:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218514816 00000100:00100000:1.0:1782759492.962902:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218514816 00000100:00100000:1.0:1782759492.962956:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2867 00000100:00100000:1.0:1782759492.962966:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107612:x1869355218514816:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759492.962985:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759492.963003:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c8ac lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27376 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.963060:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c8b3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.963073:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.963084:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c8b3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759492.963129:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1b:0x0]: returning size 4096 00000004:00200000:1.0:1782759492.963131:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759492.963158:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c8ac lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27376 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.963188:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27376 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.963196:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:1.0:1782759492.963199:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759492.963201:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759492.963259:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:107612:x1869355218514816:12345-192.168.202.31@tcp:101:rm.0 Request processed in 293us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.963266:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2867 00000100:00100000:3.0:1782759492.965549:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.965898:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218515072 00000100:00100000:0.0:1782759492.965906:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218515072 00000100:00100000:0.0:1782759492.965957:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2868 00000100:00100000:0.0:1782759492.965968:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:107612:x1869355218515072:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759492.965986:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759492.966041:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c8ba lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2737d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759492.966132:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1b:0x0]: returning size 4096 00010000:00010000:0.0:1782759492.966312:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c8ba lrc: 1/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2737d expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.966339:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502800) 00010000:00010000:0.0:1782759492.966343:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759492.966348:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c8ba lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2737d expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.966367:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:0.0:1782759492.966421:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:107612:x1869355218515072:12345-192.168.202.31@tcp:101:rm.0 Request processed in 455us (878us total) trans 4294967695 rc 301/301 00000100:00100000:0.0:1782759492.966429:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2868 00000100:00100000:3.0:1782759492.968337:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759492.968397:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218515200 00000100:00100000:0.0:1782759492.968405:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218515200 00000100:00100000:0.0:1782759492.968464:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 328 00000100:00100000:0.0:1782759492.968473:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:107612:x1869355218515200:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:0.0:1782759492.975491:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:107612:x1869355218515200:12345-192.168.202.31@tcp:37:rm.0 Request processed in 7009us (7151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.975505:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 328 00000100:00100000:3.0:1782759492.977287:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.977340:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218515456 00000100:00100000:1.0:1782759492.977350:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218515456 00000100:00100000:1.0:1782759492.977401:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 329 00000100:00100000:1.0:1782759492.977412:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:107612:x1869355218515456:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1782759492.977739:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107612:x1869355218515456:12345-192.168.202.31@tcp:35:rm.0 Request processed in 329us (456us total) trans 4294967696 rc 0/0 00000100:00100000:1.0:1782759492.977748:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 329 00000100:00100000:3.0:1782759492.979198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.979251:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218515840 00000100:00100000:2.0:1782759492.979257:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218515840 00000100:00100000:2.0:1782759492.979310:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2869 00000100:00100000:2.0:1782759492.979319:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107612:x1869355218515840:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1782759492.979354:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759492.979383:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c8b3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27376 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.979398:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:2.0:1782759492.979402:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759492.979454:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.979465:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.979475:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759492.979493:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232909824:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1782759492.979531:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759492.979560:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759492.979600:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909824 00000100:00100000:3.0:1782759492.979617:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909824 00000100:00100000:3.0:1782759492.979682:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3212 00000100:00100000:3.0:1782759492.979690:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355232909824:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1782759492.979703:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759492.979716:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c8cf lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c8c8 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.979752:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c8cf lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8c8 expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.979765:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c8cf lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8c8 expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.979772:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4500) 00010000:00010000:3.0:1782759492.979775:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759492.979777:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759492.979816:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355232909824:12345-0@lo:101:mdt00_004.0 Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.979823:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3212 00000100:00100000:2.0:1782759492.979845:0:12673:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967974 gen 2 00000004:00080000:2.0:1782759492.979852:0:12673:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967974 committed transno 4294967974 00000100:00100000:2.0:1782759492.979874:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232909824:0@lo:101:mdt00_004.0 00010000:00010000:2.0:1782759492.979889:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.979900:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759492.979921:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:2.0:1782759492.979939:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.979946:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.979955:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.979964:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759492.979968:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232909952:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1782759492.979999:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759492.980020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218515584 00000100:00100000:1.0:1782759492.980025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218515584 00000100:00100000:2.0:1782759492.980026:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759492.980060:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 394 00000100:00100000:1.0:1782759492.980068:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218515584:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:1.0:1782759492.980079:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782759492.980080:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232909952 00000100:00100000:0.0:1782759492.980085:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232909952 00010000:00010000:1.0:1782759492.980094:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8a5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2736f expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.980108:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:1.0:1782759492.980122:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759492.980157:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218515584:12345-192.168.202.31@tcp:103:rm.0 Request processed in 91us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.980162:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 394 00000100:00100000:0.0:1782759492.980323:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:0.0:1782759492.980332:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355232909952:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1782759492.980339:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759492.980350:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c8d6 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.980364:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8d6 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.980380:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8d6 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.980387:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:0.0:1782759492.980390:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759492.980392:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759492.980428:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355232909952:12345-0@lo:101:mdt00_004.0 Request processed in 98us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.980433:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:3.0:1782759492.980460:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232909952:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1782759492.980473:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.980483:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759492.980496:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00000100:00100000:3.0:1782759492.980534:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232910080:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782759492.980561:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759492.980598:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759492.980671:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910080 00000100:00100000:1.0:1782759492.980676:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910080 00000100:00100000:1.0:1782759492.980709:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:1.0:1782759492.980714:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355232910080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759492.980910:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355232910080:12345-0@lo:1000:mdt00_004.0 Request processed in 195us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.980917:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1782759492.980945:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232910080:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782759492.980987:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232910208:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782759492.981009:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759492.981031:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759492.981047:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910208 00000100:00100000:0.0:1782759492.981052:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910208 00000100:00100000:0.0:1782759492.981084:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:0.0:1782759492.981090:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355232910208:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1782759492.981159:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355232910208:12345-0@lo:1000:mdt00_004.0 Request processed in 70us (149us total) trans 0 rc 1/1 00000100:00100000:0.0:1782759492.981166:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00100000:3.0:1782759492.981192:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232910208:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1782759492.981227:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.981235:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.981242:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.981252:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232910336:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1782759492.981274:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759492.981294:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759492.981617:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910336 00000100:00100000:1.0:1782759492.981621:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910336 00000100:00100000:1.0:1782759492.981644:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:1.0:1782759492.981649:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355232910336:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759492.981656:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759492.981666:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c8eb lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c8e4 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.981681:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c8eb lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8e4 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.981691:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c8eb lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8e4 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.981698:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cdecd4e3b00) 00010000:00010000:1.0:1782759492.981701:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759492.981709:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759492.981750:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:12673:x1869355232910336:12345-0@lo:101:mdt00_004.0 Request processed in 100us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.981757:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:3.0:1782759492.981798:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355232910336:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1782759492.981811:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.981820:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.981840:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.981855:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.981864:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759492.982169:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].31, 672 off64432 00000040:00080000:3.0:1782759492.982214:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].32, 752 off68584 00000004:00080000:3.0:1782759492.982220:0:12673:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc45c39c0 with version 63 00000004:00080000:0.0:1782759492.982661:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 63 rpc_version 63 00000020:00100000:0.0:1782759492.982685:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759492.982692:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cded3b86680 x1869355232910592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2000/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759492.982707:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232910592:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759492.982749:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759492.982767:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bf4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759492.982827:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910592 00000100:00100000:1.0:1782759492.982831:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910592 00000100:00100000:1.0:1782759492.982855:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217 00000100:00100000:1.0:1782759492.982861:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232910592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759492.983115:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232910592:12345-0@lo:1000:osp_up0-1.0 Request processed in 253us (365us total) trans 4294967980 rc 0/0 00000100:00100000:1.0:1782759492.983124:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217 00000100:00100000:2.0:1782759492.983150:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232910592:0@lo:1000:osp_up0-1.0 00000004:00200000:3.0:1782759492.983193:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1b:0x0]: returning size 4096 00010000:00010000:3.0:1782759492.983210:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983218:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983224:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983230:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759492.983234:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983241:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983252:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:3.0:1782759492.983255:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759492.983259:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983274:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c8f2 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983285:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983293:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983300:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983322:0:12673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782759492.983331:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:3.0:1782759492.983335:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983341:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983347:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983419:0:12673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1782759492.983424:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:3.0:1782759492.983429:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.983446:0:12673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759492.983503:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107612:x1869355218515840:12345-192.168.202.31@tcp:36:rm.0 Request processed in 4183us (4307us total) trans 4294967697 rc 0/0 00000100:00100000:3.0:1782759492.983511:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2869 00010000:00010000:1.0:1782759492.983664:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782759492.983671:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.983681:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759492.983686:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759492.983695:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983713:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759492.983718:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983731:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 2/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983750:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759492.983755:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759492.983762:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983791:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.983792:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759492.983801:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759492.983817:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 1/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983819:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 1/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983836:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648a00/0xd5b45c7f5c60c8c8 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c8cf expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759492.983838:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232910848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759492.983859:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60c8e4 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60c8eb expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759492.983865:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759492.983869:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759492.983873:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759492.983877:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759492.983882:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759492.983883:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759492.983885:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759492.983927:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232910720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759492.983948:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910848 00000100:00100000:0.0:1782759492.983953:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910848 00000100:00100000:2.0:1782759492.983956:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759492.983992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910720 00000100:00100000:2.0:1782759492.983995:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910720 00000100:00100000:0.0:1782759492.983996:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1782759492.984006:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3664:x1869355232910848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759492.984016:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759492.984032:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c8cf lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8c8 expref: 11 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759492.984034:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1782759492.984044:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3663:x1869355232910720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759492.984053:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759492.984061:0:140594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4500) 00010000:00010000:0.0:1782759492.984070:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759492.984074:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c8eb lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8e4 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759492.984096:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cdecd4e3b00) 00010000:00010000:2.0:1782759492.984102:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759492.984103:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3664:x1869355232910848:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759492.984111:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1782759492.984132:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232910720:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759492.984137:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1782759492.984170:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232910720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759492.984196:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232910848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759492.990986:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.991045:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218515968 00000100:00100000:1.0:1782759492.991054:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218515968 00000100:00100000:1.0:1782759492.991118:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2870 00000100:00100000:1.0:1782759492.991128:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:107612:x1869355218515968:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759492.991152:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759492.991174:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8f9 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27384 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991247:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991260:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991271:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991285:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991292:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991317:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991391:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991400:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991417:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759492.991460:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x18:0x0]: returning size 0 00000004:00200000:1.0:1782759492.991465:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759492.991483:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991495:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991504:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991511:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991517:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991524:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991540:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759492.991545:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991552:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991564:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:1.0:1782759492.991568:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759492.991572:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991608:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c900 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991621:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991639:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991645:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991650:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759492.991653:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991659:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991678:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cdecd4e3800) 00010000:00010000:1.0:1782759492.991681:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759492.991684:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991690:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c907 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991718:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c8f9 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27384 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991747:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27384 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.991754:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cdecd4e3000) 00010000:00010000:1.0:1782759492.991757:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759492.991759:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759492.991824:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107612:x1869355218515968:12345-192.168.202.31@tcp:101:rm.0 Request processed in 697us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759492.991831:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2870 00000100:00100000:2.0:1782759492.996050:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759492.996142:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218516096 00000100:00100000:3.0:1782759492.996151:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218516096 00000100:00100000:3.0:1782759492.996276:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1071 00000100:00100000:3.0:1782759492.996286:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218516096:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759492.996302:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759492.996319:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2738b expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759492.996341:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x6a42c044, atime: 0x6a42c044, ctime: 0x6a42c044, blocks: 0x0 00010000:00010000:3.0:1782759492.996358:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=3533s v=(0 0) 00010000:00010000:3.0:1782759492.996362:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759492.996369:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.996382:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.996391:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759492.996454:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218516096:12345-192.168.202.31@tcp:101:rm.0 Request processed in 169us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759492.996465:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1071 00000100:00080000:2.0:1782759492.996509:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759492.998292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759492.998378:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218516352 00000100:00100000:1.0:1782759492.998386:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218516352 00000100:00100000:1.0:1782759492.998491:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2871 00000100:00100000:1.0:1782759492.998501:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:107612:x1869355218516352:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1782759492.998545:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759492.998568:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c90e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27384 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998628:0:8593:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60c882) 00010000:00010000:1.0:1782759492.998633:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cdecd4e3000) 00010000:00010000:1.0:1782759492.998642:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759492.998661:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998672:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998680:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998690:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998696:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998701:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998786:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 3/0,1 mode: --/EX res: [0x200000421:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998794:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.998801:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759492.999024:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off10080 00000004:00080000:1.0:1782759492.999041:0:8593:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3533275462607ns, next at 3534275460950ns, rc = 0 00010000:00010000:1.0:1782759492.999136:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999144:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999151:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999158:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999163:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999169:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999184:0:8593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759492.999202:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999209:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.999213:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759492.999220:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999226:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.999235:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759492.999237:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759492.999242:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999243:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.999262:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999289:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.999291:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cdecd4e3300) 00010000:00010000:3.0:1782759492.999298:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782759492.999302:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 1/0,0 mode: --/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.999313:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60c931 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x18:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999316:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x18:0x0].0x0 (ffff8cdecd4e3300) 00010000:00010000:1.0:1782759492.999321:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782759492.999325:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 2/0,0 mode: --/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759492.999327:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759492.999330:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759492.999334:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759492.999334:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c92a lrc: 0/0,0 mode: --/EX res: [0x200000421:0x18:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999356:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999361:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999365:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999371:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999376:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759492.999378:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999384:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999392:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3600) 00010000:00010000:1.0:1782759492.999400:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759492.999403:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999418:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60c91c lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759492.999429:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008267ef5b reply state 0000000047d0fe0f transno 4294967981 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999437:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759492.999441:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cdecd4e3d00) 00010000:00010000:1.0:1782759492.999443:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759492.999445:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759492.999501:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107612:x1869355218516352:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1002us (1213us total) trans 4294967981 rc 0/0 00000100:00100000:1.0:1782759492.999506:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2871 10000000:01000000:3.0:1782759493.130712:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759493.130754:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759493.130759:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759493.130807:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.130839:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.130851:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759493.130877:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232910976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759493.130945:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759493.131016:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759493.131020:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232910976 00000100:00100000:0.0:1782759493.131029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232910976 00000100:00100000:0.0:1782759493.131086:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:0.0:1782759493.131096:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232910976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759493.131112:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759493.131126:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60c938 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.131149:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.131159:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.131169:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dda00, rc 0) 00000100:00100000:0.0:1782759493.131216:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232910976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759493.131224:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:3.0:1782759493.131251:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232910976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759493.131267:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.131276:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759493.131295:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759493.131300:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.131307:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759493.338989:0:147499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6192cfb0 20000000:00000080:1.0:1782759493.339003:0:147499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc24c6800 uarg=0000000000000000 00010000:00010000:1.0:1782759493.339189:0:147499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759493.339203:0:147499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759493.339222:0:147499:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759493.339232:0:147499:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759493.339246:0:147499:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759493.339263:0:147499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.339279:0:147499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.339293:0:147499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.339326:0:147499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759493.339338:0:147499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 23 pid: 6524 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759493.339351:0:147499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147499:1869355232911104:0@lo:104: 00000100:00100000:1.0:1782759493.339404:0:147499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759493.339454:0:147499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759493.339510:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232911104 00000100:00100000:3.0:1782759493.339517:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232911104 00000100:00100000:3.0:1782759493.339602:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1782759493.339612:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:147499:x1869355232911104:12345-0@lo:104: 00010000:00010000:3.0:1782759493.339631:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.339685:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759493.339691:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:147499:x1869355232911104:12345-0@lo:104: Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759493.339698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00010000:00010000:0.0:1782759493.339729:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759493.339734:0:147499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147499:1869355232911104:0@lo:104: 00010000:00010000:0.0:1782759493.339738:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759493.339754:0:147499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.339761:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759493.339766:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.339774:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759493.339782:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759493.339788:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759493.339820:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.339827:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759493.339853:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759493.339857:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232911232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759493.339862:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60c938 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c93f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759493.339878:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759493.339881:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759493.339883:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759493.339892:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759493.339927:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232911232 00000100:00100000:3.0:1782759493.339931:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232911232 00010000:00010000:3.0:1782759493.339950:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 24 pid: 6524 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759493.339976:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:3.0:1782759493.339982:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232911232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759493.339992:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759493.339996:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 24 pid: 6524 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340007:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 24 pid: 6524 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340018:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dda00/0xd5b45c7f5c60c93f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c938 expref: 24 pid: 6524 timeout: 3683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340029:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340037:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340057:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340064:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340071:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340077:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340083:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759493.340086:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340093:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340106:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759493.340114:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759493.340135:0:147499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759493.340145:0:147499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759493.340147:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232911232:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (254us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759493.340161:0:147499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60c946 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759493.340162:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:0.0:1782759493.340187:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232911232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759493.515966:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759493.515988:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232911360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759493.516061:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759493.516126:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232911360 00000100:00100000:2.0:1782759493.516134:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232911360 00000100:00100000:2.0:1782759493.516223:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:2.0:1782759493.516236:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232911360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759493.516275:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445883904 avail 1299644416 00000100:00100000:2.0:1782759493.516349:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232911360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759493.516357:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00100000:0.0:1782759493.516393:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232911360:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759493.962703:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759494.511820:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759494.511875:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218516608 00000100:00100000:1.0:1782759494.511884:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218516608 00000100:00080000:2.0:1782759494.511929:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759494.511948:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2872 00000100:00100000:1.0:1782759494.511960:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107685:x1869355218516608:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782759494.512082:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.512096:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.512106:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.512118:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.512140:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c8d6 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.512149:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 4/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.512189:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c8d6 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.512206:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232911488:0@lo:104: 00000100:00100000:1.0:1782759494.512259:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.512325:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759494.512330:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232911488 00000100:00100000:3.0:1782759494.512335:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232911488 00000100:00100000:3.0:1782759494.512374:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1782759494.512386:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6532:x1869355232911488:12345-0@lo:104: 00010000:00010000:3.0:1782759494.512396:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.512451:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759494.512458:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6532:x1869355232911488:12345-0@lo:104: Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759494.512464:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00010000:00010000:3.0:1782759494.512488:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759494.512494:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.512502:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759494.512507:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759494.512516:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.512539:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.512545:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759494.512570:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 1/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.512597:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60c8d6 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c8dd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.512619:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232911616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759494.512624:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6532:1869355232911488:0@lo:104: 00010000:00010000:3.0:1782759494.512625:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759494.512630:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759494.512645:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.512648:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759494.512661:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.512697:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232911616 00000100:00100000:1.0:1782759494.512702:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232911616 00010000:00010000:1.0:1782759494.512732:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c8d6 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.512751:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1782759494.512757:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232911616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759494.512766:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:0.0:1782759494.514674:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967981 is committed 00000004:00080000:0.0:1782759494.514684:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000001:00080000:0.0:1782759494.514700:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967980 is committed 00010000:00010000:2.0:1782759494.514724:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.514737:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.514744:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.514751:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759494.514756:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.514764:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.514777:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cdecd4e3d00) 00010000:00010000:2.0:1782759494.514781:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759494.514786:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.514806:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c923 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759494.514833:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232911744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782759494.514871:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60c8dd lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c8d6 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759494.514889:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759494.514895:0:140594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:1.0:1782759494.514899:0:140594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.514906:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.514918:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.514936:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232911744 00010000:00010000:1.0:1782759494.514941:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759494.514944:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232911744 00000100:00080000:0.0:1782759494.514978:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759494.514990:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232911616:12345-0@lo:103:ldlm_bl.0 Request processed in 2232us (2329us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.514999:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1782759494.515001:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1782759494.515026:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232911744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1782759494.515043:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782759494.515049:0:82628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:32 count 1 00010000:00010000:1.0:1782759494.515052:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.515067:0:82628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.515082:0:82628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.515090:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782759494.515094:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759494.515098:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.515123:0:82628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 6 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.515136:0:82628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 6 pid: 8446 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.515148:0:82628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:82628:1869355232911872:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759494.515218:0:82628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759494.515255:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232911616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759494.515603:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515613:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515621:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759494.515642:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093de4ba4 reply state 000000005cd2c391 transno 4294967982 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515660:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515667:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x19:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:1.0:1782759494.515670:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759494.515672:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759494.515677:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x19:0x0]: returning size 4096 00010000:00010000:1.0:1782759494.515686:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515693:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515698:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515705:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515720:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759494.515724:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515732:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515740:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3000) 00010000:00010000:1.0:1782759494.515742:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759494.515745:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515760:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c94d lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759494.515774:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093de4ba4 reply state 000000005cd2c391 transno 4294967982 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515783:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.515789:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:1.0:1782759494.515791:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759494.515793:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1782759494.515853:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107685:x1869355218516608:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 3896us (4040us total) trans 4294967982 rc 0/0 00000100:00100000:1.0:1782759494.515865:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2872 00000100:00100000:2.0:1782759494.517959:0:82628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:82628:1869355232911872:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759494.517972:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:2.0:1782759494.518002:0:82628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.518041:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218516736 00000100:00100000:2.0:1782759494.518046:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218516736 00010000:00010000:2.0:1782759494.518092:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 7 pid: 8446 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759494.518096:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759494.518130:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 792 00000100:00100000:2.0:1782759494.518142:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5715850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218516736:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759494.518157:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759494.518163:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 7 pid: 8446 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.518182:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 7 pid: 8446 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.518204:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b294c40/0xd5b45c7f5c60c915 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2738b expref: 7 pid: 8446 timeout: 3634 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.518217:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759494.518221:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759494.518233:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.518242:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.518279:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759494.518307:0:82628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518319:0:82628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.518327:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5715850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218516736:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 186us (357us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759494.518331:0:82628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.518339:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 792 00010000:00010000:0.0:1782759494.518345:0:82628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518365:0:82628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782759494.518530:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232911744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3522us (3644us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1782759494.518539:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000004:00080000:2.0:1782759494.518555:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4ddb480/2, rc 0, transno 4294967408 00010000:00010000:0.0:1782759494.518562:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759494.518564:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232911744:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782759494.518569:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518609:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759494.518615:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518623:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518636:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518651:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60c95b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.518671:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759494.518673:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759494.518675:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759494.521841:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.521897:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218516992 00000100:00100000:3.0:1782759494.521907:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218516992 00000100:00100000:3.0:1782759494.521969:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2873 00000100:00100000:3.0:1782759494.521982:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:107686:x1869355218516992:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759494.522008:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759494.522043:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c969 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27392 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522155:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522169:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522181:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522195:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522202:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522209:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759494.522501:0:42628:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x21:0x0], index 0: 0 00010000:00010000:3.0:1782759494.522642:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60c97e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522649:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60c97e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522655:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60c97e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759494.522706:0:42628:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967983 00010000:00010000:3.0:1782759494.522748:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522754:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522758:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522769:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522776:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759494.522780:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522787:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522799:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4400) 00010000:00010000:3.0:1782759494.522808:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759494.522813:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522821:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c970 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759494.522831:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002e29ee07 reply state 000000000b1cfee0 transno 4294967984 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522839:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522843:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34f4800) 00010000:00010000:3.0:1782759494.522845:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759494.522847:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759494.522869:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c969 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27392 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522880:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60c97e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27392 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.522885:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759494.522886:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759494.522888:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:3.0:1782759494.522939:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:107686:x1869355218516992:12345-192.168.202.31@tcp:101:touch.0 Request processed in 962us (1107us total) trans 4294967984 rc 0/0 00000100:00100000:3.0:1782759494.522945:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2873 00000020:00080000:3.0:1782759494.522948:0:42628:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782759494.526722:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759494.526770:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218517248 00000100:00100000:0.0:1782759494.526781:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218517248 00000100:00100000:0.0:1782759494.526838:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2874 00000100:00100000:0.0:1782759494.526850:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:107686:x1869355218517248:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:0.0:1782759494.526894:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759494.526916:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60c97e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27392 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.526932:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:0.0:1782759494.526948:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759494.526996:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.527010:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.527033:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759494.527163:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064ec829b reply state 00000000bf157683 transno 4294967985 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.527175:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.527181:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:0.0:1782759494.527185:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759494.527188:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759494.527282:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107686:x1869355218517248:12345-192.168.202.31@tcp:36:touch.0 Request processed in 433us (580us total) trans 4294967985 rc 0/0 00000100:00100000:0.0:1782759494.527294:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2874 00000100:00100000:1.0:1782759494.530757:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.530799:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218517376 00000100:00100000:3.0:1782759494.530810:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218517376 00000100:00100000:3.0:1782759494.530863:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2875 00000100:00100000:3.0:1782759494.530875:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:107686:x1869355218517376:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759494.530900:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759494.530916:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c993 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27399 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.530959:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c993 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27399 expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.530973:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c993 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27399 expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.530992:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:3.0:1782759494.530995:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759494.530999:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759494.531063:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:107686:x1869355218517376:12345-192.168.202.31@tcp:101:touch.0 Request processed in 190us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759494.531070:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2875 00000100:00100000:3.0:1782759494.532490:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759494.532534:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218517504 00000100:00100000:1.0:1782759494.532542:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218517504 00000100:00080000:0.0:1782759494.532614:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759494.532664:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1073 00000100:00100000:1.0:1782759494.532676:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218517504:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:1.0:1782759494.532903:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218517504:12345-192.168.202.31@tcp:2:touch.0 Request processed in 230us (415us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1782759494.532911:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1073 00000100:00100000:0.0:1782759494.534069:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.534120:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218517760 00000100:00100000:3.0:1782759494.534131:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218517760 00000100:00100000:3.0:1782759494.534182:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 330 00000100:00100000:3.0:1782759494.534193:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:107686:x1869355218517760:12345-192.168.202.31@tcp:35:touch.0 00000001:00080000:3.0:1782759494.534451:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967986 00000100:00100000:3.0:1782759494.534542:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107686:x1869355218517760:12345-192.168.202.31@tcp:35:touch.0 Request processed in 351us (475us total) trans 4294967987 rc 0/0 00000100:00100000:3.0:1782759494.534557:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 330 00000020:00080000:3.0:1782759494.534562:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782759494.538734:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232912000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.538762:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232912128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.538771:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232912384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.538806:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759494.538810:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232912256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.538822:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759494.538935:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.538946:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232912512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.538946:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232912896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759494.538951:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912000 00000100:00100000:2.0:1782759494.538959:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912000 00000100:00100000:3.0:1782759494.538974:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232912640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.538980:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.538983:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.539005:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232913024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539017:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759494.539021:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912384 00000100:00100000:2.0:1782759494.539024:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:0.0:1782759494.539038:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912384 00000100:00100000:1.0:1782759494.539039:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759494.539040:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232912000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539045:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232913152:0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.539073:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912128 00000100:00100000:1.0:1782759494.539078:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912128 00000100:00100000:3.0:1782759494.539084:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759494.539097:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:0.0:1782759494.539106:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232912384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.539109:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912512 00000100:00100000:1.0:1782759494.539112:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912512 00000100:00100000:2.0:1782759494.539114:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232912000:12345-0@lo:400:kworker.0 Request processed in 80us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.539124:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00100000:3.0:1782759494.539135:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912640 00000100:00100000:1.0:1782759494.539140:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5018 00000100:00100000:3.0:1782759494.539142:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912640 00000100:00100000:1.0:1782759494.539150:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232912128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.539153:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232912384:12345-0@lo:400:kworker.0 Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759494.539160:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:3.0:1782759494.539172:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913024 00000100:00100000:2.0:1782759494.539172:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759494.539177:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913024 00000100:00100000:0.0:1782759494.539188:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912896 00000100:00100000:0.0:1782759494.539193:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912896 00000100:00100000:1.0:1782759494.539196:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232912128:12345-0@lo:400:kworker.0 Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.539200:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232912768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.539208:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5018 00000100:00100000:3.0:1782759494.539216:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913152 00000100:00100000:3.0:1782759494.539221:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913152 00000100:00100000:1.0:1782759494.539224:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912256 00000100:00100000:0.0:1782759494.539225:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1782759494.539228:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912256 00000100:00100000:0.0:1782759494.539237:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232912896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759494.539238:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.539247:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019 00000100:00100000:1.0:1782759494.539254:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232912512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539268:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5020 00000100:00100000:2.0:1782759494.539271:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232913280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539283:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232912640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.539284:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232912512:12345-0@lo:400:kworker.0 Request processed in 31us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759494.539284:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232912896:12345-0@lo:400:kworker.0 Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.539297:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019 00000100:00100000:0.0:1782759494.539297:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1782759494.539303:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.539316:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5021 00000100:00100000:0.0:1782759494.539322:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232912768 00000100:00100000:1.0:1782759494.539325:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232913024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.539325:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232912768 00000100:00100000:3.0:1782759494.539340:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232912640:12345-0@lo:400:kworker.0 Request processed in 62us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759494.539349:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5020 00000100:00100000:0.0:1782759494.539353:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913280 00000100:00100000:0.0:1782759494.539357:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913280 00000100:00100000:2.0:1782759494.539366:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:1.0:1782759494.539366:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232913024:12345-0@lo:400:kworker.0 Request processed in 40us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759494.539374:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5022 00000100:00100000:2.0:1782759494.539383:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232912768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.539383:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5021 00000100:00100000:3.0:1782759494.539385:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232912256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.539395:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1782759494.539401:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5023 00000100:00100000:0.0:1782759494.539404:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232913280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.539408:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232913152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759494.539441:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232912768:12345-0@lo:400:kworker.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.539448:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232913152:12345-0@lo:400:kworker.0 Request processed in 39us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.539455:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:0.0:1782759494.539457:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232913280:12345-0@lo:400:kworker.0 Request processed in 42us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.539460:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5023 00000100:00100000:0.0:1782759494.539464:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00080000:1.0:1782759494.539488:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759494.539493:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759494.539495:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759494.539498:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759494.539505:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232912768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.539507:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232912896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759494.539527:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232913280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.539531:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232912384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539545:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232912256:12345-0@lo:400:kworker.0 Request processed in 160us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759494.539553:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5022 00000100:00100000:2.0:1782759494.539567:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232912256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539621:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232912640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539649:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232913152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759494.539661:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232912128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759494.539758:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232913408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759494.539785:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759494.539893:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232912512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759494.539904:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232913024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759494.539912:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232912000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759494.540073:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913408 00000100:00100000:1.0:1782759494.540078:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913408 00000100:00100000:1.0:1782759494.540113:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1782759494.540120:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232913408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759494.540140:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759494.540176:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232913408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.540183:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1782759494.540204:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232913408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759494.549415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759494.549466:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218517888 00000100:00100000:1.0:1782759494.549474:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218517888 00000100:00100000:1.0:1782759494.549536:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2876 00000100:00100000:1.0:1782759494.549545:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107690:x1869355218517888:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1782759494.549635:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107690:x1869355218517888:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 91us (236us total) trans 0 rc -13/-13 00000100:00100000:1.0:1782759494.549640:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2876 00000100:00100000:1.0:1782759494.567303:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.567409:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218518016 00000100:00100000:3.0:1782759494.567419:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218518016 00000100:00080000:1.0:1782759494.567473:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759494.567500:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2877 00000100:00100000:3.0:1782759494.567511:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107693:x1869355218518016:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1782759494.567638:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107693:x1869355218518016:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 128us (343us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759494.567649:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2877 00000100:00100000:0.0:1782759494.594461:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.594543:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218518144 00000100:00100000:3.0:1782759494.594551:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218518144 00000100:00100000:3.0:1782759494.594619:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2878 00000100:00100000:3.0:1782759494.594630:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107700:x1869355218518144:12345-192.168.202.31@tcp:46:lfs.0 00000100:00100000:3.0:1782759494.594722:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107700:x1869355218518144:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 83us (258us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759494.594730:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2878 00000100:00100000:1.0:1782759494.606883:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759494.606955:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218518272 00000100:00100000:2.0:1782759494.606964:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218518272 00000100:00100000:2.0:1782759494.607030:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2879 00000100:00100000:2.0:1782759494.607042:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107702:x1869355218518272:12345-192.168.202.31@tcp:46:lfs.0 00000100:00100000:2.0:1782759494.607141:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:107702:x1869355218518272:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 101us (266us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759494.607149:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2879 00000100:00100000:1.0:1782759494.616983:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759494.617048:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218518400 00000100:00100000:0.0:1782759494.617059:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218518400 00000100:00100000:0.0:1782759494.617119:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2880 00000100:00100000:0.0:1782759494.617129:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:107703:x1869355218518400:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759494.617149:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759494.617181:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c99a lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273a0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617240:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617254:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617265:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617276:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617284:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617291:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617355:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c9af lrc: 3/1,0 mode: --/PR res: [0x200000421:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617363:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c9af lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617381:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c9af lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759494.617421:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x19:0x0]: returning size 4096 00000004:00200000:0.0:1782759494.617425:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759494.617457:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c9af lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617470:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617476:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617483:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617489:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617495:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759494.617503:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617510:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617523:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2200) 00010000:00010000:0.0:1782759494.617526:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759494.617530:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617546:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60c9a1 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617559:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617566:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617572:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617623:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759494.617626:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617632:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617640:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:0.0:1782759494.617643:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759494.617646:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617653:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60c9a8 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617680:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c99a lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273a0 expref: 17 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617727:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c9af lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273a0 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.617735:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x19:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:0.0:1782759494.617737:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759494.617739:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc400, rc 0) 00000100:00100000:0.0:1782759494.617795:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:107703:x1869355218518400:12345-192.168.202.31@tcp:101:rm.0 Request processed in 667us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759494.617802:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2880 00000100:00100000:0.0:1782759494.619415:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.619490:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218518656 00000100:00100000:3.0:1782759494.619498:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218518656 00000100:00100000:3.0:1782759494.619563:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2881 00000100:00100000:3.0:1782759494.619570:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:107703:x1869355218518656:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759494.619604:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759494.619620:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c9b6 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273a7 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759494.619717:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x19:0x0]: returning size 4096 00010000:00010000:3.0:1782759494.619865:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c9b6 lrc: 1/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273a7 expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.619874:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4400) 00010000:00010000:3.0:1782759494.619876:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759494.619878:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60c9b6 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273a7 expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.619888:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5a00, rc 0) 00000100:00100000:3.0:1782759494.619928:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:107703:x1869355218518656:12345-192.168.202.31@tcp:101:rm.0 Request processed in 359us (517us total) trans 4294967988 rc 301/301 00000100:00100000:3.0:1782759494.619932:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2881 00000100:00100000:1.0:1782759494.621870:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.621928:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218518784 00000100:00100000:3.0:1782759494.621937:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218518784 00000100:00100000:3.0:1782759494.621981:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 331 00000100:00100000:3.0:1782759494.621992:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9345450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:107703:x1869355218518784:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:3.0:1782759494.624192:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9345450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:107703:x1869355218518784:12345-192.168.202.31@tcp:37:rm.0 Request processed in 2196us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759494.624206:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 331 00000100:00100000:0.0:1782759494.626019:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.626109:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218519040 00000100:00100000:3.0:1782759494.626119:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218519040 00000100:00100000:3.0:1782759494.626196:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 332 00000100:00100000:3.0:1782759494.626206:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:107703:x1869355218519040:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:3.0:1782759494.626492:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:107703:x1869355218519040:12345-192.168.202.31@tcp:35:rm.0 Request processed in 286us (480us total) trans 4294967989 rc 0/0 00000100:00100000:3.0:1782759494.626518:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 332 00000100:00100000:1.0:1782759494.628441:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759494.628489:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218519296 00000100:00100000:3.0:1782759494.628497:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218519296 00000100:00100000:3.0:1782759494.628535:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2882 00000100:00100000:3.0:1782759494.628541:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:107703:x1869355218519296:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1782759494.628620:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759494.628647:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60c9af lrc: 0/0,0 mode: --/PR res: [0x200000421:0x19:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273a0 expref: 18 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628667:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x19:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:3.0:1782759494.628672:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759494.628717:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628730:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628737:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628746:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628752:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628759:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628840:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628846:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.628850:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759494.629097:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x19:0x0]: returning size 4096 00010000:00010000:3.0:1782759494.629113:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629119:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629125:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629131:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759494.629135:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629143:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629152:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x19:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:3.0:1782759494.629156:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759494.629160:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629176:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60c9d2 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x19:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629192:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629198:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629202:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629208:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629213:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759494.629216:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629222:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629230:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4d00) 00010000:00010000:3.0:1782759494.629233:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759494.629235:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629241:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60c9c4 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759494.629255:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000070e9658b reply state 0000000034318a4f transno 4294967990 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629272:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.629278:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:3.0:1782759494.629281:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759494.629284:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759494.629345:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:107703:x1869355218519296:12345-192.168.202.31@tcp:36:rm.0 Request processed in 802us (910us total) trans 4294967990 rc 0/0 00000100:00100000:3.0:1782759494.629352:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2882 00000100:00100000:3.0:1782759494.630790:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759494.630855:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218519424 00000100:00100000:1.0:1782759494.630864:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218519424 00000100:00100000:1.0:1782759494.630917:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2883 00000100:00100000:1.0:1782759494.630927:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:107703:x1869355218519424:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759494.630957:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759494.630976:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c9d9 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273ae expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631038:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631050:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631060:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631070:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631077:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631083:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631145:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631154:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631180:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759494.631218:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1a:0x0]: returning size 0 00000004:00200000:1.0:1782759494.631221:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759494.631236:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631244:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631249:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631253:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631257:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631261:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631264:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759494.631267:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631271:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631277:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3000) 00010000:00010000:1.0:1782759494.631284:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759494.631286:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631290:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60c9e0 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631302:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631313:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631319:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631323:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759494.631326:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631332:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631340:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34f4800) 00010000:00010000:1.0:1782759494.631341:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759494.631344:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631347:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60c9e7 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631364:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60c9d9 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ae expref: 21 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631381:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ae expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.631386:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:1.0:1782759494.631387:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759494.631389:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759494.631429:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:107703:x1869355218519424:12345-192.168.202.31@tcp:101:rm.0 Request processed in 505us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759494.631434:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2883 00000100:00100000:0.0:1782759494.633090:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759494.633167:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218519552 00000100:00100000:2.0:1782759494.633176:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218519552 00000100:00100000:2.0:1782759494.633241:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1074 00000100:00100000:2.0:1782759494.633252:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218519552:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759494.633268:0:8600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759494.633296:0:8600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273b5 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759494.633319:0:8600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x6a42c047, atime: 0x6a42c047, ctime: 0x6a42c047, blocks: 0x0 00010000:00010000:2.0:1782759494.633337:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=3534s v=(0 0) 00010000:00010000:2.0:1782759494.633341:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759494.633349:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 8 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.633365:0:8600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 8 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.633376:0:8600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759494.633421:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218519552:12345-192.168.202.31@tcp:101:rm.0 Request processed in 172us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.633429:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1074 00000100:00100000:3.0:1782759494.635129:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759494.635400:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218519808 00000100:00100000:0.0:1782759494.635409:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218519808 00000100:00100000:0.0:1782759494.635465:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2884 00000100:00100000:0.0:1782759494.635474:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:107703:x1869355218519808:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782759494.635519:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782759494.635544:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60c9ee lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ae expref: 20 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635569:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60c993 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27399 expref: 19 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635616:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:0.0:1782759494.635621:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759494.635657:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635669:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635678:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635689:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635697:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635703:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635868:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 3/0,1 mode: --/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635876:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.635883:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759494.636088:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10552 00000004:00080000:0.0:1782759494.636099:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3534912521156ns, next at 3535912518946ns, rc = 0 00010000:00010000:0.0:1782759494.636183:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636193:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636208:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636215:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636222:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636228:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636249:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759494.636267:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636273:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636279:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636285:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759494.636289:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636296:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636305:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:0.0:1782759494.636308:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759494.636320:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 2/0,0 mode: --/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636326:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca0a lrc: 0/0,0 mode: --/EX res: [0x200000421:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636341:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636347:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636353:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636358:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636364:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759494.636367:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636372:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636379:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2200) 00010000:00010000:0.0:1782759494.636381:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759494.636384:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636390:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60c9fc lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759494.636407:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054b24cb6 reply state 00000000f078f66f transno 4294967991 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636425:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.636431:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34f4800) 00010000:00010000:0.0:1782759494.636433:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759494.636436:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759494.636548:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:107703:x1869355218519808:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1073us (1423us total) trans 4294967991 rc 0/0 00000100:00100000:0.0:1782759494.636556:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2884 00010000:00010000:1.0:1782759494.636561:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759494.636569:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.636609:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759494.636613:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.636622:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.636633:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:1.0:1782759494.636636:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782759494.636639:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 1/0,0 mode: --/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.636645:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca11 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.636657:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759494.636666:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759494.636668:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759494.666834:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759494.666841:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759494.666845:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759494.666888:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.666898:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.666906:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759494.666924:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232913536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759494.666986:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759494.667041:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759494.667091:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913536 00000100:00100000:0.0:1782759494.667100:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913536 00000100:00100000:0.0:1782759494.667155:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3211 00000100:00100000:0.0:1782759494.667164:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232913536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759494.667229:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759494.667244:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ca18 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.667269:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.667280:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.667290:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4ddc00, rc 0) 00000100:00100000:0.0:1782759494.667349:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232913536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759494.667356:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3211 00000100:00100000:3.0:1782759494.667455:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232913536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759494.667466:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.667477:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759494.667491:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759494.667494:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759494.667499:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759494.955451:0:147694:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff27f33420 20000000:00000080:2.0:1782759494.955470:0:147694:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e80c00 uarg=0000000000000000 00010000:00010000:2.0:1782759494.955693:0:147694:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759494.955728:0:147694:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759494.955754:0:147694:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759494.955765:0:147694:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759494.955779:0:147694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759494.955796:0:147694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.955812:0:147694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.955825:0:147694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.955862:0:147694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759494.955875:0:147694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 23 pid: 6524 timeout: 3685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.955890:0:147694:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147694:1869355232913664:0@lo:104: 00000100:00100000:2.0:1782759494.955948:0:147694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759494.955998:0:147694:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759494.956001:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913664 00000100:00100000:1.0:1782759494.956010:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913664 00000100:00100000:1.0:1782759494.956069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1782759494.956078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:147694:x1869355232913664:12345-0@lo:104: 00010000:00010000:1.0:1782759494.956089:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956150:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759494.956170:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:147694:x1869355232913664:12345-0@lo:104: Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759494.956175:0:147694:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147694:1869355232913664:0@lo:104: 00010000:00010000:0.0:1782759494.956177:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1782759494.956182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00010000:00010000:0.0:1782759494.956190:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.956201:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc133cc20) 00010000:00010000:2.0:1782759494.956204:0:147694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759494.956206:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.956226:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759494.956234:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759494.956238:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759494.956262:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.956266:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759494.956286:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759494.956291:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232913792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759494.956297:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60ca18 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca1f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759494.956315:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759494.956318:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759494.956321:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759494.956326:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759494.956369:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913792 00000100:00100000:1.0:1782759494.956374:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913792 00010000:00010000:1.0:1782759494.956389:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 24 pid: 6524 timeout: 3685 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.956421:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1782759494.956429:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232913792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759494.956439:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759494.956443:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 24 pid: 6524 timeout: 3685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956453:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 24 pid: 6524 timeout: 3685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956464:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60ca1f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca18 expref: 24 pid: 6524 timeout: 3685 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956496:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956504:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956516:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956522:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956529:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956535:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956541:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759494.956544:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956552:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956570:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759494.956591:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759494.956629:0:147694:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.956631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232913792:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (304us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759494.956640:0:147694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759494.956647:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232913792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759494.956652:0:147694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca26 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759494.956654:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00010000:00010000:0.0:1782759494.987737:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759495.050841:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232913920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759495.050910:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759495.050950:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232913920 00000100:00100000:1.0:1782759495.050958:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232913920 00000100:00100000:1.0:1782759495.051012:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1782759495.051021:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232913920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759495.051042:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759495.051088:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232913920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759495.051093:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1782759495.051142:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232913920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759495.562824:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232914048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759495.562905:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759495.562944:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914048 00000100:00100000:2.0:1782759495.562952:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914048 00000100:00100000:2.0:1782759495.563034:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:2.0:1782759495.563045:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232914048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759495.563079:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446150144 avail 1299910656 00000100:00100000:2.0:1782759495.563142:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232914048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759495.563150:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00100000:1.0:1782759495.563183:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232914048:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1782759495.565341:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967697 is committed 00000020:00080000:2.0:1782759495.565368:0:7461:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc45c3f00 refcount 2 committed 0 result 0 batchid 30 00000020:00080000:2.0:1782759495.565373:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec5282700 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3540 00000020:00080000:2.0:1782759495.565377:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].31 00000020:00080000:2.0:1782759495.565380:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec5282600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4875800 00000020:00080000:2.0:1782759495.565383:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].30 00010000:00010000:2.0:1782759495.565413:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.565424:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.565432:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.565440:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759495.565444:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.565452:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.565474:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1b:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:2.0:1782759495.565477:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759495.565482:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759495.565487:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60c851 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759495.565516:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 30 committed batchid 29 00000020:00080000:2.0:1782759495.565569:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 29 00000100:00100000:2.0:1782759495.899994:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759495.900039:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759495.900068:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759495.900093:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759495.900103:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218519936 00000100:00100000:3.0:1782759495.900114:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218519936 00000100:00100000:2.0:1782759495.900122:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520448 00000100:00100000:2.0:1782759495.900127:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520448 00000100:00100000:1.0:1782759495.900149:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520064 00000100:00100000:1.0:1782759495.900155:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520064 00000100:00100000:3.0:1782759495.900169:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3212 00000100:00100000:3.0:1782759495.900184:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218519936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759495.900189:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2891 00000100:00100000:1.0:1782759495.900194:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520192 00000100:00100000:1.0:1782759495.900199:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520192 00000100:00100000:2.0:1782759495.900204:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218520448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759495.900229:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5024 00000100:00100000:0.0:1782759495.900239:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5025 00000100:00100000:1.0:1782759495.900241:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:2403:x1869355218520064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759495.900253:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218520192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759495.900280:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218520448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759495.900287:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:2403:x1869355218520064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759495.900288:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218519936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 99us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759495.900295:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2891 00000100:00100000:0.0:1782759495.900297:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218520192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759495.900306:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5024 00000100:00100000:3.0:1782759495.900310:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3212 00000100:00100000:0.0:1782759495.900316:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5025 00000100:00100000:0.0:1782759495.902449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759495.902493:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520320 00000100:00100000:2.0:1782759495.902501:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520320 00000100:00100000:2.0:1782759495.902558:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2892 00000100:00100000:2.0:1782759495.902570:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218520320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759495.902658:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218520320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759495.902678:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2892 00010000:00010000:1.0:1782759496.011789:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782759496.074736:0:8598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3536351156234ns, next at 3537351154038ns, rc = 0 00000100:00100000:0.0:1782759496.074748:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232914176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759496.074818:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759496.074876:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759496.074877:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914176 00000100:00100000:0.0:1782759496.074885:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232914304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759496.074886:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914176 00000100:00100000:0.0:1782759496.074915:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782759496.074942:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759496.074947:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914304 00000100:00100000:3.0:1782759496.074951:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914304 00000100:00100000:0.0:1782759496.074958:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00080000:2.0:1782759496.074970:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759496.074973:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232914176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759496.074980:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:3.0:1782759496.074988:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232914304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759496.075008:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1782759496.075009:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759496.075070:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232914176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759496.075078:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232914304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759496.075084:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:3.0:1782759496.075092:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1782759496.075106:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232914304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759496.075140:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232914176:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759496.395636:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759496.395643:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759496.395649:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759496.395703:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.395712:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.395719:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759496.395739:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232914432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759496.395805:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759496.395848:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914432 00000100:00100000:0.0:1782759496.395856:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914432 00000100:00100000:3.0:1782759496.395864:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759496.395909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:0.0:1782759496.395920:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232914432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759496.395934:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759496.395947:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ca2d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.395968:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.395985:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.395993:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759496.396036:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232914432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759496.396044:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:3.0:1782759496.396066:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232914432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759496.396081:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.396090:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759496.396106:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759496.396112:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.396120:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759496.591337:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967408 is committed 00000001:00080000:3.0:1782759496.591352:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967407 is committed 00000020:00000080:3.0:1782759496.722638:0:147938:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8166c8d0 20000000:00000080:3.0:1782759496.722653:0:147938:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf929400 uarg=0000000000000000 00010000:00010000:3.0:1782759496.723252:0:147938:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759496.723263:0:147938:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759496.723276:0:147938:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759496.723282:0:147938:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759496.723307:0:147938:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759496.723321:0:147938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.723334:0:147938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.723342:0:147938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.723378:0:147938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.723390:0:147938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 23 pid: 6524 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759496.723401:0:147938:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147938:1869355232914560:0@lo:104: 00000100:00100000:3.0:1782759496.723450:0:147938:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759496.723533:0:147938:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759496.723569:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914560 00000100:00100000:2.0:1782759496.723627:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914560 00000100:00100000:2.0:1782759496.723668:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:2.0:1782759496.723674:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:147938:x1869355232914560:12345-0@lo:104: 00010000:00010000:2.0:1782759496.723685:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759496.723758:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759496.723764:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:147938:x1869355232914560:12345-0@lo:104: Request processed in 90us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759496.723770:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1782759496.723777:0:147938:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:147938:1869355232914560:0@lo:104: 00010000:00010000:3.0:1782759496.723801:0:147938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.723837:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759496.723845:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.723852:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759496.723855:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.723864:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759496.723872:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759496.723878:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759496.723904:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.723908:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759496.723945:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232914688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759496.723967:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759496.723999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914688 00000100:00100000:3.0:1782759496.724005:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914688 00010000:00010000:0.0:1782759496.724011:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724025:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 24 pid: 6524 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.724041:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60ca2d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca34 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759496.724059:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759496.724061:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759496.724063:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00010000:00010000:0.0:1782759496.724066:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759496.724074:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232914688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759496.724084:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759496.724090:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 24 pid: 6524 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724102:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 24 pid: 6524 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724114:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca2d expref: 24 pid: 6524 timeout: 3686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724128:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724136:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724148:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724155:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724173:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724180:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724185:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759496.724189:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724196:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724219:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759496.724228:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759496.724263:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232914688:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759496.724268:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:2.0:1782759496.724293:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232914688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759496.724324:0:147938:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.724332:0:147938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759496.724344:0:147938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca3b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759497.035143:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759497.100385:0:147986:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff9d57d310 20000000:00000080:1.0:1782759497.100398:0:147986:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf957c00 uarg=0000000000000000 00010000:00010000:1.0:1782759497.100641:0:147986:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759497.100660:0:147986:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759497.100682:0:147986:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759497.100708:0:147986:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759497.100728:0:147986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759497.100746:0:147986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100761:0:147986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100769:0:147986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100776:0:147986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100783:0:147986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100790:0:147986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100797:0:147986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759497.100807:0:147986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100816:0:147986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100829:0:147986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100837:0:147986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759497.100844:0:147986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60ca42 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 147986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759497.464595:0:148034:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc49bff0d0 20000000:00000080:2.0:1782759497.464610:0:148034:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc24c6800 uarg=0000000000000000 00010000:00010000:2.0:1782759497.464843:0:148034:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759497.464858:0:148034:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759497.464878:0:148034:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759497.464895:0:148034:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759497.464913:0:148034:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759497.464930:0:148034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464945:0:148034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464955:0:148034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464962:0:148034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464969:0:148034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464976:0:148034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464982:0:148034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759497.464986:0:148034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.464993:0:148034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.465003:0:148034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.465010:0:148034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.465025:0:148034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60ca49 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759497.834922:0:148082:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0d7097d0 20000000:00000080:2.0:1782759497.834935:0:148082:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc24c7c00 uarg=0000000000000000 00010000:00010000:2.0:1782759497.835097:0:148082:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759497.835107:0:148082:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759497.835121:0:148082:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759497.835128:0:148082:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759497.835143:0:148082:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759497.835161:0:148082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835177:0:148082:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835188:0:148082:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835196:0:148082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835203:0:148082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835221:0:148082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835231:0:148082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759497.835240:0:148082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835246:0:148082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835256:0:148082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835261:0:148082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759497.835265:0:148082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ca50 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759498.058755:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759498.378668:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759498.378686:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759498.378692:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759498.378748:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759498.378760:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759498.378770:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759498.378822:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232914816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759498.378890:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759498.378942:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914816 00000100:00100000:2.0:1782759498.378950:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914816 00000100:00100000:3.0:1782759498.378959:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded38c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759498.379000:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:2.0:1782759498.379006:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232914816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759498.379017:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759498.379028:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ca57 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.379045:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.379053:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759498.379062:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759498.379104:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232914816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759498.379118:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1782759498.379142:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232914816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759498.379168:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759498.379182:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759498.379198:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759498.379204:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759498.379210:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759498.635897:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232914944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759498.635968:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759498.636011:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232914944 00000100:00100000:3.0:1782759498.636020:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232914944 00000100:00100000:3.0:1782759498.636081:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00100000:3.0:1782759498.636092:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232914944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759498.636127:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445883904 avail 1299644416 00000100:00100000:3.0:1782759498.636181:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232914944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759498.636189:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00100000:2.0:1782759498.636225:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967980 gen 2 00000004:00080000:2.0:1782759498.636231:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967980 committed transno 4294967980 00000020:00080000:2.0:1782759498.636238:0:3663:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc45c3600 refcount 2 committed 0 result 0 batchid 31 00000020:00080000:2.0:1782759498.636243:0:3663:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63a00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c39c0 00000020:00080000:2.0:1782759498.636246:0:3663:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].32 00000020:00080000:2.0:1782759498.636249:0:3663:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3f63200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4ace600 00000020:00080000:2.0:1782759498.636259:0:3663:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].31 00000020:00080000:3.0:1782759498.636292:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 31 committed batchid 29 00000100:00100000:2.0:1782759498.636294:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232914944:0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1782759498.636351:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 29 00010000:00010000:3.0:1782759499.089659:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759499.398239:0:148278:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6e5b5a80 20000000:00000080:3.0:1782759499.398254:0:148278:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf929000 uarg=0000000000000000 10000000:01000000:3.0:1782759499.398573:0:148278:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759499.398867:0:148278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.398883:0:148278:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.398892:0:148278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.398927:0:148278:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.398940:0:148278:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 23 pid: 6525 timeout: 3689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759499.398954:0:148278:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148278:1869355232915072:0@lo:104: 00000100:00100000:3.0:1782759499.399009:0:148278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759499.399067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915072 00000100:00100000:1.0:1782759499.399075:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915072 00000100:00100000:3.0:1782759499.399113:0:148278:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90a80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759499.399296:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1782759499.399308:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:148278:x1869355232915072:12345-0@lo:104: 00010000:00010000:1.0:1782759499.399321:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399387:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759499.399394:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:148278:x1869355232915072:12345-0@lo:104: Request processed in 89us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759499.399401:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:3.0:1782759499.399413:0:148278:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148278:1869355232915072:0@lo:104: 00010000:00010000:3.0:1782759499.399433:0:148278:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.399512:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759499.399519:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.399526:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759499.399530:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.399538:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759499.399545:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759499.399550:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759499.399648:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.399655:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759499.399699:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232915200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759499.399731:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759499.399742:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759499.399755:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60ca57 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca5e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.399773:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759499.399776:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759499.399778:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759499.399811:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915200 00000100:00100000:1.0:1782759499.399815:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915200 00010000:00010000:1.0:1782759499.399833:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 24 pid: 6525 timeout: 3689 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759499.399852:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1782759499.399856:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232915200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759499.399865:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759499.399869:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 24 pid: 6525 timeout: 3689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399876:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 24 pid: 6525 timeout: 3689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399889:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60ca5e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca57 expref: 24 pid: 6525 timeout: 3689 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399901:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399909:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399922:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399929:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399936:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399943:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399952:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759499.399955:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399960:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399974:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759499.399982:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759499.399998:0:148278:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.400009:0:148278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759499.400018:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232915200:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759499.400030:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00010000:00010000:3.0:1782759499.400051:0:148278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60ca65 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759499.400055:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232915200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759499.658754:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759499.658772:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232915328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759499.658830:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759499.658948:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915328 00000100:00100000:2.0:1782759499.658953:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232915456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.658957:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915328 00000100:00100000:2.0:1782759499.658995:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759499.659035:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759499.659040:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1782759499.659049:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232915584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.659055:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232915328:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782759499.659059:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759499.659081:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1782759499.659086:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759499.659138:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232915328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759499.659145:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1782759499.659168:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232915968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.659192:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232915712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659200:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759499.659224:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232916480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.659233:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759499.659235:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915456 00000100:00100000:0.0:1782759499.659247:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915456 00000100:00100000:2.0:1782759499.659265:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915968 00000100:00100000:2.0:1782759499.659270:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915968 00000100:00100000:3.0:1782759499.659277:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232916224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659281:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915712 00000100:00100000:0.0:1782759499.659285:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915712 00000100:00100000:3.0:1782759499.659311:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759499.659337:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5026 00000100:00100000:3.0:1782759499.659345:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967408 gen 2 00000004:00080000:3.0:1782759499.659352:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4ddb480, transno 4294967408 00000100:00100000:0.0:1782759499.659362:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5027 00000100:00100000:0.0:1782759499.659371:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232915968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.659376:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232915328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759499.659377:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232915456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.659406:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232916736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659408:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232915968:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.659417:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5027 00000100:00100000:2.0:1782759499.659433:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232915456:12345-0@lo:400:kworker.0 Request processed in 69us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.659435:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5028 00000100:00100000:2.0:1782759499.659448:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5026 00000100:00100000:0.0:1782759499.659449:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232915712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.659459:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759499.659483:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916224 00000100:00100000:0.0:1782759499.659492:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232915712:12345-0@lo:400:kworker.0 Request processed in 48us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759499.659496:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232915712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659499:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5028 00000100:00100000:2.0:1782759499.659500:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916224 00000100:00100000:3.0:1782759499.659517:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759499.659526:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232915840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659532:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232916096:0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659541:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916736 00000100:00100000:2.0:1782759499.659546:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916736 00000100:00100000:3.0:1782759499.659559:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759499.659565:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759499.659605:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232916608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659606:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1782759499.659621:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232916224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659626:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759499.659658:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232916224:12345-0@lo:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759499.659677:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1782759499.659689:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1782759499.659695:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232916736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659729:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232916736:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759499.659734:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1782759499.659753:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916096 00000100:00100000:2.0:1782759499.659756:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916096 00000100:00100000:2.0:1782759499.659778:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916608 00000100:00100000:2.0:1782759499.659781:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916608 00000100:00100000:2.0:1782759499.659801:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5029 00000100:00100000:2.0:1782759499.659809:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232916096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659814:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5030 00000100:00100000:0.0:1782759499.659823:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232916608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659845:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232916096:12345-0@lo:400:kworker.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759499.659852:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5029 00000100:00100000:0.0:1782759499.659860:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232916608:12345-0@lo:400:kworker.0 Request processed in 38us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.659866:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5030 00000100:00080000:2.0:1782759499.659879:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759499.659883:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759499.659886:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759499.659889:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759499.659895:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232916096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659903:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232916608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659909:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759499.659929:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916480 00000100:00100000:0.0:1782759499.659932:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916480 00000100:00100000:2.0:1782759499.659953:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232915968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659955:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5031 00000100:00100000:0.0:1782759499.659964:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232916480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759499.659973:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232915456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.659991:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232916480:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.659996:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5031 00000100:00100000:2.0:1782759499.660004:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232916480:0@lo:400:kworker.0 00000100:00080000:0.0:1782759499.660007:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759499.660533:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232916352:0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.660573:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759499.660629:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232916736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.660645:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916352 00000100:00100000:3.0:1782759499.660649:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232916224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.660651:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916352 00000100:00100000:0.0:1782759499.660703:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1782759499.660706:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915584 00000100:00100000:3.0:1782759499.660711:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915584 00000100:00100000:0.0:1782759499.660719:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232916352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.660752:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232916352:12345-0@lo:400:kworker.0 Request processed in 44us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759499.660756:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232915840 00000100:00100000:0.0:1782759499.660760:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1782759499.660761:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232915840 00000100:00100000:3.0:1782759499.660785:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222 00000100:00100000:3.0:1782759499.660793:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232915584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.660900:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232915584:12345-0@lo:400:kworker.0 Request processed in 108us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759499.660909:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222 00000100:00100000:3.0:1782759499.660933:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3223 00000100:00100000:3.0:1782759499.660941:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232915840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.660973:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232915840:12345-0@lo:400:kworker.0 Request processed in 34us (1415us total) trans 0 rc 0/0 00000100:00080000:0.0:1782759499.660976:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759499.660979:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3223 00000100:00100000:0.0:1782759499.661005:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232915840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759499.661021:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232916352:0@lo:400:kworker.0 00000100:00100000:3.0:1782759499.661029:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232915584:0@lo:400:kworker.0 00000004:00080000:0.0:1782759499.662711:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000001:00080000:0.0:1782759499.662761:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967991 is committed 00000004:00080000:0.0:1782759499.662774:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00010000:00010000:3.0:1782759499.662841:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662855:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662864:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662880:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759499.662886:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662895:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662911:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:3.0:1782759499.662914:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759499.662918:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662925:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60c954 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759499.662939:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1782759499.662940:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662949:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662956:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759499.662958:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232916864:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782759499.662969:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759499.662972:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662979:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.662998:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x19:0x0].0x0 (ffff8cdecd4e3200) 00010000:00010000:3.0:1782759499.663001:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759499.663005:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663011:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60c962 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759499.663019:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759499.663037:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663044:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663050:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663056:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759499.663059:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663065:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663072:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34f4800) 00010000:00010000:3.0:1782759499.663075:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759499.663078:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663083:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60c977 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663101:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663107:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663112:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663119:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759499.663122:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663128:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663137:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1a:0x0].0x0 (ffff8cddc24d2f00) 00010000:00010000:3.0:1782759499.663140:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759499.663144:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663151:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60c98c lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759499.663159:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232916864 00000100:00100000:2.0:1782759499.663167:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232916864 00010000:00010000:3.0:1782759499.663182:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663191:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663197:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663210:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759499.663213:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759499.663219:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00010000:00010000:3.0:1782759499.663223:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759499.663234:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232916864:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1782759499.663235:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc3502900) 00010000:00010000:3.0:1782759499.663242:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759499.663245:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663252:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60c9cb lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1782759499.663260:0:8445:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:33 count 1 00010000:00010000:3.0:1782759499.663267:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663275:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663283:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.663283:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663299:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759499.663305:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663311:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.663315:0:8445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 7 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.663332:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=5s v=(0 0) 00010000:00010000:3.0:1782759499.663337:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34f4800) 00010000:00010000:2.0:1782759499.663337:0:8445:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759499.663344:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759499.663347:0:8445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663348:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.663367:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60ca03 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.663387:0:8445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 7 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.663416:0:8445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 7 pid: 8600 timeout: 3639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759499.663429:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1869355232916992:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759499.664131:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759499.666298:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8445:1869355232916992:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759499.666332:0:8445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759499.666452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759499.666552:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520576 00000100:00100000:0.0:1782759499.666559:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520576 00000100:00080000:2.0:1782759499.666644:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759499.666763:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 8 pid: 8600 timeout: 3639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759499.666842:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 796 00000100:00100000:0.0:1782759499.666851:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218520576:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759499.666864:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759499.666878:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 8 pid: 8600 timeout: 3639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.666890:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 8 pid: 8600 timeout: 3639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.666911:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60c9f5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273b5 expref: 8 pid: 8600 timeout: 3639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.666926:0:9534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759499.666929:0:9534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759499.666934:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.666944:0:9534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759499.666970:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759499.667028:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218520576:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 178us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759499.667035:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 796 00010000:00010000:3.0:1782759499.667080:0:8445:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.667089:0:8445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.667099:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.667106:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759499.667125:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759499.667148:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759499.667156:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.667164:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759499.667169:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.667179:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.667192:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.667198:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60ca6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.667217:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759499.667219:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759499.667226:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759499.667338:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232916864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4109us (4322us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1782759499.667346:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000004:00080000:3.0:1782759499.667384:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc3d4f480/2, rc 0, transno 4294967415 00000100:00100000:3.0:1782759499.667390:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232916864:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1782759499.668434:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967415 is committed 00000001:00080000:2.0:1782759499.668444:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967414 is committed 00000020:00000080:2.0:1782759499.739629:0:148326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed4d77d20 20000000:00000080:2.0:1782759499.739642:0:148326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4bbf800 uarg=0000000000000000 10000000:01000000:2.0:1782759499.739806:0:148326:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759499.739825:0:148326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739837:0:148326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739845:0:148326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739849:0:148326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739853:0:148326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739857:0:148326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739861:0:148326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759499.739864:0:148326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739868:0:148326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739876:0:148326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739886:0:148326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759499.739890:0:148326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60ca73 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759500.106869:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759500.110455:0:148374:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc6dfd92d0 20000000:00000080:3.0:1782759500.110471:0:148374:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf92b800 uarg=0000000000000000 00010000:00010000:3.0:1782759500.110688:0:148374:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759500.110705:0:148374:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759500.110727:0:148374:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759500.110738:0:148374:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759500.110757:0:148374:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759500.110775:0:148374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110791:0:148374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110802:0:148374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110809:0:148374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110816:0:148374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110822:0:148374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110840:0:148374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759500.110845:0:148374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110853:0:148374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110866:0:148374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110875:0:148374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759500.110881:0:148374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60ca7a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759500.170689:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232917120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759500.170760:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759500.170838:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917120 00000100:00100000:2.0:1782759500.170844:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917120 00000100:00100000:2.0:1782759500.170890:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1782759500.170898:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232917120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759500.170918:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759500.170973:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232917120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759500.170981:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:2.0:1782759500.171035:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232917120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759500.682730:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759500.682753:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232917248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759500.682811:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759500.682873:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917248 00000100:00100000:3.0:1782759500.682879:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917248 00000100:00100000:3.0:1782759500.682943:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224 00000100:00100000:3.0:1782759500.682953:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232917248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759500.682984:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446150144 avail 1299910656 00000100:00100000:3.0:1782759500.683030:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232917248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759500.683037:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224 00000100:00100000:0.0:1782759500.683074:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232917248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759501.020690:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759501.020737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759501.020786:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759501.020820:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218521088 00000100:00100000:1.0:1782759501.020830:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218521088 00000100:00100000:1.0:1782759501.020896:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2896 00000100:00100000:1.0:1782759501.020914:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218521088:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759501.020986:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218521088:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759501.020995:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2896 00000100:00080000:1.0:1782759501.021019:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759501.021102:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520704 00000100:00100000:1.0:1782759501.021106:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520704 00000100:00100000:1.0:1782759501.021156:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3215 00000100:00100000:1.0:1782759501.021166:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218520704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759501.021167:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520832 00000100:00100000:0.0:1782759501.021175:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520832 00000100:00100000:1.0:1782759501.021205:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218520704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759501.021212:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3215 00000100:00100000:0.0:1782759501.021224:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5032 00000100:00100000:0.0:1782759501.021235:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218520832:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:1.0:1782759501.021257:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759501.021290:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218520832:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 52us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759501.021298:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5032 00000100:00100000:0.0:1782759501.022288:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759501.022327:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759501.022346:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218521216 00000100:00100000:0.0:1782759501.022352:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218521216 00000100:00080000:1.0:1782759501.022385:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759501.022411:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2897 00000100:00100000:2.0:1782759501.022449:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218520960 00000100:00100000:2.0:1782759501.022453:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218520960 00000100:00080000:1.0:1782759501.022480:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759501.022498:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5033 00000100:00100000:2.0:1782759501.022508:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218520960:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759501.022563:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218520960:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 57us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759501.022571:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5033 00000100:00100000:0.0:1782759501.022671:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218521216:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759501.022700:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218521216:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 281us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759501.022707:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2897 00010000:00010000:2.0:1782759501.133791:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759501.195881:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232917376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759501.195992:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232917504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759501.196058:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759501.196471:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759501.196515:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917504 00000100:00100000:2.0:1782759501.196522:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917504 00000100:00100000:3.0:1782759501.196563:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917376 00000100:00100000:2.0:1782759501.196606:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1782759501.196619:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232917504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759501.196661:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759501.196663:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917376 00000100:00100000:3.0:1782759501.196703:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:3.0:1782759501.196714:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232917376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759501.196717:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232917504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759501.196726:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00002000:00000024:3.0:1782759501.196728:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1782759501.196728:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759501.196767:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232917504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759501.196790:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232917376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759501.196798:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:2.0:1782759501.196800:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967415 gen 2 00000004:00080000:2.0:1782759501.196806:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc3d4f480, transno 4294967415 00000100:00100000:2.0:1782759501.196820:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232917376:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782759501.324877:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759501.324885:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759501.324891:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759501.324937:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.324951:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.324963:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759501.324988:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232917632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759501.325057:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759501.325118:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759501.325696:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917632 00000100:00100000:0.0:1782759501.325716:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917632 00000100:00100000:0.0:1782759501.325771:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:0.0:1782759501.325783:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232917632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759501.325797:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759501.325813:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ca81 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.325836:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.325847:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759501.325856:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759501.325904:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232917632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759501.325913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:2.0:1782759501.326305:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232917632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759501.326330:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.326340:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759501.326360:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759501.326365:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.326374:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1782759501.691567:0:148569:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc46075720 20000000:00000080:3.0:1782759501.691607:0:148569:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc24c6800 uarg=0000000000000000 00010000:00010000:3.0:1782759501.691828:0:148569:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759501.691846:0:148569:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759501.691867:0:148569:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759501.691879:0:148569:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759501.691902:0:148569:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759501.691926:0:148569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.691947:0:148569:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.691958:0:148569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.692010:0:148569:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.692026:0:148569:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 23 pid: 6525 timeout: 3691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759501.692045:0:148569:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148569:1869355232917760:0@lo:104: 00000100:00100000:3.0:1782759501.692132:0:148569:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759501.692194:0:148569:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759501.692282:0:140593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759501.692298:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917760 00000100:00100000:1.0:1782759501.692305:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917760 00000100:00100000:1.0:1782759501.692359:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1782759501.692371:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd7e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:148569:x1869355232917760:12345-0@lo:104: 00010000:00010000:1.0:1782759501.692387:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692488:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759501.692494:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd7e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:148569:x1869355232917760:12345-0@lo:104: Request processed in 126us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759501.692506:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00010000:00010000:2.0:1782759501.692524:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759501.692534:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.692544:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759501.692548:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.692559:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759501.692568:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759501.692598:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1782759501.692621:0:148569:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148569:1869355232917760:0@lo:104: 00010000:00010000:3.0:1782759501.692639:0:148569:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.692642:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.692682:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759501.692715:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759501.692724:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60ca81 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759501.692729:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232917888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759501.692749:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759501.692753:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759501.692755:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759501.692765:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759501.692812:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232917888 00000100:00100000:1.0:1782759501.692818:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232917888 00010000:00010000:1.0:1782759501.692840:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 24 pid: 6525 timeout: 3691 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759501.692872:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1782759501.692881:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232917888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759501.692894:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759501.692900:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 24 pid: 6525 timeout: 3691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692911:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 24 pid: 6525 timeout: 3691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692924:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd000/0xd5b45c7f5c60ca88 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca81 expref: 24 pid: 6525 timeout: 3691 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692939:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692961:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692976:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.692984:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.693002:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.693009:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.693015:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759501.693020:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.693029:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.693047:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759501.693058:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759501.693074:0:148569:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.693084:0:148569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759501.693091:0:148569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60ca8f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759501.693102:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232917888:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759501.693110:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:0.0:1782759501.693187:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232917888:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1782759501.708868:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 31 batchid updated 00000020:00080000:2.0:1782759501.708886:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 30 batchid updated 00000020:00080000:3.0:1782759501.708930:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 31 00000004:00080000:3.0:1782759501.709010:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cdec93a23c0 with version 64 00000020:00080000:3.0:1782759501.709027:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 30 cancel update log [0x200000401:0x2:0x0].31: rc = 0 00000004:00080000:2.0:1782759501.709047:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 64 rpc_version 64 00000020:00100000:2.0:1782759501.709094:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759501.709109:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc3d4df80 x1869355232918144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1782759501.709139:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 30 cancel update log [0x240000400:0x2:0x0].30: rc = 0 00000100:00100000:2.0:1782759501.709149:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232918144:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1782759501.709173:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cdec93a2180 with version 65 00000020:00080000:3.0:1782759501.709179:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 31 cancel update log [0x200000401:0x2:0x0].32: rc = 0 00000100:00100000:2.0:1782759501.709252:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1782759501.709263:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 31 cancel update log [0x240000400:0x2:0x0].31: rc = 0 00000020:00080000:3.0:1782759501.709273:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 31 00000100:00100000:2.0:1782759501.709304:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759501.709329:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232918144 00000100:00100000:0.0:1782759501.709340:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232918144 00000100:00100000:0.0:1782759501.709435:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:0.0:1782759501.709451:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355232918144:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759501.709703:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232918144:12345-0@lo:1000:osp_up0-1.0 Request processed in 251us (447us total) trans 4294967992 rc 0/0 00000100:00100000:0.0:1782759501.709714:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00000100:00100000:2.0:1782759501.709755:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232918144:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1782759501.709773:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 65 rpc_version 65 00000020:00100000:2.0:1782759501.709786:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759501.709791:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc3d4fb80 x1869355232918400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782759501.709801:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232918400:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759501.709831:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759501.709852:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759501.709938:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232918400 00000100:00100000:3.0:1782759501.709944:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232918400 00000100:00100000:3.0:1782759501.709995:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226 00000100:00100000:3.0:1782759501.710004:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232918400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759501.710114:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232918400:12345-0@lo:1000:osp_up0-1.0 Request processed in 111us (282us total) trans 4294967993 rc 0/0 00000100:00100000:3.0:1782759501.710128:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226 00000100:00100000:2.0:1782759501.710217:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4fb80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232918400:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1782759502.154880:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759502.858681:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759502.858688:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759502.858693:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759502.858732:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.858745:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.858756:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759502.858778:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232918528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759502.858836:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.858876:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232918528 00000100:00100000:2.0:1782759502.858883:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232918528 00000100:00100000:0.0:1782759502.858888:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759502.858935:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3217 00000100:00100000:2.0:1782759502.858946:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232918528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759502.858960:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759502.858975:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ca96 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.858997:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.859005:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.859012:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759502.859061:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232918528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.859068:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3217 00000100:00100000:0.0:1782759502.859094:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232918528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759502.859107:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.859115:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759502.859129:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759502.859133:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.859138:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759502.902894:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.902951:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218521472 00000100:00100000:0.0:1782759502.902967:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218521472 00000100:00100000:0.0:1782759502.903031:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2885 00000100:00100000:0.0:1782759502.903043:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:108048:x1869355218521472:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:0.0:1782759502.903149:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232918656:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782759502.903214:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759502.903246:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232918656 00000100:00100000:0.0:1782759502.903247:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759502.903252:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232918656 00000100:00100000:1.0:1782759502.903299:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:1.0:1782759502.903308:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6533:x1869355232918656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1782759502.903403:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6533:x1869355232918656:12345-0@lo:1000:mdt00_002.0 Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759502.903411:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:2.0:1782759502.903429:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232918656:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.903483:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232918784:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.903518:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.903542:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.903597:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232918784 00000100:00100000:3.0:1782759502.903603:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232918784 00000100:00100000:3.0:1782759502.903656:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:3.0:1782759502.903664:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6533:x1869355232918784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.903745:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6533:x1869355232918784:12345-0@lo:1000:mdt00_002.0 Request processed in 81us (225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759502.903762:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232918784:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.903769:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00010000:00010000:2.0:1782759502.903818:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.903835:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.903847:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759502.903860:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232918912:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1782759502.903886:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.903908:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759502.903976:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232918912 00000100:00100000:0.0:1782759502.903981:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232918912 00000100:00100000:0.0:1782759502.904017:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229 00000100:00100000:0.0:1782759502.904027:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6533:x1869355232918912:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1782759502.904037:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759502.904054:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60caab lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60caa4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.904079:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60caab lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60caa4 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.904096:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60caab lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60caa4 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.904105:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759502.904109:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759502.904112:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759502.904150:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6533:x1869355232918912:12345-0@lo:101:mdt00_002.0 Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.904156:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:2.0:1782759502.904178:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232918912:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1782759502.904192:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.904204:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759502.904220:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:2.0:1782759502.904239:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.904247:0:6533:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.904256:0:6533:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759502.904271:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919040:0@lo:101:mdt00_002.0 00000100:00100000:2.0:1782759502.904307:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.904350:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.904365:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919040 00000100:00100000:3.0:1782759502.904371:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919040 00000100:00100000:3.0:1782759502.904408:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3230 00000100:00100000:3.0:1782759502.904417:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6533:x1869355232919040:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1782759502.904426:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759502.904440:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cab2 expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.904457:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cab2 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.904466:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cab2 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.904474:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759502.904477:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759502.904479:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759502.904515:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919040:12345-0@lo:101:mdt00_002.0 Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.904533:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3230 00000100:00100000:2.0:1782759502.904554:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919040:0@lo:101:mdt00_002.0 00010000:00010000:2.0:1782759502.904569:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.904609:0:6533:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759502.904626:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00000100:00100000:2.0:1782759502.904675:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.904711:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.904735:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759502.904749:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919168 00000100:00100000:0.0:1782759502.904755:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919168 00000100:00100000:0.0:1782759502.904794:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231 00000100:00100000:0.0:1782759502.904800:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782759502.904859:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919168:12345-0@lo:1000:mdt00_002.0 Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.904866:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231 00000100:00100000:2.0:1782759502.904881:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919168:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.904927:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919296:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.904953:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.904969:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.904988:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919296 00000100:00100000:3.0:1782759502.904993:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919296 00000100:00100000:3.0:1782759502.905026:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232 00000100:00100000:3.0:1782759502.905033:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.905096:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919296:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (141us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759502.905103:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232 00000100:00100000:2.0:1782759502.905113:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919296:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905180:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919424:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905206:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.905225:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.905254:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919424 00000100:00100000:3.0:1782759502.905260:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919424 00000100:00100000:3.0:1782759502.905294:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233 00000100:00100000:3.0:1782759502.905303:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919424:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.905367:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919424:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (159us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759502.905375:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233 00000100:00100000:2.0:1782759502.905382:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919424:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905429:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919552:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905454:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.905471:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.905492:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919552 00000100:00100000:3.0:1782759502.905497:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919552 00000100:00100000:3.0:1782759502.905526:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3234 00000100:00100000:3.0:1782759502.905534:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919552:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.905634:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919552:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.905654:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3234 00000100:00100000:2.0:1782759502.905673:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919552:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905712:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919680:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905732:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.905745:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.905773:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919680 00000100:00100000:3.0:1782759502.905779:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919680 00000100:00100000:3.0:1782759502.905808:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1782759502.905816:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919680:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.905891:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919680:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.905899:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235 00000100:00100000:2.0:1782759502.905906:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919680:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905947:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919808:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782759502.905970:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.905987:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.906076:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232919808 00000100:00100000:3.0:1782759502.906081:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232919808 00000100:00100000:3.0:1782759502.906114:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236 00000100:00100000:3.0:1782759502.906122:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759502.906188:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6533:x1869355232919808:12345-0@lo:1000:mdt00_002.0 Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.906196:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236 00000100:00100000:2.0:1782759502.906210:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355232919808:0@lo:1000:mdt00_002.0 00000040:00080000:2.0:1782759502.906754:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].32, 1000 off65432 00000040:00080000:2.0:1782759502.906820:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].33, 1152 off69736 00000004:00080000:2.0:1782759502.906826:0:6533:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4ccde40 with version 66 00000004:00080000:0.0:1782759502.906864:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 66 rpc_version 66 00000020:00100000:0.0:1782759502.906885:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759502.906892:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc479f800 x1869355232920064/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759502.906907:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232920064:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759502.906958:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759502.906978:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90a80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759502.907001:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920064 00000100:00100000:3.0:1782759502.907005:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920064 00000100:00100000:3.0:1782759502.907041:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:3.0:1782759502.907051:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232920064:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759502.907418:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+11:7476:x1869355232920064:12345-0@lo:1000:osp_up0-1.0 Request processed in 368us (466us total) trans 4294967994 rc 0/0 00000100:00100000:3.0:1782759502.907427:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00100000:0.0:1782759502.907493:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232920064:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1782759502.909042:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909060:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909074:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759502.909091:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aebd913f reply state 0000000032a56e8d transno 4294967698 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909103:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909110:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3700) 00010000:00010000:1.0:1782759502.909113:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759502.909116:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759502.909124:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1c:0x0]: returning size 4096 00000004:00080000:1.0:1782759502.909132:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:1.0:1782759502.909142:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909151:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909158:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759502.909181:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1782759502.909186:0:6533:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:1.0:1782759502.909191:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909202:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759502.909206:0:6533:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909209:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 2/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909224:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759502.909228:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759502.909234:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909259:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909264:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759502.909286:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 1/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909296:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649400/0xd5b45c7f5c60caa4 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60caab expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759502.909303:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108048:x1869355218521472:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 6258us (6411us total) trans 4294967698 rc 0/0 00000100:00100000:1.0:1782759502.909315:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2885 00010000:00010000:2.0:1782759502.909316:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759502.909318:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759502.909320:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759502.909329:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232920192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759502.909378:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759502.909405:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920192 00000100:00100000:2.0:1782759502.909411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920192 00000100:00100000:2.0:1782759502.909464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1782759502.909476:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3663:x1869355232920192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759502.909488:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759502.909504:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60caab lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60caa4 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.909518:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:2.0:1782759502.909526:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759502.909562:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3663:x1869355232920192:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.909569:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1782759502.909617:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232920192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759502.915310:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.917552:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218521728 00000100:00100000:0.0:1782759502.917561:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218521728 00000100:00100000:0.0:1782759502.917656:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2886 00000100:00100000:0.0:1782759502.917668:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:108049:x1869355218521728:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759502.917688:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759502.917708:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cac7 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273bc expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.917804:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.917818:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.917829:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.917849:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.917856:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.917864:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759502.918182:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x21:0x0], index 1: 0 00010000:00010000:0.0:1782759502.918347:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cadc lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918354:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cadc lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918360:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cadc lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759502.918403:0:6532:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967995 00010000:00010000:0.0:1782759502.918446:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918455:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918461:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918468:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918482:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759502.918486:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918491:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918502:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3502e00) 00010000:00010000:0.0:1782759502.918506:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759502.918510:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918516:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cace lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759502.918532:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013f14149 reply state 00000000bf712826 transno 4294967996 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918543:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.918549:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc3502a00) 00010000:00010000:0.0:1782759502.918551:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759502.918554:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759502.919858:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cac7 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273bc expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.919884:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cadc lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273bc expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759502.919914:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc3502400) 00010000:00010000:0.0:1782759502.919917:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759502.919921:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759502.919988:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:108049:x1869355218521728:12345-192.168.202.31@tcp:101:touch.0 Request processed in 2322us (4685us total) trans 4294967996 rc 0/0 00000100:00100000:0.0:1782759502.919998:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2886 00000020:00080000:0.0:1782759502.920004:0:6532:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782759502.924777:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759502.924951:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218521984 00000100:00100000:3.0:1782759502.924961:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218521984 00000100:00100000:3.0:1782759502.925030:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2887 00000100:00100000:3.0:1782759502.925042:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:108049:x1869355218521984:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:3.0:1782759502.925110:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759502.925138:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cadc lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273bc expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.925157:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc3502400) 00010000:00010000:3.0:1782759502.925168:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759502.925224:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.925238:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.925248:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759502.925387:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb2a8edb reply state 000000008a3b6185 transno 4294967997 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.925400:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759502.925407:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759502.925410:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759502.925412:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759502.925499:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108049:x1869355218521984:12345-192.168.202.31@tcp:36:touch.0 Request processed in 460us (729us total) trans 4294967997 rc 0/0 00000100:00100000:3.0:1782759502.925506:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2887 00000100:00100000:1.0:1782759502.927901:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.927945:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218522112 00000100:00100000:2.0:1782759502.927956:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218522112 00000100:00100000:2.0:1782759502.928019:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2888 00000100:00100000:2.0:1782759502.928031:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108049:x1869355218522112:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759502.928052:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759502.928067:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60caf1 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273c3 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.928136:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60caf1 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273c3 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.928151:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60caf1 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273c3 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759502.928184:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:2.0:1782759502.928187:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759502.928190:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759502.928240:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:108049:x1869355218522112:12345-192.168.202.31@tcp:101:touch.0 Request processed in 211us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.928248:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2888 00000100:00100000:1.0:1782759502.929722:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759502.929774:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218522240 00000100:00100000:3.0:1782759502.929782:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218522240 00000100:00100000:3.0:1782759502.929832:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1076 00000100:00100000:3.0:1782759502.929854:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218522240:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:3.0:1782759502.930043:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218522240:12345-192.168.202.31@tcp:2:touch.0 Request processed in 191us (327us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782759502.930051:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1076 00000100:00100000:1.0:1782759502.931063:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.931113:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218522496 00000100:00100000:0.0:1782759502.931118:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218522496 00000100:00100000:0.0:1782759502.931167:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 333 00000100:00100000:0.0:1782759502.931176:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:108049:x1869355218522496:12345-192.168.202.31@tcp:35:touch.0 00000001:00080000:0.0:1782759502.931385:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967998 00000100:00100000:0.0:1782759502.931478:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108049:x1869355218522496:12345-192.168.202.31@tcp:35:touch.0 Request processed in 304us (429us total) trans 4294967999 rc 0/0 00000100:00100000:0.0:1782759502.931486:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 333 00000020:00080000:0.0:1782759502.931491:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782759502.945222:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.945310:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218522624 00000100:00100000:0.0:1782759502.945320:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218522624 00000100:00100000:0.0:1782759502.945377:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2889 00000100:00100000:0.0:1782759502.945385:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218522624:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1782759502.945665:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218522624:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 280us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.945672:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2889 00000100:00100000:1.0:1782759502.946438:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.946492:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218522752 00000100:00100000:0.0:1782759502.946497:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218522752 00000100:00100000:0.0:1782759502.946543:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2890 00000100:00100000:0.0:1782759502.946551:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218522752:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000040:00080000:0.0:1782759502.946628:0:12673:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:0.0:1782759502.946686:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218522752:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 136us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.946694:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2890 00000100:00100000:1.0:1782759502.947783:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.947826:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218522880 00000100:00100000:2.0:1782759502.947833:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218522880 00000100:00100000:2.0:1782759502.947885:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2891 00000100:00100000:2.0:1782759502.947897:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218522880:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1782759502.947947:0:6533:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759502.947995:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218522880:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.948001:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2891 00000100:00100000:1.0:1782759502.948686:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.948724:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523008 00000100:00100000:2.0:1782759502.948730:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523008 00000100:00100000:2.0:1782759502.948765:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2892 00000100:00100000:2.0:1782759502.948773:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523008:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1782759502.948813:0:6532:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759502.948857:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523008:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 84us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.948863:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2892 00000100:00100000:1.0:1782759502.949684:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759502.949828:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523136 00000100:00100000:3.0:1782759502.949833:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523136 00000100:00100000:3.0:1782759502.949863:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2893 00000100:00100000:3.0:1782759502.949870:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523136:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1782759502.949959:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523136:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.949965:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2893 00000100:00100000:1.0:1782759502.950645:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.950738:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523264 00000100:00100000:2.0:1782759502.950744:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523264 00000100:00100000:2.0:1782759502.950795:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2894 00000100:00100000:2.0:1782759502.950804:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523264:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1782759502.950885:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523264:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.950892:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2894 00000100:00100000:1.0:1782759502.951738:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.951785:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523392 00000100:00100000:0.0:1782759502.951792:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523392 00000100:00100000:0.0:1782759502.951830:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2895 00000100:00100000:0.0:1782759502.951837:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523392:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1782759502.951929:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523392:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 91us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.951935:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2895 00000100:00100000:1.0:1782759502.952932:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.952986:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523520 00000100:00100000:0.0:1782759502.952992:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523520 00000100:00100000:0.0:1782759502.953023:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2896 00000100:00100000:0.0:1782759502.953030:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523520:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1782759502.953111:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108053:x1869355218523520:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 80us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.953118:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2896 00000100:00100000:1.0:1782759502.971745:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.971812:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523648 00000100:00100000:2.0:1782759502.971821:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523648 00000100:00100000:2.0:1782759502.971888:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2897 00000100:00100000:2.0:1782759502.971902:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218523648:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759502.972048:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218523648:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 151us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.972054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2897 00000100:00100000:1.0:1782759502.972789:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.972841:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523776 00000100:00100000:2.0:1782759502.972846:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523776 00000100:00100000:2.0:1782759502.972882:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2898 00000100:00100000:2.0:1782759502.972892:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218523776:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000040:00080000:2.0:1782759502.972950:0:6532:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759502.972993:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218523776:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.973000:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2898 00000100:00100000:1.0:1782759502.976741:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759502.976824:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218523904 00000100:00100000:3.0:1782759502.976832:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218523904 00000100:00100000:3.0:1782759502.976881:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2899 00000100:00100000:3.0:1782759502.976893:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218523904:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:3.0:1782759502.976958:0:6531:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:3.0:1782759502.977015:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218523904:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 126us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759502.977021:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2899 00000100:00100000:1.0:1782759502.977754:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.978198:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524032 00000100:00100000:2.0:1782759502.978204:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524032 00000100:00100000:2.0:1782759502.978264:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2900 00000100:00100000:2.0:1782759502.978275:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524032:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000040:00080000:2.0:1782759502.978320:0:8593:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x5:0x0] first idx 0, last_idx 1 00000100:00100000:2.0:1782759502.978366:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524032:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 94us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.978374:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2900 00000100:00100000:1.0:1782759502.979419:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.979561:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524160 00000100:00100000:0.0:1782759502.979567:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524160 00000100:00100000:0.0:1782759502.979649:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2901 00000100:00100000:0.0:1782759502.979661:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524160:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1782759502.979781:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524160:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 122us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.979796:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2901 00000100:00100000:1.0:1782759502.980530:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759502.980600:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524288 00000100:00100000:0.0:1782759502.980605:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524288 00000100:00100000:0.0:1782759502.980652:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2902 00000100:00100000:0.0:1782759502.980662:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524288:12345-192.168.202.31@tcp:503:chlg_load_threa.0 00000100:00100000:0.0:1782759502.980750:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524288:12345-192.168.202.31@tcp:503:chlg_load_threa.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759502.980759:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2902 00000100:00100000:1.0:1782759502.981763:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.982150:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524416 00000100:00100000:2.0:1782759502.982157:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524416 00000100:00100000:2.0:1782759502.982199:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2903 00000100:00100000:2.0:1782759502.982206:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524416:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1782759502.982279:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524416:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 74us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.982287:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2903 00000100:00100000:1.0:1782759502.983088:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759502.983145:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524544 00000100:00100000:2.0:1782759502.983150:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524544 00000100:00100000:2.0:1782759502.983184:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2904 00000100:00100000:2.0:1782759502.983194:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524544:12345-192.168.202.31@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1782759502.983259:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108058:x1869355218524544:12345-192.168.202.31@tcp:502:chlg_load_threa.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759502.983266:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2904 00000100:00100000:1.0:1782759503.012219:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759503.012331:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524672 00000100:00100000:3.0:1782759503.012340:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524672 00000100:00080000:0.0:1782759503.012406:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759503.012451:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2905 00000100:00100000:3.0:1782759503.012462:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108067:x1869355218524672:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:3.0:1782759503.012499:0:6531:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff8cdefab9cef8 uarg=0000000000000000 00000004:00000080:3.0:1782759503.012535:0:6531:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff8cdefab9cef8 00000004:00000080:3.0:1782759503.012554:0:6531:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1782759503.012621:0:6531:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.012625:0:6531:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1782759503.012662:0:6531:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 19 00000040:00080000:3.0:1782759503.012710:0:6531:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:3.0:1782759503.012718:0:6531:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759503.012725:0:6531:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1782759503.012741:0:6531:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759503.012744:0:6531:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759503.012862:0:6531:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 19 count 1 00000040:00080000:3.0:1782759503.012868:0:6531:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:3.0:1782759503.012948:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108067:x1869355218524672:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 487us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.012955:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2905 00000100:00100000:1.0:1782759503.030512:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759503.030569:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524800 00000100:00100000:2.0:1782759503.030596:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524800 00000100:00080000:0.0:1782759503.030668:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759503.030680:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2906 00000100:00100000:2.0:1782759503.030693:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108069:x1869355218524800:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:2.0:1782759503.030744:0:8593:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff8cdefab9d0d8 uarg=0000000000000000 00000004:00000080:2.0:1782759503.030785:0:8593:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff8cdefab9d0d8 00000004:00000080:2.0:1782759503.030790:0:8593:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=2, endrec=0 00000040:00080000:2.0:1782759503.030819:0:8593:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759503.030822:0:8593:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1782759503.030836:0:8593:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl2 endrec = 5 00000040:00080000:2.0:1782759503.030884:0:8593:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:2.0:1782759503.030892:0:8593:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1782759503.030895:0:8593:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:2.0:1782759503.030906:0:8593:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759503.030908:0:8593:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1782759503.030955:0:8593:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 5 count 1 00000040:00080000:2.0:1782759503.030960:0:8593:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:2.0:1782759503.031034:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108069:x1869355218524800:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 346us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759503.031040:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2906 00000100:00100000:0.0:1782759503.037698:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759503.037767:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218524928 00000100:00100000:1.0:1782759503.037777:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218524928 00000100:00100000:1.0:1782759503.037839:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2907 00000100:00100000:1.0:1782759503.037849:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108070:x1869355218524928:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759503.037867:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759503.037888:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60caf8 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273ca expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.037958:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.037971:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.037981:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.037993:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.038003:0:42628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cab2 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.038012:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 4/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.038043:0:42628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cab2 expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759503.038078:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355232920320:0@lo:104: 00000100:00100000:1.0:1782759503.038132:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759503.038184:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920320 00000100:00100000:1.0:1782759503.038187:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759503.038189:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920320 00000100:00100000:3.0:1782759503.038216:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1782759503.038222:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355232920320:12345-0@lo:104: 00010000:00010000:3.0:1782759503.038232:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.038280:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759503.038287:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355232920320:12345-0@lo:104: Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.038293:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1782759503.038372:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355232920320:0@lo:104: 00010000:00010000:1.0:1782759503.038393:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.038423:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759503.038431:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.038441:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759503.038447:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759503.038457:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.038482:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.038489:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759503.038515:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 1/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.038530:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf648c00/0xd5b45c7f5c60cab2 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cab9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759503.038540:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232920448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759503.038553:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759503.038557:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759503.038559:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759503.038609:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759503.038700:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920448 00000100:00100000:1.0:1782759503.038704:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920448 00010000:00010000:1.0:1782759503.038718:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cab2 expref: 10 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759503.038738:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1782759503.038742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5717850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3664:x1869355232920448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759503.038750:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1782759503.040741:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967999 is committed 00000001:00080000:1.0:1782759503.040764:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967994 is committed 00010000:00010000:2.0:1782759503.040773:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040783:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040789:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040793:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759503.040804:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040810:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040823:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc3502a00) 00010000:00010000:2.0:1782759503.040825:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759503.040827:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040832:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cad5 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040851:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040855:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040861:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040866:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759503.040869:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040876:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040884:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:2.0:1782759503.040887:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759503.040893:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cab9 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cab2 expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040898:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.040911:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60caea lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.040912:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759503.040925:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.040935:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.040943:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 4/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.040969:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759503.040996:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041003:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759503.041043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5717850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232920448:12345-0@lo:103:ldlm_bl.0 Request processed in 2298us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.041052:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1782759503.041156:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:42628:1869355232920576:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782759503.041161:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232920448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759503.041218:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759503.041246:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759503.041300:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920576 00000100:00100000:3.0:1782759503.041304:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920576 00000100:00100000:3.0:1782759503.041352:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238 00000100:00100000:3.0:1782759503.041358:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42628:x1869355232920576:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1782759503.041550:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42628:x1869355232920576:12345-0@lo:1000:mdt00_005.0 Request processed in 192us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.041555:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238 00000100:00100000:1.0:1782759503.041670:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:42628:1869355232920576:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1782759503.041702:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cb0d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041709:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cb0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041715:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cb0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759503.041730:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cb0d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041740:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041743:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041749:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041755:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041761:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759503.041764:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041771:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041779:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3d00) 00010000:00010000:1.0:1782759503.041787:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759503.041791:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041797:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60caff lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041806:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041812:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041818:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041823:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759503.041825:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041829:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041834:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4e00) 00010000:00010000:1.0:1782759503.041835:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759503.041837:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041841:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb06 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041863:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60caf8 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ca expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041880:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cb0d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ca expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.041884:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3c00) 00010000:00010000:1.0:1782759503.041886:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759503.041887:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759503.041920:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108070:x1869355218524928:12345-192.168.202.31@tcp:101:rm.0 Request processed in 4074us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759503.041924:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2907 00000100:00100000:1.0:1782759503.044622:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759503.044681:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218525056 00000100:00100000:3.0:1782759503.044690:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218525056 00000100:00100000:3.0:1782759503.044748:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2908 00000100:00100000:3.0:1782759503.044759:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108070:x1869355218525056:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759503.044778:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759503.044795:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cb14 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273d1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.044848:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60cb1b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.044869:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60cb1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.044876:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60cb1b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759503.044916:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1c:0x0]: returning size 4096 00000004:00200000:3.0:1782759503.044919:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1782759503.044943:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cb14 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273d1 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.044954:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60cb1b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273d1 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.044960:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3700) 00010000:00010000:3.0:1782759503.044962:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759503.044964:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:3.0:1782759503.045004:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:108070:x1869355218525056:12345-192.168.202.31@tcp:101:rm.0 Request processed in 248us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.045009:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2908 00000100:00100000:0.0:1782759503.049783:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759503.049846:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218525312 00000100:00100000:1.0:1782759503.049854:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218525312 00000100:00100000:1.0:1782759503.049903:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2909 00000100:00100000:1.0:1782759503.049909:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:108070:x1869355218525312:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759503.049925:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759503.049942:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60cb22 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273d8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759503.050015:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1c:0x0]: returning size 4096 00010000:00010000:1.0:1782759503.050156:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60cb22 lrc: 1/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273d8 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.050166:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3d00) 00010000:00010000:1.0:1782759503.050168:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759503.050177:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60cb22 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273d8 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.050202:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759503.050248:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:108070:x1869355218525312:12345-192.168.202.31@tcp:101:rm.0 Request processed in 339us (475us total) trans 4294967699 rc 301/301 00000100:00100000:1.0:1782759503.050253:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2909 00000100:00100000:0.0:1782759503.052021:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759503.052062:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218525440 00000100:00100000:3.0:1782759503.052069:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218525440 00000100:00100000:3.0:1782759503.052108:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 334 00000100:00100000:3.0:1782759503.052116:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:108070:x1869355218525440:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:3.0:1782759503.055016:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:108070:x1869355218525440:12345-192.168.202.31@tcp:37:rm.0 Request processed in 2894us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.055025:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 334 00000100:00100000:0.0:1782759503.057937:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759503.057978:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218525696 00000100:00100000:1.0:1782759503.057987:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218525696 00000100:00100000:1.0:1782759503.058027:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 335 00000100:00100000:1.0:1782759503.058035:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:108070:x1869355218525696:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:1.0:1782759503.058266:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108070:x1869355218525696:12345-192.168.202.31@tcp:35:rm.0 Request processed in 232us (337us total) trans 4294967700 rc 0/0 00000100:00100000:1.0:1782759503.058272:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 335 00000100:00100000:0.0:1782759503.059960:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759503.060011:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218525824 00000100:00100000:3.0:1782759503.060016:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218525824 00000100:00100000:3.0:1782759503.060051:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 398 00000100:00100000:3.0:1782759503.060057:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218525824:12345-192.168.202.31@tcp:103:rm.0 00010000:00010000:3.0:1782759503.060068:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759503.060087:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cb0d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ca expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.060101:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3c00) 00010000:00010000:3.0:1782759503.060107:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759503.060179:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218525824:12345-192.168.202.31@tcp:103:rm.0 Request processed in 120us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.060186:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 398 00000100:00100000:0.0:1782759503.061555:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759503.061629:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218526080 00000100:00100000:2.0:1782759503.061646:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218526080 00000100:00100000:2.0:1782759503.061703:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2910 00000100:00100000:2.0:1782759503.061712:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108070:x1869355218526080:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1782759503.061755:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759503.061771:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60cb1b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273d1 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.061782:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3700) 00010000:00010000:2.0:1782759503.061784:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759503.061821:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.061827:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.061833:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759503.061847:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232920704:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1782759503.061878:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759503.061902:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759503.061938:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920704 00000100:00100000:3.0:1782759503.061941:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920704 00000100:00100000:3.0:1782759503.061980:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00100000:3.0:1782759503.061985:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355232920704:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759503.061993:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759503.062003:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cb37 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cb30 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.062018:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cb37 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb30 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.062026:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cb37 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb30 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.062031:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759503.062043:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759503.062045:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759503.062069:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6532:x1869355232920704:12345-0@lo:101:mdt00_001.0 Request processed in 84us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.062073:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:2.0:1782759503.062228:0:6532:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967994 gen 2 00000004:00080000:2.0:1782759503.062239:0:6532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967992 committed transno 4294967994 00000004:00080000:2.0:1782759503.062259:0:6532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967993 committed transno 4294967994 00000004:00080000:2.0:1782759503.062267:0:6532:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967994 committed transno 4294967994 00000100:00100000:2.0:1782759503.062283:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232920704:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759503.062297:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.062306:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759503.062320:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:2.0:1782759503.062338:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.062344:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.062352:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759503.062363:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232920832:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1782759503.062387:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759503.062409:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759503.062453:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920832 00000100:00100000:3.0:1782759503.062458:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920832 00000100:00100000:3.0:1782759503.062487:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:3.0:1782759503.062492:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6532:x1869355232920832:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759503.062498:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759503.062505:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cb3e expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.062516:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb3e expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.062522:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb3e expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.062527:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:3.0:1782759503.062529:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759503.062530:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759503.062554:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232920832:12345-0@lo:101:mdt00_001.0 Request processed in 62us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.062557:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00100000:2.0:1782759503.062699:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232920832:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1782759503.062710:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.062719:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782759503.062740:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00000100:00100000:2.0:1782759503.062766:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232920960:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759503.062790:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759503.062811:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759503.062896:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232920960 00000100:00100000:0.0:1782759503.062899:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232920960 00000100:00100000:0.0:1782759503.062926:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3241 00000100:00100000:0.0:1782759503.062931:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232920960:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759503.062976:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232920960:12345-0@lo:1000:mdt00_001.0 Request processed in 46us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759503.062980:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3241 00000100:00100000:2.0:1782759503.063037:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232920960:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759503.063062:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232921088:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759503.063076:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759503.063092:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759503.063220:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921088 00000100:00100000:0.0:1782759503.063223:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921088 00000100:00100000:0.0:1782759503.063247:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3242 00000100:00100000:0.0:1782759503.063251:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232921088:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759503.063385:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232921088:12345-0@lo:1000:mdt00_001.0 Request processed in 133us (306us total) trans 0 rc 1/1 00000100:00100000:0.0:1782759503.063391:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3242 00000100:00100000:3.0:1782759503.063485:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232921088:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782759503.063513:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.063523:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.063528:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759503.063536:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232921216:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782759503.063552:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759503.063711:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759503.063791:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921216 00000100:00100000:0.0:1782759503.063798:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921216 00000100:00100000:0.0:1782759503.063844:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3243 00000100:00100000:0.0:1782759503.063849:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232921216:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1782759503.063854:0:39509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759503.063862:0:39509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cb53 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cb4c expref: -99 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.063873:0:39509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cb53 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb4c expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.063879:0:39509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cb53 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb4c expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.063884:0:39509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759503.063885:0:39509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759503.063887:0:39509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759503.063912:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6532:x1869355232921216:12345-0@lo:101:mdt00_001.0 Request processed in 64us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759503.063916:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3243 00000100:00100000:3.0:1782759503.063948:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232921216:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759503.063955:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.063961:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.063975:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.063981:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.063986:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759503.064357:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].34, 432 off65968 00000040:00080000:3.0:1782759503.064397:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].34, 512 off70248 00000004:00080000:3.0:1782759503.064402:0:6532:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc686c000 with version 67 00000004:00080000:1.0:1782759503.064441:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 67 rpc_version 67 00000020:00100000:1.0:1782759503.064467:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759503.064476:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc36fd880 x1869355232921472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759503.064493:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232921472:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759503.064526:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759503.064554:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759503.064595:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921472 00000100:00100000:2.0:1782759503.064599:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921472 00000100:00100000:2.0:1782759503.064633:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244 00000100:00100000:2.0:1782759503.064651:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232921472:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759503.064895:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+10:7476:x1869355232921472:12345-0@lo:1000:osp_up0-1.0 Request processed in 247us (369us total) trans 4294968000 rc 0/0 00000100:00100000:2.0:1782759503.064900:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244 00000100:00100000:1.0:1782759503.064940:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232921472:0@lo:1000:osp_up0-1.0 00000004:00200000:2.0:1782759503.065013:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1c:0x0]: returning size 4096 00010000:00010000:2.0:1782759503.065026:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065032:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065036:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065039:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759503.065042:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065052:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065060:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3700) 00010000:00010000:2.0:1782759503.065062:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759503.065064:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065068:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cb5a lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065075:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065080:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065084:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065100:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782759503.065106:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:2.0:1782759503.065109:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065112:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065117:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065134:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:2.0:1782759503.065138:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000421:0x17:0x0] 00010000:00010000:2.0:1782759503.065142:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.065149:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759503.065204:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108070:x1869355218526080:12345-192.168.202.31@tcp:36:rm.0 Request processed in 3493us (3651us total) trans 4294967701 rc 0/0 00000100:00100000:2.0:1782759503.065209:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2910 00010000:00010000:3.0:1782759503.065279:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759503.065290:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065297:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759503.065301:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759503.065310:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065329:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 2/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065333:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759503.065349:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 1/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065353:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60cb4c lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cb53 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065363:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759503.065365:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 2/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065369:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:3.0:1782759503.065372:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759503.065376:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065390:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065394:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759503.065403:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 1/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065408:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649c00/0xd5b45c7f5c60cb30 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cb37 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065416:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759503.065417:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759503.065418:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759503.065423:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759503.065429:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232921728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759503.065450:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759503.065467:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921728 00000100:00100000:3.0:1782759503.065469:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921728 00000100:00100000:3.0:1782759503.065487:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782759503.065491:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3663:x1869355232921728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759503.065497:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759503.065506:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cb37 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb30 expref: 10 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065513:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759503.065517:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759503.065533:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3663:x1869355232921728:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.065541:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782759503.065559:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232921728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759503.065607:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759503.065615:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232921600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759503.065649:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759503.065674:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921600 00000100:00100000:3.0:1782759503.065677:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921600 00000100:00100000:3.0:1782759503.065712:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1782759503.065719:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3664:x1869355232921600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759503.065727:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759503.065736:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cb53 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb4c expref: 9 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.065744:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:3.0:1782759503.065751:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759503.065769:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3664:x1869355232921600:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.065773:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1782759503.065790:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232921600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759503.066067:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759503.067208:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759503.067319:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218526208 00000100:00100000:3.0:1782759503.067322:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218526208 00000100:00100000:3.0:1782759503.067351:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2911 00000100:00100000:3.0:1782759503.067356:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:108070:x1869355218526208:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759503.067365:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759503.067377:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cb61 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273df expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067421:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067429:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067435:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067441:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067445:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067449:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067492:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067497:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067500:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759503.067527:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1b:0x0]: returning size 0 00000004:00200000:3.0:1782759503.067530:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759503.067542:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067557:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067563:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067569:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067681:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067690:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067704:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759503.067708:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067715:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067725:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:3.0:1782759503.067728:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759503.067731:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067737:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cb68 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067749:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067759:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067763:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067765:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759503.067767:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067771:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067776:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34f4b00) 00010000:00010000:3.0:1782759503.067778:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759503.067779:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067783:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cb6f lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067801:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cb61 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273df expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067809:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273df expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.067814:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759503.067815:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759503.067821:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759503.067884:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108070:x1869355218526208:12345-192.168.202.31@tcp:101:rm.0 Request processed in 528us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759503.067889:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2911 00000100:00100000:3.0:1782759503.070699:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759503.070817:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218526336 00000100:00100000:1.0:1782759503.070825:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218526336 00000100:00080000:0.0:1782759503.070874:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759503.070898:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1077 00000100:00100000:1.0:1782759503.070911:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218526336:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759503.070939:0:82628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759503.070959:0:82628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273e6 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759503.070982:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x6a42c04f, atime: 0x6a42c04f, ctime: 0x6a42c04f, blocks: 0x0 00010000:00010000:1.0:1782759503.071000:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=3543s v=(0 0) 00010000:00010000:1.0:1782759503.071005:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759503.071014:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 7 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.071032:0:82628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 7 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.071044:0:82628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759503.071095:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218526336:12345-192.168.202.31@tcp:101:rm.0 Request processed in 187us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759503.071102:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1077 00000100:00100000:0.0:1782759503.075207:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759503.075295:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218526592 00000100:00100000:1.0:1782759503.075304:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218526592 00000100:00100000:1.0:1782759503.075353:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2912 00000100:00100000:1.0:1782759503.075360:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108070:x1869355218526592:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:1.0:1782759503.075402:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759503.075422:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60cb76 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273df expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075437:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60caf1 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273c3 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075456:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:1.0:1782759503.075463:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759503.075481:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075490:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075497:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075503:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075506:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075510:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075709:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075719:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.075727:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759503.075912:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10144 00000004:00080000:1.0:1782759503.075921:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3543352343346ns, next at 3544352341305ns, rc = 0 00010000:00010000:1.0:1782759503.076011:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076018:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076024:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076029:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076033:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076036:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076053:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759503.076067:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076070:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076074:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076077:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759503.076080:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076084:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076095:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cdecd4e3e00) 00010000:00010000:1.0:1782759503.076097:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1782759503.076099:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076103:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cb92 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x1b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076113:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076116:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076120:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076123:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076126:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759503.076127:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076130:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076134:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3f00) 00010000:00010000:1.0:1782759503.076135:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759503.076136:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076149:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cb84 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759503.076161:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092beb55b reply state 0000000089371a8c transno 4294968001 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076172:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759503.076178:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cdecd4e3a00) 00010000:00010000:1.0:1782759503.076181:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759503.076183:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759503.076239:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108070:x1869355218526592:12345-192.168.202.31@tcp:36:rm.0 Request processed in 879us (1039us total) trans 4294968001 rc 0/0 00000100:00100000:1.0:1782759503.076244:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2912 00010000:00010000:0.0:1782759503.076496:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759503.076502:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.076509:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759503.076512:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.076529:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.076538:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1b:0x0].0x0 (ffff8cdecd4e3e00) 00010000:00010000:0.0:1782759503.076540:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782759503.076544:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 1/0,0 mode: --/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.076549:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cb99 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.076561:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759503.076563:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759503.076564:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759503.178847:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759503.412252:0:148764:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe5a481d0 20000000:00000080:0.0:1782759503.412268:0:148764:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e55800 uarg=0000000000000000 00010000:00010000:0.0:1782759503.412450:0:148764:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759503.412465:0:148764:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759503.412485:0:148764:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759503.412496:0:148764:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759503.412515:0:148764:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759503.412546:0:148764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.412562:0:148764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.412571:0:148764:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.412929:0:148764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.412944:0:148764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 23 pid: 6526 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759503.412960:0:148764:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148764:1869355232921856:0@lo:104: 00000100:00100000:0.0:1782759503.413015:0:148764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759503.413052:0:148764:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2629000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759503.413121:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921856 00000100:00100000:2.0:1782759503.413128:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921856 00000100:00100000:2.0:1782759503.413176:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:2.0:1782759503.413185:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:148764:x1869355232921856:12345-0@lo:104: 00010000:00010000:2.0:1782759503.413196:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759503.413256:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759503.413262:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:148764:x1869355232921856:12345-0@lo:104: Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759503.413269:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00010000:00010000:3.0:1782759503.413280:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759503.413289:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413298:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759503.413302:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413311:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759503.413319:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759503.413325:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:0.0:1782759503.413348:0:148764:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:148764:1869355232921856:0@lo:104: 00010000:00010000:3.0:1782759503.413359:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413366:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759503.413372:0:148764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413389:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759503.413394:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1782759503.413397:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc000/0xd5b45c7f5c60ca96 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ca9d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413421:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759503.413423:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759503.413425:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759503.413497:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232921984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759503.413527:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759503.413568:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232921984 00000100:00100000:0.0:1782759503.413572:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232921984 00010000:00010000:0.0:1782759503.413611:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 24 pid: 6526 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759503.413650:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1782759503.413657:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232921984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759503.413667:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759503.413672:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 24 pid: 6526 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413683:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 24 pid: 6526 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413697:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60ca9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ca96 expref: 24 pid: 6526 timeout: 3693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413714:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413721:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413733:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413739:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413746:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413753:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413757:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759503.413761:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413766:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413784:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759503.413792:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759503.413814:0:148764:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413823:0:148764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759503.413830:0:148764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cba0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759503.413834:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232921984:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759503.413848:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1782759503.413923:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232921984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759503.755717:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759503.755737:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232922112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759503.755809:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759503.755841:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232922112 00000100:00100000:0.0:1782759503.755850:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232922112 00000100:00100000:0.0:1782759503.755908:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245 00000100:00100000:0.0:1782759503.755918:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232922112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759503.755961:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445879808 avail 1299640320 00000100:00100000:0.0:1782759503.756012:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232922112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759503.756019:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245 00000100:00100000:1.0:1782759503.756070:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232922112:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759504.202788:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759504.608752:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759504.608801:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218526848 00000100:00100000:1.0:1782759504.608811:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218526848 00000100:00100000:1.0:1782759504.608886:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2913 00000100:00100000:1.0:1782759504.608902:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108143:x1869355218526848:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:1.0:1782759504.609017:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.609034:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.609054:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.609067:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.609077:0:42628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cb3e expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.609086:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 4/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.609118:0:42628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cb3e expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759504.609135:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4fa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355232922240:0@lo:104: 00000100:00100000:1.0:1782759504.609334:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759504.609386:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759504.609395:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232922240 00000100:00100000:2.0:1782759504.609399:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232922240 00000100:00100000:2.0:1782759504.609447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:2.0:1782759504.609455:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355232922240:12345-0@lo:104: 00010000:00010000:2.0:1782759504.609465:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609516:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759504.609523:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355232922240:12345-0@lo:104: Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.609530:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1782759504.609549:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4fa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355232922240:0@lo:104: 00010000:00010000:2.0:1782759504.609554:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759504.609562:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609570:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759504.609599:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609603:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759504.609616:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609651:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 2/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609657:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759504.609683:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 1/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609695:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf649800/0xd5b45c7f5c60cb3e lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cb45 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.609711:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759504.609713:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759504.609716:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759504.609723:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232922368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759504.609809:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759504.609903:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232922368 00000100:00100000:1.0:1782759504.609908:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232922368 00010000:00010000:1.0:1782759504.609929:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cb3e expref: 8 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759504.609977:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1782759504.609985:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232922368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759504.609996:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1782759504.612487:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968001 is committed 00000004:00080000:1.0:1782759504.612499:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00000001:00080000:1.0:1782759504.612512:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968000 is committed 00010000:00010000:3.0:1782759504.612539:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.612554:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.612562:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.612569:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759504.612574:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.612679:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cb45 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cb3e expref: 7 pid: 39509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.612696:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:1.0:1782759504.612701:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.612710:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.612718:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.612743:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759504.612767:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.612779:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cdecd4e3a00) 00010000:00010000:3.0:1782759504.612782:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759504.612792:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.612800:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60cb8b lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759504.612811:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232922368:12345-0@lo:103:ldlm_bl.0 Request processed in 2825us (3000us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.612823:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1782759504.612882:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232922368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759504.612916:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759504.612989:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232922496:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782759504.613026:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759504.613056:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759504.613062:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232922496 00000100:00100000:3.0:1782759504.613068:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232922496 00000100:00100000:3.0:1782759504.613124:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1782759504.613133:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232922496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782759504.613157:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:33 count 1 00010000:00010000:3.0:1782759504.613176:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.613195:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 6 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.613203:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782759504.613208:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759504.613212:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.613235:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 6 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.613253:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 6 pid: 82628 timeout: 3644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759504.613270:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1869355232922624:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759504.613328:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c5e0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1782759504.613616:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759504.613845:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613856:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613865:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759504.613880:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000014e83f1 reply state 00000000a907f73a transno 4294968002 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613891:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613897:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1c:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:1.0:1782759504.613900:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759504.613903:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759504.613908:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1c:0x0]: returning size 4096 00010000:00010000:1.0:1782759504.613916:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613922:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613927:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613934:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613946:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759504.613949:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613956:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613965:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cdecd4e3300) 00010000:00010000:1.0:1782759504.613968:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759504.613971:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.613977:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cba7 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759504.613991:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000014e83f1 reply state 00000000a907f73a transno 4294968002 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.614000:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.614006:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:1.0:1782759504.614008:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759504.614011:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1782759504.614186:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108143:x1869355218526848:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 5288us (5437us total) trans 4294968002 rc 0/0 00000100:00100000:1.0:1782759504.614194:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2913 00000100:00100000:1.0:1782759504.616909:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1869355232922624:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759504.616922:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:1.0:1782759504.616933:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759504.616953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218526976 00000100:00100000:0.0:1782759504.616960:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218526976 00010000:00010000:0.0:1782759504.616992:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 7 pid: 82628 timeout: 3644 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759504.617031:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 801 00000100:00100000:0.0:1782759504.617040:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218526976:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759504.617054:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759504.617060:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 7 pid: 82628 timeout: 3644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.617071:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 7 pid: 82628 timeout: 3644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.617092:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cb7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273e6 expref: 7 pid: 82628 timeout: 3644 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.617114:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759504.617118:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759504.617123:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.617131:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.617235:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759504.617255:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.617265:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.617276:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759504.617284:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218526976:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 242us (362us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759504.617288:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759504.617295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 801 00010000:00010000:1.0:1782759504.617311:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759504.618063:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759504.618071:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.618081:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759504.618085:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.618094:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.618107:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.618114:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286c4592/0xd5b45c7f5c60cbb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.618131:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759504.618133:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759504.618134:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759504.620539:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355232922496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7397us (7502us total) trans 4294967410 rc 0/0 00000004:00080000:0.0:1782759504.620547:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc44f9880/2, rc 0, transno 4294967410 00000100:00100000:1.0:1782759504.620554:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1782759504.620558:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232922496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782759504.624886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759504.624929:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218527232 00000100:00100000:1.0:1782759504.624939:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218527232 00000100:00100000:1.0:1782759504.624983:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2914 00000100:00100000:1.0:1782759504.624991:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:108144:x1869355218527232:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759504.625011:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759504.625030:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cbc3 lrc: 2/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273ed expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.625109:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.625135:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.625146:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.625168:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.625176:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.625183:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759504.625516:0:12673:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1782759504.625755:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cbd8 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625766:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625773:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759504.625830:0:12673:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968003 00010000:00010000:0.0:1782759504.625864:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625881:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625886:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625892:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625896:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759504.625901:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625907:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625918:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc34fe700) 00010000:00010000:0.0:1782759504.625921:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759504.625924:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625930:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60cbca lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759504.625940:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021e078ab reply state 00000000fdbcd7a5 transno 4294968004 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625949:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.625954:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe300) 00010000:00010000:0.0:1782759504.625960:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759504.625963:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759504.625988:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cbc3 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ed expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.626003:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ed expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.626009:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:0.0:1782759504.626011:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759504.626013:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759504.626073:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:108144:x1869355218527232:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1083us (1193us total) trans 4294968004 rc 0/0 00000100:00100000:0.0:1782759504.626080:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2914 00000020:00080000:0.0:1782759504.626085:0:12673:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782759504.628242:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759504.628279:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218527488 00000100:00100000:3.0:1782759504.628286:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218527488 00000100:00100000:3.0:1782759504.628335:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2915 00000100:00100000:3.0:1782759504.628342:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:108144:x1869355218527488:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:3.0:1782759504.628382:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759504.628402:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cbd8 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273ed expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.628415:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:3.0:1782759504.628425:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759504.628867:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.628880:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.628889:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759504.628993:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000120fd652 reply state 0000000018a66c03 transno 4294968005 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.629001:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759504.629006:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:3.0:1782759504.629008:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759504.629010:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759504.629077:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:108144:x1869355218527488:12345-192.168.202.31@tcp:36:touch.0 Request processed in 736us (840us total) trans 4294968005 rc 0/0 00000100:00100000:3.0:1782759504.629083:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2915 00000100:00100000:1.0:1782759504.632850:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.633015:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218527616 00000100:00100000:2.0:1782759504.633024:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218527616 00000100:00100000:2.0:1782759504.633088:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2916 00000100:00100000:2.0:1782759504.633102:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:108144:x1869355218527616:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759504.633126:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759504.633145:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cbed lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273f4 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.633397:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cbed lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273f4 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.633412:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cbed lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273f4 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.633433:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:2.0:1782759504.633436:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759504.633439:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759504.633536:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108144:x1869355218527616:12345-192.168.202.31@tcp:101:touch.0 Request processed in 438us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.633553:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2916 00000100:00100000:3.0:1782759504.637344:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759504.637386:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218527744 00000100:00100000:3.0:1782759504.637396:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218527744 00000100:00100000:3.0:1782759504.637455:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1079 00000100:00100000:3.0:1782759504.637465:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218527744:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:3.0:1782759504.637703:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218527744:12345-192.168.202.31@tcp:2:touch.0 Request processed in 240us (367us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1782759504.637709:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1079 00000100:00080000:3.0:1782759504.637729:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759504.639323:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.639683:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528000 00000100:00100000:2.0:1782759504.639691:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528000 00000100:00100000:2.0:1782759504.639852:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 336 00000100:00100000:2.0:1782759504.639864:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:108144:x1869355218528000:12345-192.168.202.31@tcp:35:touch.0 00000001:00080000:2.0:1782759504.640114:0:66654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294968006 00000100:00100000:2.0:1782759504.640210:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:108144:x1869355218528000:12345-192.168.202.31@tcp:35:touch.0 Request processed in 349us (889us total) trans 4294968007 rc 0/0 00000100:00100000:2.0:1782759504.640219:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 336 00000020:00080000:2.0:1782759504.640223:0:66654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782759504.667919:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.667987:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528128 00000100:00100000:2.0:1782759504.667997:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528128 00000100:00100000:2.0:1782759504.668064:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2917 00000100:00100000:2.0:1782759504.668076:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:108148:x1869355218528128:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759504.668184:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:108148:x1869355218528128:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 112us (273us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759504.668193:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2917 00000100:00100000:3.0:1782759504.691450:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759504.691527:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528256 00000100:00100000:0.0:1782759504.691538:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528256 00000100:00100000:3.0:1782759504.691636:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2918 00000100:00100000:3.0:1782759504.691652:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108151:x1869355218528256:12345-192.168.202.31@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1782759504.691925:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108151:x1869355218528256:12345-192.168.202.31@tcp:501:chlg_load_threa.0 Request processed in 278us (482us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759504.691935:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2918 00000100:00100000:1.0:1782759504.721342:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.721400:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528384 00000100:00100000:2.0:1782759504.721410:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528384 00000100:00100000:2.0:1782759504.721475:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2919 00000100:00100000:2.0:1782759504.721486:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:108158:x1869355218528384:12345-192.168.202.31@tcp:46:lfs.0 00000100:00100000:2.0:1782759504.721613:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:108158:x1869355218528384:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 89us (239us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759504.721646:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2919 00000100:00100000:3.0:1782759504.737724:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759504.737798:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528512 00000100:00100000:0.0:1782759504.737807:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528512 00000100:00100000:0.0:1782759504.737856:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2920 00000100:00100000:0.0:1782759504.737863:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108160:x1869355218528512:12345-192.168.202.31@tcp:46:lfs.0 00000100:00100000:0.0:1782759504.737960:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:108160:x1869355218528512:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 97us (246us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759504.737966:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2920 00000100:00100000:3.0:1782759504.747000:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759504.747188:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528640 00000100:00100000:0.0:1782759504.747198:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528640 00000100:00100000:0.0:1782759504.747268:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2921 00000100:00100000:0.0:1782759504.747279:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:108161:x1869355218528640:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759504.747312:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759504.747348:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cbf4 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb273fb expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747409:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747422:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747435:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747446:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747454:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747460:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747530:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cc09 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747539:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cc09 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747545:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cc09 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759504.747657:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1c:0x0]: returning size 4096 00000004:00200000:0.0:1782759504.747667:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759504.747691:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cc09 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747705:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747712:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747719:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747725:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747731:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759504.747736:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747743:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747767:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759504.747770:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759504.747776:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747783:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cbfb lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747799:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747816:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747821:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747826:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759504.747829:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747836:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747844:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:0.0:1782759504.747847:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759504.747850:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747856:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc02 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747881:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cbf4 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273fb expref: 17 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747903:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cc09 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273fb expref: 16 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.747911:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1c:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:0.0:1782759504.747913:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759504.747921:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759504.747980:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:108161:x1869355218528640:12345-192.168.202.31@tcp:101:rm.0 Request processed in 702us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.747987:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2921 00000100:00100000:1.0:1782759504.751683:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.751847:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218528896 00000100:00100000:2.0:1782759504.751856:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218528896 00000100:00100000:2.0:1782759504.751909:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2922 00000100:00100000:2.0:1782759504.751918:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:108161:x1869355218528896:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759504.751934:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759504.751949:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc10 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27402 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759504.752021:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1c:0x0]: returning size 4096 00010000:00010000:2.0:1782759504.752146:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc10 lrc: 1/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27402 expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.752157:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:2.0:1782759504.752160:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759504.752165:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc10 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27402 expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.752183:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759504.752240:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:108161:x1869355218528896:12345-192.168.202.31@tcp:101:rm.0 Request processed in 323us (565us total) trans 4294968008 rc 301/301 00000100:00100000:2.0:1782759504.752245:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2922 00000100:00100000:3.0:1782759504.756869:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759504.756993:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218529024 00000100:00100000:1.0:1782759504.757003:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218529024 00000100:00100000:1.0:1782759504.757060:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 337 00000100:00100000:1.0:1782759504.757070:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec778b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:108161:x1869355218529024:12345-192.168.202.31@tcp:37:rm.0 00000100:00100000:1.0:1782759504.760517:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec778b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:108161:x1869355218529024:12345-192.168.202.31@tcp:37:rm.0 Request processed in 3442us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.760528:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 337 00000100:00100000:2.0:1782759504.763252:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759504.763467:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218529280 00000100:00100000:3.0:1782759504.763477:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218529280 00000100:00100000:0.0:1782759504.763711:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 338 00000100:00100000:0.0:1782759504.763722:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:108161:x1869355218529280:12345-192.168.202.31@tcp:35:rm.0 00000100:00100000:0.0:1782759504.763953:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:108161:x1869355218529280:12345-192.168.202.31@tcp:35:rm.0 Request processed in 234us (708us total) trans 4294968009 rc 0/0 00000100:00100000:0.0:1782759504.763958:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 338 00000100:00100000:3.0:1782759504.765829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.765921:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218529536 00000100:00100000:2.0:1782759504.765929:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218529536 00000100:00100000:2.0:1782759504.766012:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2923 00000100:00100000:2.0:1782759504.766024:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:108161:x1869355218529536:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:2.0:1782759504.766082:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759504.766105:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cc09 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273fb expref: 18 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766121:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1c:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:2.0:1782759504.766125:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759504.766152:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766165:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766175:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766184:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766190:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766193:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766270:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 3/0,1 mode: --/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766276:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766280:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759504.766513:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1c:0x0]: returning size 4096 00010000:00010000:2.0:1782759504.766526:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766531:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766535:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766539:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759504.766542:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766546:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766552:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1c:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:2.0:1782759504.766554:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782759504.766556:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 2/0,0 mode: --/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766560:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cc2c lrc: 0/0,0 mode: --/EX res: [0x200000421:0x1c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766571:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766640:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766650:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766664:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766669:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759504.766672:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766678:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766687:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:2.0:1782759504.766689:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759504.766691:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766697:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cc1e lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759504.766712:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8c0260f reply state 00000000474b9e71 transno 4294968010 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766723:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.766729:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:2.0:1782759504.766731:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759504.766733:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759504.766798:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:108161:x1869355218529536:12345-192.168.202.31@tcp:36:rm.0 Request processed in 776us (975us total) trans 4294968010 rc 0/0 00000100:00100000:2.0:1782759504.766806:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2923 00000100:00100000:3.0:1782759504.768976:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759504.769032:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218529664 00000100:00100000:2.0:1782759504.769041:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218529664 00000100:00100000:2.0:1782759504.769099:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2924 00000100:00100000:2.0:1782759504.769109:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:108161:x1869355218529664:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759504.769132:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759504.769151:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cc33 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27409 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769223:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 3/1,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769235:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769245:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769256:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769264:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769270:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769332:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769341:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769366:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759504.769417:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1d:0x0]: returning size 0 00000004:00200000:2.0:1782759504.769421:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759504.769442:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769454:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769464:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769470:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769476:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769483:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769486:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759504.769489:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769494:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769502:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc3500e00) 00010000:00010000:2.0:1782759504.769510:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759504.769513:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 3/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769520:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cc3a lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769534:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769540:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769546:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769551:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759504.769554:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769558:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769566:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe300) 00010000:00010000:2.0:1782759504.769569:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759504.769571:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769606:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cc41 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769650:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cc33 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27409 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769687:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27409 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.769694:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:2.0:1782759504.769697:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759504.769699:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759504.769751:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:108161:x1869355218529664:12345-192.168.202.31@tcp:101:rm.0 Request processed in 644us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.769758:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2924 00000100:00100000:3.0:1782759504.771876:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759504.772119:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218529792 00000100:00100000:1.0:1782759504.772136:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218529792 00000100:00100000:1.0:1782759504.772208:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1080 00000100:00100000:1.0:1782759504.772219:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218529792:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759504.772234:0:82628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759504.772252:0:82628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27410 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759504.772286:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a42c051, atime: 0x6a42c051, ctime: 0x6a42c051, blocks: 0x0 00010000:00010000:1.0:1782759504.772301:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=3545s v=(0 0) 00010000:00010000:1.0:1782759504.772304:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759504.772310:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.772332:0:82628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759504.772340:0:82628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759504.772385:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218529792:12345-192.168.202.31@tcp:101:rm.0 Request processed in 169us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.772392:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1080 00000100:00100000:3.0:1782759504.774787:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759504.774992:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530048 00000100:00100000:0.0:1782759504.775001:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530048 00000100:00100000:0.0:1782759504.775056:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2925 00000100:00100000:0.0:1782759504.775067:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:108161:x1869355218530048:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782759504.775123:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1782759504.775148:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cc48 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27409 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775169:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cbed lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb273f4 expref: 19 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775179:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:0.0:1782759504.775184:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759504.775206:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775218:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775238:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775245:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,1 mode: --/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775250:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775254:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775346:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 3/0,1 mode: --/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775354:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775361:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759504.775554:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10616 00000004:00080000:0.0:1782759504.775562:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3545051983998ns, next at 3546051982477ns, rc = 0 00010000:00010000:0.0:1782759504.775670:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775680:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775687:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775704:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775711:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 4/0,1 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775718:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775737:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759504.775756:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 3/0,1 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775761:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759504.775763:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 2/0,0 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775770:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775773:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775787:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759504.775789:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759504.775793:0:9533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775794:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 3/0,0 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775811:0:9533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775813:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 4/0,0 mode: EX/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775828:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:2.0:1782759504.775832:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759504.775834:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 1/0,0 mode: --/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775839:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cc6b lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775840:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:0.0:1782759504.775847:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759504.775851:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 2/0,0 mode: --/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759504.775853:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759504.775861:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759504.775862:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759504.775871:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cc64 lrc: 0/0,0 mode: --/EX res: [0x200000421:0x1d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775888:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775895:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775901:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775906:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775910:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759504.775913:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775919:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775927:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759504.775930:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759504.775932:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 3/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775938:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc56 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759504.775956:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c481be7 reply state 0000000021456ee7 transno 4294968011 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775973:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759504.775980:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe300) 00010000:00010000:0.0:1782759504.775982:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759504.775984:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759504.776052:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:108161:x1869355218530048:12345-192.168.202.31@tcp:36:rm.0 Request processed in 983us (1268us total) trans 4294968011 rc 0/0 00000100:00100000:0.0:1782759504.776060:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2925 00000100:00100000:0.0:1782759504.779812:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232923136:0@lo:400:kworker.0 00000100:00100000:2.0:1782759504.779860:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232922880:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.779887:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759504.779907:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759504.779965:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232923648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.779996:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759504.780008:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232923392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.780029:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232924160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759504.780039:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759504.780060:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232923904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.780065:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759504.780123:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923136 00000100:00100000:3.0:1782759504.780130:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923136 00000100:00100000:3.0:1782759504.780179:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923392 00000100:00100000:3.0:1782759504.780182:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923392 00000100:00100000:3.0:1782759504.780196:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:3.0:1782759504.780204:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232923136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.780409:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232922752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759504.780656:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3247 00000100:00100000:0.0:1782759504.780668:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232923392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.780686:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232923136:12345-0@lo:400:kworker.0 Request processed in 480us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759504.780695:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00100000:3.0:1782759504.780738:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968000 gen 2 00000100:00100000:0.0:1782759504.780740:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232923392:12345-0@lo:400:kworker.0 Request processed in 75us (700us total) trans 0 rc 0/0 00000004:00080000:3.0:1782759504.780746:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968000 committed transno 4294968000 00000100:00100000:3.0:1782759504.780772:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232923136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.780773:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3247 00000100:00100000:3.0:1782759504.780801:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923648 00000100:00100000:3.0:1782759504.780806:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923648 00000100:00100000:0.0:1782759504.780806:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232922880 00000100:00100000:0.0:1782759504.780812:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232922880 00000100:00100000:0.0:1782759504.780842:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3218 00000100:00100000:3.0:1782759504.780848:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924160 00000100:00100000:0.0:1782759504.780851:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232922880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.780853:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924160 00000100:00100000:0.0:1782759504.780887:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232922880:12345-0@lo:400:kworker.0 Request processed in 39us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759504.780893:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5034 00000100:00100000:0.0:1782759504.780907:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3218 00000100:00100000:3.0:1782759504.780908:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232923648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.780950:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232923648:12345-0@lo:400:kworker.0 Request processed in 48us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759504.780957:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5034 00000100:00100000:3.0:1782759504.780969:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5035 00000100:00100000:3.0:1782759504.780977:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232924160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781010:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232924160:12345-0@lo:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.781010:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232923008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781023:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5035 00000100:00100000:0.0:1782759504.781045:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782759504.781057:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759504.781069:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232923520:0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781089:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232923648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.781096:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759504.781103:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232924160:0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781142:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923008 00000100:00100000:3.0:1782759504.781145:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923008 00000100:00100000:0.0:1782759504.781154:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232924032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781174:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923520 00000100:00100000:3.0:1782759504.781178:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923520 00000100:00100000:0.0:1782759504.781193:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759504.781203:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924032 00000100:00100000:3.0:1782759504.781206:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924032 00000100:00100000:0.0:1782759504.781226:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5036 00000100:00100000:0.0:1782759504.781235:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232923008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.781331:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232923008:12345-0@lo:400:kworker.0 Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.781538:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759504.781545:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759504.781566:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232924416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.781573:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232923264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.781613:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759504.781639:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232923776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.781668:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759504.781683:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232924288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.781699:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759504.781725:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232922752 00000100:00100000:1.0:1782759504.781729:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232922752 00000100:00100000:0.0:1782759504.781737:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5036 00000100:00100000:3.0:1782759504.781742:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923264 00000100:00100000:3.0:1782759504.781747:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923264 00000100:00100000:0.0:1782759504.781756:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5037 00000100:00100000:1.0:1782759504.781758:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1782759504.781766:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232922752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759504.781766:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232923520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781772:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5038 00000100:00100000:3.0:1782759504.781782:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232924032:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1782759504.781788:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759504.781799:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232923520:12345-0@lo:400:kworker.0 Request processed in 36us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.781805:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5037 00000100:00100000:0.0:1782759504.781819:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5039 00000100:00100000:0.0:1782759504.781827:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232923264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759504.781832:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232924032:12345-0@lo:400:kworker.0 Request processed in 51us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759504.781835:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355232922752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759504.781844:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5038 00000100:00100000:1.0:1782759504.781849:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:0.0:1782759504.781854:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232923264:12345-0@lo:400:kworker.0 Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.781861:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5039 00000100:00080000:3.0:1782759504.781869:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759504.781877:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923904 00000100:00100000:1.0:1782759504.781882:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923904 00000100:00100000:0.0:1782759504.781886:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232923008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.781907:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232923520:0@lo:400:kworker.0 00000100:00080000:3.0:1782759504.781912:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759504.781913:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232923776 00000100:00100000:1.0:1782759504.781917:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232923776 00000100:00100000:0.0:1782759504.781918:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232924032:0@lo:400:kworker.0 00000100:00080000:3.0:1782759504.781938:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759504.781943:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924288 00000100:00100000:1.0:1782759504.781947:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924288 00000100:00100000:2.0:1782759504.781977:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759504.781999:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232922880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759504.782012:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232923392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.782054:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924416 00000100:00100000:0.0:1782759504.782059:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924416 00000100:00100000:0.0:1782759504.782076:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:0.0:1782759504.782082:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232923904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.782128:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:1.0:1782759504.782133:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232923776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.782157:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232923904:12345-0@lo:400:kworker.0 Request processed in 75us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.782164:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:1.0:1782759504.782169:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232923776:12345-0@lo:400:kworker.0 Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.782171:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232923904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.782179:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1782759504.782187:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1782759504.782187:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232924416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759504.782204:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1782759504.782210:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232924288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759504.782226:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232924416:12345-0@lo:400:kworker.0 Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759504.782232:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1782759504.782241:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232924288:12345-0@lo:400:kworker.0 Request processed in 31us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759504.782246:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232922752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759504.782252:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:2.0:1782759504.782266:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232923264:0@lo:400:kworker.0 00000100:00100000:2.0:1782759504.782320:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232923776:0@lo:400:kworker.0 00000100:00100000:2.0:1782759504.782333:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232924288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759504.782368:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232924416:0@lo:400:kworker.0 00000100:00080000:3.0:1782759504.782617:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1782759505.132070:0:148959:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc80677910 20000000:00000080:0.0:1782759505.132084:0:148959:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd4eac00 uarg=0000000000000000 00010000:00010000:0.0:1782759505.132245:0:148959:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759505.132257:0:148959:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759505.132277:0:148959:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759505.132287:0:148959:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759505.132306:0:148959:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759505.132324:0:148959:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132338:0:148959:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132360:0:148959:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132367:0:148959:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132374:0:148959:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132381:0:148959:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132387:0:148959:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759505.132391:0:148959:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132399:0:148959:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132411:0:148959:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132419:0:148959:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759505.132424:0:148959:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cc72 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 148959 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759505.226665:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759505.226674:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759505.226679:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759505.226709:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759505.226722:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759505.226745:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759505.226757:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759505.226782:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232924544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759505.226852:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759505.226899:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759505.226917:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924544 00000100:00100000:1.0:1782759505.226924:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924544 00000100:00100000:1.0:1782759505.226983:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:1.0:1782759505.226993:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232924544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759505.227008:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759505.227022:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cc79 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759505.227045:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759505.227055:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759505.227064:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759505.227107:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232924544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759505.227130:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:2.0:1782759505.227142:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232924544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759505.227158:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759505.227168:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759505.227186:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759505.227191:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759505.227208:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759505.293928:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759505.293961:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232924672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759505.294029:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759505.294643:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924672 00000100:00100000:0.0:1782759505.294652:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924672 00000100:00100000:0.0:1782759505.294715:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:0.0:1782759505.294726:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232924672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759505.294751:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759505.294806:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232924672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759505.294814:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1782759505.294863:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232924672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759505.802918:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232924800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759505.802988:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759505.803032:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924800 00000100:00100000:0.0:1782759505.803039:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924800 00000100:00100000:0.0:1782759505.803108:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248 00000100:00100000:0.0:1782759505.803187:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232924800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759505.803222:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446133760 avail 1299894272 00000100:00100000:0.0:1782759505.803280:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232924800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759505.803288:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248 00000100:00100000:1.0:1782759505.803444:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232924800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759506.141366:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759506.141400:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759506.141423:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759506.141444:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759506.141466:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759506.141489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530176 00000100:00100000:0.0:1782759506.141497:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530176 00000100:00100000:0.0:1782759506.141531:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3220 00000100:00100000:0.0:1782759506.141544:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218530176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759506.141634:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218530176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759506.141646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3220 00000100:00100000:0.0:1782759506.141687:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530304 00000100:00100000:0.0:1782759506.141690:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530304 00000100:00100000:0.0:1782759506.141720:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530432 00000100:00100000:0.0:1782759506.141723:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530432 00000100:00100000:0.0:1782759506.141745:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5040 00000100:00100000:0.0:1782759506.141751:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:2402:x1869355218530304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759506.141782:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:2402:x1869355218530304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759506.141788:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5040 00000100:00100000:0.0:1782759506.141800:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5041 00000100:00100000:0.0:1782759506.141806:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218530432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759506.141827:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218530432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759506.141833:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5041 00000100:00100000:0.0:1782759506.141849:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530688 00000100:00100000:0.0:1782759506.141851:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530688 00000100:00100000:0.0:1782759506.141877:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530560 00000100:00100000:0.0:1782759506.141880:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530560 00000100:00100000:0.0:1782759506.141903:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2902 00000100:00100000:0.0:1782759506.141910:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218530688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759506.141927:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2903 00000100:00100000:0.0:1782759506.141943:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218530688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759506.141944:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218530560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759506.141958:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2902 00000100:00100000:1.0:1782759506.141988:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218530560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 50us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759506.142003:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2903 00000100:00080000:3.0:1782759506.142037:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759506.142042:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759506.142045:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759506.142048:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759506.251731:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782759506.314720:0:8598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3546591141454ns, next at 3547591138841ns, rc = 0 00000100:00100000:0.0:1782759506.314722:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759506.314743:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232924928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759506.314774:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232925056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759506.314808:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759506.314841:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759506.314864:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232924928 00000100:00100000:2.0:1782759506.314873:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232924928 00000100:00100000:3.0:1782759506.314882:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925056 00000100:00100000:3.0:1782759506.314895:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925056 00000100:00100000:3.0:1782759506.314942:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1782759506.314953:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:3.0:1782759506.314955:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232925056:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759506.314955:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759506.314969:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232924928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759506.314999:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1782759506.314999:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759506.315066:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232925056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759506.315070:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232924928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759506.315079:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:3.0:1782759506.315088:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:0.0:1782759506.315092:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232925056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759506.315129:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232924928:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1782759506.827441:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967416 is committed 00010000:00010000:2.0:1782759507.275854:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759507.852204:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967701 is committed 00000020:00080000:2.0:1782759507.852219:0:7461:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc686ce40 refcount 2 committed 0 result 0 batchid 33 00000020:00080000:2.0:1782759507.852225:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cded2022100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc686c000 00000020:00080000:2.0:1782759507.852229:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].34 00000020:00080000:2.0:1782759507.852233:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cded2022b00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4ab9e00 00000020:00080000:2.0:1782759507.852236:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].34 00010000:00010000:0.0:1782759507.852251:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759507.852262:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782759507.852267:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 31 00010000:00010000:0.0:1782759507.852269:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759507.852271:0:7461:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc4ccdb40 refcount 2 committed 0 result 0 batchid 32 00000020:00080000:2.0:1782759507.852279:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedbc07100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4ccde40 00010000:00010000:0.0:1782759507.852281:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00000020:00080000:2.0:1782759507.852286:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].33 00010000:00010000:0.0:1782759507.852287:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759507.852292:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdedbc07400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc338f600 00010000:00010000:0.0:1782759507.852295:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759507.852297:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].32 00010000:00010000:0.0:1782759507.852318:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1c:0x0].0x0 (ffff8cdecd4e3700) 00000020:00080000:1.0:1782759507.852320:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 33 committed batchid 31 00010000:00010000:0.0:1782759507.852322:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759507.852329:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759507.852337:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60cac0 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1782759507.852379:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 31 00010000:00010000:1.0:1782759508.299719:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759508.643009:0:149302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde7ffa030 20000000:00000080:0.0:1782759508.643023:0:149302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc54cc400 uarg=0000000000000000 10000000:01000000:0.0:1782759508.643068:0:149302:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759508.643085:0:149302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759508.643111:0:149302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759508.643119:0:149302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759508.643155:0:149302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759508.643169:0:149302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 23 pid: 6526 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759508.643184:0:149302:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149302:1869355232925184:0@lo:104: 00000100:00100000:0.0:1782759508.643241:0:149302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759508.643294:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925184 00000100:00100000:2.0:1782759508.643303:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925184 00000100:00100000:0.0:1782759508.643308:0:149302:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759508.643357:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:2.0:1782759508.643369:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:149302:x1869355232925184:12345-0@lo:104: 00010000:00010000:2.0:1782759508.643381:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643433:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759508.643445:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:149302:x1869355232925184:12345-0@lo:104: Request processed in 80us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759508.643453:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759508.643454:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00010000:00010000:3.0:1782759508.643461:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759508.643469:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759508.643472:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759508.643481:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759508.643482:0:149302:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149302:1869355232925184:0@lo:104: 10000000:00010000:3.0:1782759508.643492:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759508.643496:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759508.643508:0:149302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759508.643521:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759508.643529:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759508.643565:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759508.643573:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60cc79 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cc80 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759508.643735:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232925312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759508.643767:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759508.643783:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759508.643792:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759508.643796:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759508.643807:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925312 00000100:00100000:2.0:1782759508.643812:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925312 00010000:00010000:2.0:1782759508.643830:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 24 pid: 6526 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759508.643854:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1782759508.643862:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5717450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232925312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759508.643872:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759508.643877:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 24 pid: 6526 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643887:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 24 pid: 6526 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643898:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60cc80 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc79 expref: 24 pid: 6526 timeout: 3698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643909:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643917:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643929:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643936:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643953:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643969:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643975:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759508.643979:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643987:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.643999:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759508.644010:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759508.644016:0:149302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759508.644023:0:149302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759508.644028:0:149302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc400/0xd5b45c7f5c60cc87 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759508.644040:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5717450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232925312:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759508.644047:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1782759508.644074:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232925312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759508.874712:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759508.874734:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232925440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759508.874808:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759508.874870:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925440 00000100:00100000:1.0:1782759508.874876:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925440 00000100:00100000:1.0:1782759508.874933:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:1.0:1782759508.874943:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232925440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759508.874987:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445879808 avail 1299640320 00000100:00100000:1.0:1782759508.875038:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232925440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759508.875047:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:3.0:1782759508.875145:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232925440:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1782759508.875837:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967410 is committed 00000001:00080000:3.0:1782759508.875856:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967409 is committed 00010000:00010000:2.0:1782759509.322704:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759509.900384:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759509.900418:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232925952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900444:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232925696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900483:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759509.900484:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759509.900493:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232926080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900528:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232926208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759509.900529:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232925568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759509.900540:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900570:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900628:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232926720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900646:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900656:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232927232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900666:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900690:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759509.900694:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232925824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900708:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900718:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232926336:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900730:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900738:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232926848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900748:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.900767:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925696 00000100:00100000:1.0:1782759509.900772:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925696 00000100:00100000:1.0:1782759509.900802:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00100000:1.0:1782759509.900807:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232925696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900840:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232925696:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.900845:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00100000:1.0:1782759509.900885:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926080 00000100:00100000:1.0:1782759509.900889:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926080 00000100:00100000:1.0:1782759509.900908:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925824 00000100:00100000:1.0:1782759509.900911:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925824 00000100:00100000:1.0:1782759509.900924:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926336 00000100:00100000:1.0:1782759509.900926:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926336 00000100:00100000:1.0:1782759509.900942:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926848 00000100:00100000:1.0:1782759509.900944:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926848 00000100:00100000:1.0:1782759509.900956:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042 00000100:00100000:1.0:1782759509.900960:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232926080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.900987:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232926080:12345-0@lo:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.900991:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042 00000100:00100000:1.0:1782759509.901012:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5043 00000100:00100000:1.0:1782759509.901023:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232925824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901047:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232925824:12345-0@lo:400:kworker.0 Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.901052:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5043 00000100:00100000:1.0:1782759509.901061:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5044 00000100:00100000:1.0:1782759509.901066:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232926336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901086:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232926336:12345-0@lo:400:kworker.0 Request processed in 20us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.901090:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5044 00000100:00100000:1.0:1782759509.901098:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5045 00000100:00100000:1.0:1782759509.901103:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232926848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901122:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232926848:12345-0@lo:400:kworker.0 Request processed in 19us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.901126:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5045 00000100:00100000:1.0:1782759509.901162:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232925824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901170:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232926336:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901177:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232926848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901184:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4faad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232925696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901224:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926720 00000100:00100000:1.0:1782759509.901226:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926720 00000100:00100000:1.0:1782759509.901247:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232927232 00000100:00100000:1.0:1782759509.901249:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232927232 00000100:00100000:1.0:1782759509.901263:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1782759509.901267:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901305:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232926720:12345-0@lo:400:kworker.0 Request processed in 37us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.901310:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1782759509.901319:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1782759509.901324:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232927232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901343:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232927232:12345-0@lo:400:kworker.0 Request processed in 20us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.901348:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1782759509.901369:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232926720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.901376:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967410 gen 2 00000004:00080000:1.0:1782759509.901381:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc44f9880, transno 4294967410 00000100:00100000:1.0:1782759509.901390:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232927232:0@lo:400:kworker.0 00000100:00080000:1.0:1782759509.901772:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759509.901776:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759509.901778:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759509.902397:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232926080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759509.902398:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759509.902409:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232926592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759509.902437:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759509.902463:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232927104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.902468:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926592 00000100:00100000:1.0:1782759509.902472:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926592 00000100:00100000:0.0:1782759509.902485:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232926464:0@lo:400:kworker.0 00000100:00100000:3.0:1782759509.902493:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759509.902520:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.902532:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232927104 00000100:00100000:1.0:1782759509.902535:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232927104 00000100:00100000:0.0:1782759509.902547:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232926976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759509.902553:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925952 00000100:00100000:3.0:1782759509.902558:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925952 00000100:00100000:1.0:1782759509.902573:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1782759509.902602:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759509.902627:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232926592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759509.902641:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926208 00000100:00100000:0.0:1782759509.902645:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232925568 00000100:00100000:3.0:1782759509.902646:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926208 00000100:00100000:0.0:1782759509.902652:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232925568 00000100:00100000:1.0:1782759509.902671:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232926592:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759509.902672:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250 00000100:00100000:1.0:1782759509.902680:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:3.0:1782759509.902686:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232925952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759509.902694:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1782759509.902697:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1782759509.902708:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232927104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759509.902709:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232925568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759509.902734:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759509.902739:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232925952:12345-0@lo:400:kworker.0 Request processed in 54us (2255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.902747:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232927104:12345-0@lo:400:kworker.0 Request processed in 43us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759509.902751:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250 00000100:00100000:1.0:1782759509.902757:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00100000:3.0:1782759509.902775:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00080000:1.0:1782759509.902777:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759509.902780:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759509.902787:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232926208:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1782759509.902825:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000100:00100000:3.0:1782759509.902833:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232926208:12345-0@lo:400:kworker.0 Request processed in 48us (2260us total) trans 0 rc 0/0 00000001:00080000:1.0:1782759509.902845:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968011 is committed 00000100:00100000:3.0:1782759509.902849:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000004:00080000:1.0:1782759509.902851:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000100:00100000:3.0:1782759509.902875:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926464 00000100:00100000:3.0:1782759509.902880:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926464 00000100:00100000:3.0:1782759509.902909:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232926976 00000100:00100000:3.0:1782759509.902913:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232926976 00000100:00100000:3.0:1782759509.902938:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5046 00000100:00100000:3.0:1782759509.902948:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232926464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.902951:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047 00000100:00100000:0.0:1782759509.902959:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232925568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.902963:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232926976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759509.902974:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1782759509.903002:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232926464:12345-0@lo:400:kworker.0 Request processed in 54us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759509.903007:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232926976:12345-0@lo:400:kworker.0 Request processed in 47us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759509.903016:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5046 00000100:00100000:1.0:1782759509.903026:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047 00000100:00100000:0.0:1782759509.903056:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232927360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782759509.903084:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759509.903213:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232926464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.903258:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232927360 00000100:00100000:1.0:1782759509.903263:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232927360 00000100:00100000:0.0:1782759509.903272:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232926976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759509.903288:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1782759509.903294:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232927360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1782759509.903309:0:82628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:34 count 1 00000100:00100000:0.0:1782759509.903324:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232925952:0@lo:400:kworker.0 00010000:00010000:1.0:1782759509.903330:0:82628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.903336:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232925568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759509.903351:0:82628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 6 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.903361:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1782759509.903365:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759509.903369:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.903414:0:82628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 6 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.903427:0:82628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 6 pid: 82628 timeout: 3650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759509.903436:0:82628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:82628:1869355232927488:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759509.903492:0:82628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c600 going to sleep for 11 seconds 00010000:00010000:3.0:1782759509.904969:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.904982:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.904990:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.904996:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759509.905001:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905009:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905026:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:3.0:1782759509.905029:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759509.905034:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905051:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cbae lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905066:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905072:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905078:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905083:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759509.905087:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905093:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905101:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1c:0x0].0x0 (ffff8cddc34fef00) 00010000:00010000:3.0:1782759509.905104:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759509.905108:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905114:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cbbc lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905132:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905139:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.905152:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912818:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759509.912828:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912840:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912859:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe300) 00010000:00010000:3.0:1782759509.912863:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759509.912867:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912874:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60cbd1 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912898:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912906:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912913:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912918:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759509.912921:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912943:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.912954:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00010000:00010000:3.0:1782759509.912956:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1d:0x0].0x0 (ffff8cddc34f4900) 00010000:00010000:3.0:1782759509.912961:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759509.912964:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.912971:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cbe6 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.912991:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530816 00010000:00010000:3.0:1782759509.912995:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.913001:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530816 00010000:00010000:0.0:1782759509.913041:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 7 pid: 82628 timeout: 3650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913042:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913057:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913065:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759509.913069:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913076:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.913085:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 803 00010000:00010000:3.0:1782759509.913086:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x8d0dad41 (ffff8cddc34f4500) 00010000:00010000:3.0:1782759509.913090:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759509.913094:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759509.913097:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218530816:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759509.913110:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cc25 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0x8d0dad41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.913114:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759509.913122:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 7 pid: 82628 timeout: 3650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913127:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913136:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.913139:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 7 pid: 82628 timeout: 3650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913149:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913166:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759509.913170:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.913170:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759509.913178:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759509.913182:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.913185:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913192:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0xc678657f (ffff8cddc34fe300) 00010000:00010000:3.0:1782759509.913195:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759509.913196:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913199:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759509.913214:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cc5d lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x17:0x0].0xc678657f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759509.913241:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1782759509.913256:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759509.913262:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759509.913303:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232926592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759509.913327:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232927104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759509.913366:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232926208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759509.913387:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218530816:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 291us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759509.913414:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 803 00010000:00010000:1.0:1782759509.913688:0:82628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fcd477/0xd5b45c7f5c60cc4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27410 expref: 6 pid: 82628 timeout: 3650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759509.913703:0:82628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:82628:1869355232927488:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759509.913724:0:82628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.913735:0:82628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.913742:0:82628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.913763:0:82628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.913781:0:82628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.913799:0:82628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782759509.913985:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355232927360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10690us (10900us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1782759509.913992:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00010000:00010000:1.0:1782759509.914012:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759509.914017:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.914025:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759509.914029:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.914037:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759509.914048:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4bcf800/2, rc 0, transno 4294967417 00010000:00010000:1.0:1782759509.914050:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759509.914058:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232927360:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1782759509.914061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000592e28fe/0xd5b45c7f5c60cc8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759509.914078:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759509.914086:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759509.914088:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759510.154908:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759510.154915:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759510.154920:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759510.154964:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.154977:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.154987:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759510.155015:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232927616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759510.155076:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759510.155133:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759510.155792:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232927616 00000100:00100000:2.0:1782759510.155801:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232927616 00000100:00100000:2.0:1782759510.155858:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222 00000100:00100000:2.0:1782759510.155868:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232927616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759510.155882:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759510.155897:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cc95 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.155937:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.155947:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759510.155956:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759510.155992:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232927616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759510.155999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222 00000100:00100000:0.0:1782759510.156737:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232927616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759510.156755:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.156766:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759510.156784:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759510.156789:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759510.156797:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759510.347772:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759510.411282:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232927744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759510.411351:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759510.411387:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232927744 00000100:00100000:3.0:1782759510.411396:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232927744 00000100:00100000:3.0:1782759510.411496:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1782759510.411506:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232927744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759510.411527:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759510.411676:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232927744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759510.411683:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:2.0:1782759510.411781:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232927744:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1782759510.416486:0:149497:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759510.416491:0:149497:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1782759510.416505:0:149497:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:1.0:1782759510.416510:0:149497:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1782759510.467790:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759510.467896:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218530944 00000100:00100000:1.0:1782759510.467905:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218530944 00000100:00100000:1.0:1782759510.468010:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2926 00000100:00100000:1.0:1782759510.468020:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:108746:x1869355218530944:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:1.0:1782759510.468078:0:6532:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=424066b3 len=12 karg=ffff8cdefaba0710 uarg=0000000000000000 00000004:00000080:1.0:1782759510.468123:0:6532:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b3 len=12 karg=ffff8cdefaba0710 00000004:00000080:1.0:1782759510.468130:0:6532:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=2, endrec=0 00000040:00080000:1.0:1782759510.468162:0:6532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759510.468166:0:6532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1782759510.468184:0:6532:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl2 endrec = 8 00000040:00080000:1.0:1782759510.468251:0:6532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:1.0:1782759510.468259:0:6532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1782759510.468263:0:6532:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:1.0:1782759510.468281:0:6532:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759510.468283:0:6532:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1782759510.468346:0:6532:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 8 count 1 00000040:00080000:1.0:1782759510.468351:0:6532:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1782759510.468648:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:108746:x1869355218530944:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 629us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759510.468657:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2926 00000100:00080000:3.0:1782759510.468724:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759510.922969:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232927872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759510.923041:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759510.923106:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232927872 00000100:00100000:0.0:1782759510.923113:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232927872 00000100:00100000:0.0:1782759510.923169:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252 00000100:00100000:0.0:1782759510.923177:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232927872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759510.923210:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446133760 avail 1299894272 00000100:00100000:0.0:1782759510.923253:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232927872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759510.923261:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252 00000100:00100000:0.0:1782759510.923304:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232927872:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1782759510.955752:0:149545:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffd96efedf0 00000004:00000080:2.0:1782759510.955768:0:149545:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0001: cmd=424066b2 len=576 karg=ffff8cdecdb12c00 uarg=0000000000000000 00000004:00000080:2.0:1782759510.955816:0:149545:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=424066b2 len=576 karg=ffff8cdecdb12c00 00000004:00000080:2.0:1782759510.955823:0:149545:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0001: Purge request: id=2, endrec=0 00000040:00080000:2.0:1782759510.955889:0:149545:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759510.955893:0:149545:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:2.0:1782759510.955912:0:149545:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0001: update changelog user cl2 endrec = 8 00000040:00080000:2.0:1782759510.955963:0:149545:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:2.0:1782759510.955972:0:149545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1782759510.956007:0:149545:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0001: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:2.0:1782759510.956036:0:149545:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759510.956039:0:149545:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1782759510.956680:0:149545:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1782759510.956688:0:149545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:2.0:1782759510.956713:0:149545:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0001: Purge request: id=2 00000040:00080000:2.0:1782759510.956739:0:149545:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759510.956748:0:149545:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1782759510.956794:0:149545:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 1 00000040:00080000:2.0:1782759510.956799:0:149545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:2.0:1782759510.956819:0:149545:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:2.0:1782759510.956821:0:149545:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0001: changelog off 00000004:00000080:2.0:1782759510.959038:0:149545:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0001: Purge changelog entries for user cl2 record=18446744073709551615 00000040:00080000:2.0:1782759510.959103:0:149545:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759510.959107:0:149545:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:2.0:1782759510.959947:0:149545:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:2.0:1782759510.959960:0:149545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:2.0:1782759510.960034:0:149545:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759510.960037:0:149545:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1782759510.960689:0:149545:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1782759510.960696:0:149545:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:3.0:1782759511.265433:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759511.265463:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759511.265479:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759511.265496:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759511.265515:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759511.266456:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531072 00000100:00100000:3.0:1782759511.266466:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531072 00000100:00100000:3.0:1782759511.266517:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3223 00000100:00100000:3.0:1782759511.266526:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218531072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759511.266618:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218531072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759511.266678:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531200 00000100:00100000:0.0:1782759511.266682:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531200 00000100:00100000:0.0:1782759511.266722:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531328 00000100:00100000:0.0:1782759511.266725:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531328 00000100:00100000:0.0:1782759511.266741:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5048 00000100:00100000:0.0:1782759511.266758:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218531200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759511.266791:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218531200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759511.266798:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5048 00000100:00100000:0.0:1782759511.266813:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5049 00000100:00100000:0.0:1782759511.266819:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218531328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759511.266841:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218531328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759511.266853:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5049 00000100:00080000:0.0:1782759511.266938:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759511.267670:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531456 00000100:00100000:0.0:1782759511.267675:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531456 00000100:00100000:0.0:1782759511.267776:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531584 00000100:00100000:0.0:1782759511.267779:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531584 00000100:00100000:0.0:1782759511.267800:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2908 00000100:00100000:0.0:1782759511.267806:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218531456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759511.267851:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218531456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759511.267858:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2908 00000100:00100000:0.0:1782759511.267868:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2909 00000100:00100000:0.0:1782759511.267873:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218531584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759511.267892:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218531584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 19us (2377us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759511.267897:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2909 00000100:00080000:0.0:1782759511.267945:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759511.267948:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759511.268283:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3223 00010000:00010000:2.0:1782759511.372876:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759511.434991:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232928000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759511.435063:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759511.435114:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759511.435119:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232928128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759511.435136:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759511.435167:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232928000 00000100:00100000:3.0:1782759511.435174:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232928000 00000100:00100000:0.0:1782759511.435191:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232928128 00000100:00100000:0.0:1782759511.435197:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232928128 00000100:00100000:3.0:1782759511.435319:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1782759511.435329:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232928000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759511.435361:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759511.435417:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232928000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759511.435423:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00080000:3.0:1782759511.437707:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759511.437850:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1782759511.437868:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232928128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759511.437896:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759511.437956:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232928128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (2817us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759511.437963:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1782759511.438032:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232928128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759511.438052:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232928000:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1782759511.506125:0:149593:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759511.506132:0:149593:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:1.0:1782759511.506876:0:149593:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1782759511.506884:0:149593:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:3.0:1782759512.064062:0:149641:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759512.064074:0:149641:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759512.064098:0:149641:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:3.0:1782759512.064105:0:149641:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000100:00100000:0.0:1782759512.108068:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759512.108484:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531712 00000100:00100000:1.0:1782759512.108494:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531712 00000100:00100000:1.0:1782759512.108574:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2927 00000100:00100000:1.0:1782759512.108616:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:108779:x1869355218531712:12345-192.168.202.31@tcp:46:lfs.0 00000004:00000080:1.0:1782759512.108654:0:12673:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b3 len=12 karg=ffff8cdefaba0ab0 uarg=0000000000000000 00000004:00000080:1.0:1782759512.108696:0:12673:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b3 len=12 karg=ffff8cdefaba0ab0 00000004:00000080:1.0:1782759512.108703:0:12673:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:1.0:1782759512.108741:0:12673:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759512.108746:0:12673:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:1.0:1782759512.108767:0:12673:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 28 00000040:00080000:1.0:1782759512.108833:0:12673:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:1.0:1782759512.108840:0:12673:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:1.0:1782759512.108845:0:12673:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:1.0:1782759512.108861:0:12673:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782759512.108864:0:12673:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:1.0:1782759512.109033:0:12673:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 28 count 1 00000040:00080000:1.0:1782759512.109038:0:12673:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000100:00100000:1.0:1782759512.109129:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:108779:x1869355218531712:12345-192.168.202.31@tcp:46:lfs.0 Request processed in 516us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759512.109138:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2927 00010000:00010000:1.0:1782759512.394691:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759512.618710:0:149690:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=424066b2 len=0 uarg=00007ffc958ff980 00000004:00000080:3.0:1782759512.618727:0:149690:0:(mdt_handler.c:8167:mdt_iocontrol()) lustre-MDT0000: cmd=424066b2 len=576 karg=ffff8cddc3ecfc00 uarg=0000000000000000 00000004:00000080:3.0:1782759512.618798:0:149690:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=424066b2 len=576 karg=ffff8cddc3ecfc00 00000004:00000080:3.0:1782759512.618805:0:149690:0:(mdd_device.c:2172:mdd_changelog_clear()) lustre-MDD0000: Purge request: id=2, endrec=0 00000040:00080000:3.0:1782759512.618858:0:149690:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759512.618862:0:149690:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000004:00000080:3.0:1782759512.618878:0:149690:0:(mdd_device.c:2144:mdd_changelog_clear_cb()) lustre-MDD0000: update changelog user cl2 endrec = 28 00000040:00080000:3.0:1782759512.618931:0:149690:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 2 00000040:00080000:3.0:1782759512.618938:0:149690:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759512.618968:0:149690:0:(mdd_device.c:2221:mdd_changelog_clear()) lustre-MDD0000: purge changelog user cl2 entries up to 18446744073709551615 00000040:00080000:3.0:1782759512.619011:0:149690:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759512.619014:0:149690:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759512.619870:0:149690:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759512.619877:0:149690:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000004:00000080:3.0:1782759512.619901:0:149690:0:(mdd_device.c:2025:mdd_changelog_user_purge()) lustre-MDD0000: Purge request: id=2 00000040:00080000:3.0:1782759512.619928:0:149690:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759512.619931:0:149690:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759512.619975:0:149690:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 1 00000040:00080000:3.0:1782759512.619979:0:149690:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000004:00000080:3.0:1782759512.619994:0:149690:0:(mdd_device.c:2047:mdd_changelog_user_purge()) turning off changelogs 00000004:02000000:3.0:1782759512.619995:0:149690:0:(mdd_device.c:491:mdd_changelog_off()) lustre-MDD0000: changelog off 00000004:00000080:3.0:1782759512.619998:0:149690:0:(mdd_device.c:2057:mdd_changelog_user_purge()) lustre-MDD0000: Purge changelog entries for user cl2 record=18446744073709551615 00000040:00080000:3.0:1782759512.620018:0:149690:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759512.620020:0:149690:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 1 of catalog [0xa:0x5:0x0] 00000040:00080000:3.0:1782759512.620776:0:149690:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 64768 count 1 00000040:00080000:3.0:1782759512.620783:0:149690:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 2 count 2 00000040:00080000:3.0:1782759512.620825:0:149690:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782759512.620834:0:149690:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:3.0:1782759512.621658:0:149690:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1782759512.621666:0:149690:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00000040:00080000:2.0:1782759513.113535:0:149738:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782759513.113542:0:149738:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x6:0x0] 00000040:00080000:2.0:1782759513.114086:0:149738:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1782759513.114096:0:149738:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 2 count 2 00010000:00010000:3.0:1782759513.421659:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1782759513.488851:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 33 batchid updated 00000020:00080000:1.0:1782759513.488933:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 33 00000004:00080000:1.0:1782759513.489000:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4e90300 with version 68 00000020:00080000:1.0:1782759513.489018:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 32 cancel update log [0x200000401:0x2:0x0].33: rc = 0 00000020:00080000:1.0:1782759513.489111:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 32 cancel update log [0x240000400:0x2:0x0].32: rc = 0 00000004:00080000:1.0:1782759513.489133:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4e909c0 with version 69 00000020:00080000:1.0:1782759513.489136:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 33 cancel update log [0x200000401:0x2:0x0].34: rc = 0 00000020:00080000:1.0:1782759513.489151:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 33 cancel update log [0x240000400:0x2:0x0].34: rc = 0 00000020:00080000:1.0:1782759513.489158:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 33 00000004:00080000:0.0:1782759513.489529:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 68 rpc_version 68 00000020:00100000:0.0:1782759513.489572:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759513.489616:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf875c00 x1869355232928384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759513.489641:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232928384:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759513.489714:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759513.489788:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759513.489859:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232928384 00000100:00100000:3.0:1782759513.489868:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232928384 00000100:00100000:3.0:1782759513.489930:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3253 00000100:00100000:3.0:1782759513.489940:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355232928384:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759513.490082:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232928384:12345-0@lo:1000:osp_up0-1.0 Request processed in 143us (368us total) trans 4294968012 rc 0/0 00000100:00100000:3.0:1782759513.490090:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3253 00000100:00100000:1.0:1782759513.490292:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875c00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232928384:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1782759513.490303:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 69 rpc_version 69 00000020:00100000:1.0:1782759513.490315:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759513.490321:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4f6f100 x1869355232928640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759513.490334:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232928640:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759513.490360:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759513.490383:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759513.490605:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232928640 00000100:00100000:0.0:1782759513.490610:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232928640 00000100:00100000:0.0:1782759513.490649:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254 00000100:00100000:0.0:1782759513.490656:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232928640:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759513.490747:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232928640:12345-0@lo:1000:osp_up0-1.0 Request processed in 91us (385us total) trans 4294968013 rc 0/0 00000100:00100000:0.0:1782759513.490754:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254 00000100:00100000:1.0:1782759513.490787:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232928640:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759513.998016:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759513.998068:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232928768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759513.998152:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759513.998215:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232928768 00000100:00100000:1.0:1782759513.998222:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232928768 00000100:00100000:1.0:1782759513.998285:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:1.0:1782759513.998295:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232928768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759513.998332:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445879808 avail 1299640320 00000100:00100000:1.0:1782759513.998379:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:3663:x1869355232928768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759513.998388:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00000100:00100000:1.0:1782759513.998442:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232928768:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759514.128708:0:149834:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5db99b20 20000000:00000080:1.0:1782759514.128728:0:149834:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc49dcc00 uarg=0000000000000000 00010000:00010000:1.0:1782759514.129245:0:149834:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759514.129261:0:149834:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759514.129279:0:149834:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759514.129288:0:149834:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759514.129307:0:149834:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759514.129327:0:149834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.129345:0:149834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.129353:0:149834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.129395:0:149834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.129408:0:149834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 23 pid: 6524 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759514.129423:0:149834:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149834:1869355232928896:0@lo:104: 00000100:00100000:1.0:1782759514.129486:0:149834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759514.129541:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232928896 00000100:00100000:1.0:1782759514.129553:0:149834:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759514.129558:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232928896 00000100:00100000:2.0:1782759514.129671:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1782759514.129683:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:149834:x1869355232928896:12345-0@lo:104: 00010000:00010000:2.0:1782759514.129696:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759514.129764:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759514.129771:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:149834:x1869355232928896:12345-0@lo:104: Request processed in 92us (285us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759514.129785:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1782759514.129791:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00010000:00010000:0.0:1782759514.129792:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759514.129800:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759514.129803:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759514.129813:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759514.129821:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759514.129827:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:1.0:1782759514.129842:0:149834:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:149834:1869355232928896:0@lo:104: 00010000:00010000:0.0:1782759514.129858:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759514.129866:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759514.129893:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759514.129911:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dd000/0xd5b45c7f5c60cc95 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cc9c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.129921:0:149834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759514.129930:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759514.129932:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759514.129934:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759514.129942:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759514.129956:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232929024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759514.129979:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759514.130116:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929024 00000100:00100000:1.0:1782759514.130119:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929024 00010000:00010000:1.0:1782759514.130134:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 24 pid: 6524 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759514.130175:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:1.0:1782759514.130180:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232929024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759514.130188:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759514.130192:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 24 pid: 6524 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130198:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 24 pid: 6524 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130206:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60cc9c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cc95 expref: 24 pid: 6524 timeout: 3704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130215:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130220:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130228:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130232:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130237:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130245:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130249:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759514.130251:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130255:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130268:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759514.130277:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759514.130304:0:149834:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759514.130309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232929024:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (329us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759514.130313:0:149834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759514.130316:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00010000:00010000:2.0:1782759514.130319:0:149834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60cca3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759514.130362:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232929024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759514.445092:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759514.666900:0:149882:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcdc95b540 20000000:00000080:3.0:1782759514.666919:0:149882:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4543800 uarg=0000000000000000 00010000:00010000:3.0:1782759514.667143:0:149882:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759514.667160:0:149882:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759514.667183:0:149882:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759514.667194:0:149882:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759514.667214:0:149882:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759514.667232:0:149882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667247:0:149882:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667257:0:149882:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667265:0:149882:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667282:0:149882:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667289:0:149882:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667294:0:149882:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759514.667298:0:149882:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667306:0:149882:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667317:0:149882:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667326:0:149882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759514.667332:0:149882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccaa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759515.018895:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232929152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.018962:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759515.019008:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232929664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019010:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232929280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019035:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019050:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019067:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232929792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019067:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232930176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019088:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019104:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232930304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019104:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759515.019119:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232930688:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019122:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759515.019137:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019153:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929152 00000100:00100000:0.0:1782759515.019158:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232929408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019159:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929152 00000100:00100000:0.0:1782759515.019177:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759515.019193:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232929920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019212:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019213:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3224 00000100:00100000:1.0:1782759515.019221:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232929152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019225:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232930432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019253:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019270:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232929152:12345-0@lo:400:kworker.0 Request processed in 50us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759515.019270:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759515.019274:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232929536:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019277:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3224 00000100:00100000:0.0:1782759515.019293:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019306:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929280 00000100:00100000:0.0:1782759515.019307:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232930048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019310:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929280 00000100:00100000:0.0:1782759515.019325:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019327:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929792 00000100:00100000:1.0:1782759515.019329:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929792 00000100:00100000:0.0:1782759515.019339:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232930560:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019349:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930304 00000100:00100000:1.0:1782759515.019352:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930304 00000100:00100000:0.0:1782759515.019357:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759515.019364:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929920 00000100:00100000:1.0:1782759515.019366:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929920 00000100:00100000:1.0:1782759515.019378:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930432 00000100:00100000:1.0:1782759515.019380:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930432 00000100:00100000:1.0:1782759515.019392:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929536 00000100:00100000:0.0:1782759515.019393:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929664 00000100:00100000:1.0:1782759515.019394:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929536 00000100:00100000:0.0:1782759515.019395:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929664 00000100:00100000:1.0:1782759515.019405:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5050 00000100:00100000:1.0:1782759515.019410:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232929280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019429:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232929408 00000100:00100000:0.0:1782759515.019432:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232929408 00000100:00100000:1.0:1782759515.019443:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232929280:12345-0@lo:400:kworker.0 Request processed in 33us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759515.019446:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:1.0:1782759515.019449:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5050 00000100:00100000:0.0:1782759515.019450:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019479:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5051 00000100:00100000:0.0:1782759515.019480:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232929664:12345-0@lo:400:kworker.0 Request processed in 30us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.019485:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232929792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019486:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:0.0:1782759515.019498:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:0.0:1782759515.019503:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355232929408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019510:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232929792:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.019515:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5051 00000100:00100000:1.0:1782759515.019527:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5052 00000100:00100000:0.0:1782759515.019528:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355232929408:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.019532:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232930304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.019534:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:0.0:1782759515.019562:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930176 00000100:00100000:1.0:1782759515.019569:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232930304:12345-0@lo:400:kworker.0 Request processed in 37us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.019608:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5052 00000100:00100000:1.0:1782759515.019621:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5053 00000100:00100000:1.0:1782759515.019627:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232929920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019665:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232929920:12345-0@lo:400:kworker.0 Request processed in 39us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.019670:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5053 00000100:00100000:1.0:1782759515.019681:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5054 00000100:00100000:1.0:1782759515.019687:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019711:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232930432:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.019716:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5054 00000100:00100000:1.0:1782759515.019928:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5055 00000100:00100000:1.0:1782759515.019935:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232929536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.019966:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232929536:12345-0@lo:400:kworker.0 Request processed in 32us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759515.019966:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930176 00000100:00100000:1.0:1782759515.019972:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5055 00000100:00100000:1.0:1782759515.019994:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930688 00000100:00100000:0.0:1782759515.019994:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930048 00000100:00100000:1.0:1782759515.019997:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930688 00000100:00100000:0.0:1782759515.019997:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930048 00000100:00100000:0.0:1782759515.020007:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930560 00000100:00100000:1.0:1782759515.020011:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:0.0:1782759515.020015:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930560 00000100:00100000:1.0:1782759515.020016:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232930176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020031:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:1.0:1782759515.020062:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355232930176:12345-0@lo:400:kworker.0 Request processed in 46us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.020068:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:1.0:1782759515.020079:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:1.0:1782759515.020085:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232930688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020097:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232930048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020120:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232930688:12345-0@lo:400:kworker.0 Request processed in 34us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759515.020120:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232930048:12345-0@lo:400:kworker.0 Request processed in 83us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.020126:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:0.0:1782759515.020132:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:1.0:1782759515.020136:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:1.0:1782759515.020141:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020165:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232930560:12345-0@lo:400:kworker.0 Request processed in 24us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759515.020170:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00080000:1.0:1782759515.020195:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759515.020198:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232929536:0@lo:400:kworker.0 00000100:00080000:1.0:1782759515.020199:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759515.020201:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759515.020203:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759515.020208:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232930048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020214:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232930816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759515.020216:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232930560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020225:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232929408:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020234:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232929920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020238:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759515.020242:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232930432:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020261:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232929280:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020270:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232929792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759515.020277:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232930304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020296:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232929664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020306:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232930176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020315:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232930688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759515.020322:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232929152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759515.020722:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930816 00000100:00100000:3.0:1782759515.020726:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930816 00000100:00100000:3.0:1782759515.020757:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:3.0:1782759515.020764:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232930816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759515.020783:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759515.020821:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232930816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759515.020836:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1782759515.020955:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232930816:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759515.301123:0:149930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6a6f46f0 20000000:00000080:2.0:1782759515.301140:0:149930:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecdb12c00 uarg=0000000000000000 00010000:00010000:2.0:1782759515.301293:0:149930:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759515.301303:0:149930:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759515.301318:0:149930:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759515.301329:0:149930:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759515.301348:0:149930:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759515.301367:0:149930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301381:0:149930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301390:0:149930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301397:0:149930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301425:0:149930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301432:0:149930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301438:0:149930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759515.301442:0:149930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301449:0:149930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301461:0:149930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301468:0:149930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759515.301475:0:149930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ccb1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 149930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759515.466722:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759515.531931:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232930944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759515.531994:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759515.532186:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232930944 00000100:00100000:3.0:1782759515.532194:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232930944 00000100:00100000:3.0:1782759515.532243:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:3.0:1782759515.532252:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232930944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759515.532274:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759515.532323:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232930944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759515.532330:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00100000:2.0:1782759515.532410:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232930944:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1782759515.533072:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967417 is committed 10000000:01000000:2.0:1782759516.042858:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759516.042865:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759516.042870:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759516.042917:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759516.042929:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759516.042953:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759516.042979:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232931072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759516.043050:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759516.043104:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d08600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759516.043175:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931072 00000100:00100000:0.0:1782759516.043182:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931072 00000100:00100000:0.0:1782759516.043236:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:0.0:1782759516.043245:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232931072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759516.043263:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759516.043276:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ccb8 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759516.043297:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759516.043305:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759516.043314:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc000, rc 0) 00000100:00100000:0.0:1782759516.043355:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232931072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759516.043361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00000100:00100000:3.0:1782759516.043477:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759516.043488:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232931200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759516.043518:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759516.043642:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931200 00000100:00100000:0.0:1782759516.043646:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931200 00000100:00100000:2.0:1782759516.043744:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232931072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759516.043758:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759516.043767:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759516.043785:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759516.043789:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759516.043796:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759516.043841:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:0.0:1782759516.043849:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232931200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759516.043872:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446133760 avail 1299894272 00000100:00100000:0.0:1782759516.043915:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232931200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759516.043921:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00100000:3.0:1782759516.043973:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232931200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759516.385309:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759516.385350:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759516.385394:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759516.385419:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759516.385444:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759516.385471:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532352 00000100:00100000:0.0:1782759516.385494:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532352 00000100:00100000:0.0:1782759516.385559:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532224 00000100:00100000:0.0:1782759516.385562:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532224 00000100:00100000:0.0:1782759516.385611:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2914 00000100:00100000:0.0:1782759516.385622:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218532352:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759516.385691:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218532352:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759516.385699:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2914 00000100:00100000:0.0:1782759516.385715:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2915 00000100:00100000:0.0:1782759516.385722:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218532224:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759516.385747:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218532224:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759516.385753:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2915 00000100:00100000:1.0:1782759516.386002:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531840 00000100:00100000:1.0:1782759516.386006:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531840 00000100:00100000:1.0:1782759516.386044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3226 00000100:00100000:1.0:1782759516.386051:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218531840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759516.386086:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218531840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759516.386101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3226 00000100:00100000:1.0:1782759516.386129:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532096 00000100:00100000:1.0:1782759516.386132:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532096 00000100:00100000:1.0:1782759516.386169:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218531968 00000100:00100000:1.0:1782759516.386172:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218531968 00000100:00100000:1.0:1782759516.386191:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5056 00000100:00100000:1.0:1782759516.386196:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218532096:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759516.386222:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218532096:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759516.386228:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5056 00000100:00100000:1.0:1782759516.386237:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5057 00000100:00100000:1.0:1782759516.386242:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218531968:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759516.386259:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218531968:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 17us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759516.386264:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5057 00000100:00080000:1.0:1782759516.386277:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759516.386280:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759516.386282:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759516.386284:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759516.490699:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759516.555714:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759516.555736:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232931328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759516.555803:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759516.555868:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931328 00000100:00100000:3.0:1782759516.555874:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931328 00000100:00100000:3.0:1782759516.555921:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:3.0:1782759516.555930:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232931328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759516.555959:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759516.556001:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232931328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759516.556009:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00100000:3.0:1782759516.556101:0:3665:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967417 gen 2 00000004:00080000:3.0:1782759516.556113:0:3665:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4bcf800, transno 4294967417 00000100:00100000:3.0:1782759516.556133:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232931328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759516.556400:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232931456:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759516.556427:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759516.556607:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931456 00000100:00100000:0.0:1782759516.556612:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931456 00000100:00100000:0.0:1782759516.556642:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1782759516.556649:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232931456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759516.556661:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1782759516.556753:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232931456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759516.556758:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:3.0:1782759516.556872:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232931456:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782759517.516431:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759517.581922:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968013 is committed 00010000:00010000:0.0:1782759518.540873:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759519.115758:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759519.115779:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232931584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759519.115841:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759519.115898:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931584 00000100:00100000:1.0:1782759519.115905:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931584 00000100:00100000:1.0:1782759519.115984:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259 00000100:00100000:1.0:1782759519.115992:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232931584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759519.116030:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445879808 avail 1299640320 00000100:00100000:1.0:1782759519.116069:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232931584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759519.116076:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259 00000100:00100000:1.0:1782759519.116110:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968013 gen 2 00000004:00080000:1.0:1782759519.116115:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968012 committed transno 4294968013 00000004:00080000:1.0:1782759519.116131:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968013 committed transno 4294968013 00000100:00100000:1.0:1782759519.116145:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232931584:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1782759519.254466:0:150125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64f: Nodemap enforces fscrypt_admin RBAC roles ========================================================== 14:58:38 (1782759518) 00010000:00010000:1.0:1782759519.562841:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759520.138986:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232931712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759520.139031:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232931840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759520.139057:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759520.139123:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931712 00000100:00100000:3.0:1782759520.139134:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931712 00000100:00080000:2.0:1782759520.139197:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759520.140153:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:3.0:1782759520.140252:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232931712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759520.140285:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759520.140294:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232932096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.147641:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.147737:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759520.147749:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232931968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.147802:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.147850:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931840 00000100:00100000:0.0:1782759520.147858:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931840 00000100:00100000:0.0:1782759520.147897:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1782759520.147904:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232931840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.147947:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232931840:12345-0@lo:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.147954:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1782759520.147994:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232931840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148021:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232931968 00000100:00100000:0.0:1782759520.148024:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232931968 00000100:00100000:0.0:1782759520.148045:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058 00000100:00100000:0.0:1782759520.148050:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232931968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148080:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232931968:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.148086:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058 00000100:00100000:0.0:1782759520.148107:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232931968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148207:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232932352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148231:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.148251:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932352 00000100:00100000:0.0:1782759520.148253:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932352 00000100:00100000:0.0:1782759520.148288:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3260 00000100:00100000:0.0:1782759520.148292:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232932352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148316:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232932352:12345-0@lo:400:kworker.0 Request processed in 23us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.148325:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3260 00000100:00100000:0.0:1782759520.148343:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232932352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148349:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232932864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148369:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.148386:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759520.148390:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232932480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148403:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.148412:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232932992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148426:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.148454:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932864 00000100:00100000:0.0:1782759520.148458:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932864 00000100:00100000:0.0:1782759520.148509:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:0.0:1782759520.148516:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232932864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148546:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232932864:12345-0@lo:400:kworker.0 Request processed in 31us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.148552:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:0.0:1782759520.148597:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232932864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148617:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932480 00000100:00100000:0.0:1782759520.148620:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932480 00000100:00100000:0.0:1782759520.148638:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932992 00000100:00100000:0.0:1782759520.148640:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932992 00000100:00100000:0.0:1782759520.148661:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5059 00000100:00100000:0.0:1782759520.148666:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232932480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148701:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232932480:12345-0@lo:400:kworker.0 Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.148715:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5059 00000100:00100000:0.0:1782759520.148726:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5060 00000100:00100000:0.0:1782759520.148731:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232932992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148755:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232932992:12345-0@lo:400:kworker.0 Request processed in 24us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.148760:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5060 00000100:00100000:0.0:1782759520.148781:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232932480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.148788:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232932992:0@lo:400:kworker.0 00000100:00080000:0.0:1782759520.148834:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759520.148837:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759520.151053:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759520.151059:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232931712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10809us (11999us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759520.151071:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:2.0:1782759520.151090:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232932608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.151106:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932096 00000100:00100000:0.0:1782759520.151111:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932096 00000100:00100000:2.0:1782759520.151128:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.151147:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:0.0:1782759520.151155:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232932096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.151193:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232932096:12345-0@lo:400:kworker.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.151199:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00100000:2.0:1782759520.151204:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232933120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151235:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759520.151316:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232932096:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151330:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759520.151343:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232932224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151362:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759520.151379:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932608 00000100:00100000:3.0:1782759520.151383:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932608 00000100:00100000:0.0:1782759520.151385:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933120 00000100:00100000:0.0:1782759520.151387:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933120 00000100:00100000:3.0:1782759520.151414:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061 00000100:00100000:0.0:1782759520.151608:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5062 00000100:00100000:3.0:1782759520.151612:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232932608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759520.151614:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232933120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151671:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932224 00000100:00100000:0.0:1782759520.151676:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232933120:12345-0@lo:400:kworker.0 Request processed in 63us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.151682:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5062 00000100:00100000:2.0:1782759520.151685:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932224 00000100:00080000:0.0:1782759520.151709:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759520.151726:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5063 00000100:00100000:2.0:1782759520.151743:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232932224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151781:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232932224:12345-0@lo:400:kworker.0 Request processed in 50us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759520.151788:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5063 00000100:00100000:2.0:1782759520.151813:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232932224:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151820:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232932736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151844:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759520.151871:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232933248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.151891:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759520.151911:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232932736 00000100:00100000:2.0:1782759520.151923:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232932736 00000100:00100000:2.0:1782759520.151965:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933248 00000100:00100000:2.0:1782759520.151968:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933248 00000100:00100000:2.0:1782759520.151999:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:2.0:1782759520.152007:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232932736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.152049:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232932736:12345-0@lo:400:kworker.0 Request processed in 43us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759520.152056:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:2.0:1782759520.152077:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:2.0:1782759520.152085:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232933248:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759520.152124:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759520.152127:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759520.152130:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232933248:12345-0@lo:400:kworker.0 Request processed in 39us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759520.152136:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:2.0:1782759520.152166:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232933248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.152173:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232933120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759520.152195:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232932736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759520.152261:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232932608:12345-0@lo:400:kworker.0 Request processed in 651us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759520.152268:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061 00000100:00100000:0.0:1782759520.152290:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232932608:0@lo:400:kworker.0 00000100:00100000:1.0:1782759520.158982:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232931712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759520.587749:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759520.651712:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759520.651733:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232933376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759520.651797:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759520.651851:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933376 00000100:00100000:0.0:1782759520.651858:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933376 00000100:00100000:0.0:1782759520.651897:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1782759520.651904:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232933376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759520.651925:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759520.651973:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232933376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759520.651981:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:0.0:1782759520.652177:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232933376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759521.162891:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232933504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759521.162988:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759521.163126:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933504 00000100:00100000:2.0:1782759521.163136:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933504 00000100:00100000:2.0:1782759521.163232:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00100000:2.0:1782759521.163244:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232933504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759521.163286:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446133760 avail 1299894272 00000100:00100000:2.0:1782759521.163405:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232933504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 163us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759521.163413:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00000100:00100000:0.0:1782759521.163508:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232933504:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1782759521.214951:0:150174:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_64f Need fscrypt, skip fscrypt_admin role 00000100:00100000:0.0:1782759521.502201:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759521.502258:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759521.502301:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759521.502341:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759521.502377:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759521.502414:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532736 00000100:00100000:0.0:1782759521.502427:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532736 00000100:00100000:0.0:1782759521.502515:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532608 00000100:00100000:0.0:1782759521.502538:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532608 00000100:00100000:0.0:1782759521.502570:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5064 00000100:00100000:0.0:1782759521.502636:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218532736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759521.502729:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218532736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 96us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759521.502738:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5064 00000100:00100000:0.0:1782759521.502758:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5065 00000100:00100000:0.0:1782759521.502764:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218532608:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759521.502790:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218532608:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759521.502795:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5065 00000100:00100000:0.0:1782759521.502814:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532992 00000100:00100000:0.0:1782759521.502817:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532992 00000100:00100000:0.0:1782759521.502846:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532864 00000100:00100000:0.0:1782759521.502849:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532864 00000100:00100000:0.0:1782759521.502868:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2919 00000100:00100000:0.0:1782759521.502875:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218532992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759521.502903:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218532992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759521.502909:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2919 00000100:00100000:0.0:1782759521.502919:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2920 00000100:00100000:0.0:1782759521.502924:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218532864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759521.502945:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218532864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 21us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759521.502951:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2920 00000100:00080000:0.0:1782759521.502974:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759521.502978:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759521.502980:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759521.502982:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759521.504131:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218532480 00000100:00100000:3.0:1782759521.504150:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218532480 00000100:00100000:3.0:1782759521.504214:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3228 00000100:00100000:3.0:1782759521.504225:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218532480:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759521.504284:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218532480:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 61us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759521.504304:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3228 00010000:00010000:0.0:1782759521.611514:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759521.675051:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232933760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759521.675143:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759521.675265:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759521.675272:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232933632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759521.675297:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759521.678399:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933760 00000100:00100000:3.0:1782759521.678473:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933760 00000100:00100000:3.0:1782759521.678617:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933632 00000100:00100000:3.0:1782759521.678621:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933632 00000100:00100000:3.0:1782759521.678716:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:3.0:1782759521.678729:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232933760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759521.678774:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759521.678873:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232933760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759521.678880:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:3.0:1782759521.678899:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:3.0:1782759521.678906:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232933632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759521.678916:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759521.678958:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232933632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759521.678965:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:2.0:1782759521.679360:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232933632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759521.679380:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232933760:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1782759522.635662:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759522.683430:0:150222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64g: Nodemap enforces server_upcall RBAC role ========================================================== 14:58:42 (1782759522) 00000100:00100000:1.0:1782759522.914155:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759522.914544:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218533248 00000100:00100000:2.0:1782759522.914567:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218533248 00000100:00100000:2.0:1782759522.914676:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2928 00000100:00100000:2.0:1782759522.914685:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109388:x1869355218533248:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:2.0:1782759522.914782:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232933888:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759522.914822:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759522.914918:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232933888 00000100:00100000:0.0:1782759522.914922:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232933888 00000100:00100000:0.0:1782759522.914961:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:0.0:1782759522.914968:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355232933888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759522.915062:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355232933888:12345-0@lo:1000:mdt00_001.0 Request processed in 95us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.915070:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:2.0:1782759522.915122:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759522.915145:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232933888:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759522.915189:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934016:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759522.915212:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759522.915236:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759522.915368:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934016 00000100:00100000:0.0:1782759522.915371:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934016 00000100:00100000:0.0:1782759522.915399:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:0.0:1782759522.915404:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355232934016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759522.915537:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355232934016:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759522.915555:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00100000:3.0:1782759522.915670:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934016:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782759522.915709:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.915717:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.915735:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759522.915751:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934144:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782759522.915772:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.915786:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759522.915808:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934144 00000100:00100000:0.0:1782759522.915812:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934144 00000100:00100000:0.0:1782759522.915836:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:0.0:1782759522.915840:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355232934144:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1782759522.915848:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759522.915898:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cccd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ccc6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.915920:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cccd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccc6 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.915943:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cccd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccc6 expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.915951:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759522.915953:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759522.915957:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dcc00, rc 0) 00000100:00100000:0.0:1782759522.915993:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:6532:x1869355232934144:12345-0@lo:101:mdt00_001.0 Request processed in 151us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.915999:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1782759522.916238:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934144:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759522.916249:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.916256:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759522.916268:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1782759522.916285:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.916289:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.916294:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759522.916301:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934272:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782759522.916317:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.916330:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759522.916357:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934272 00000100:00100000:1.0:1782759522.916363:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934272 00000100:00100000:1.0:1782759522.916390:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:1.0:1782759522.916398:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6532:x1869355232934272:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1782759522.916406:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759522.916436:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ccd4 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.916461:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccd4 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.916482:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccd4 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.916489:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cdecd4e3c00) 00010000:00010000:1.0:1782759522.916492:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759522.916494:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759522.916534:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934272:12345-0@lo:101:mdt00_001.0 Request processed in 136us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759522.916670:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:3.0:1782759522.916894:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934272:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759522.916905:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.916926:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759522.916939:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1782759522.916964:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934400:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.916996:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.917072:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759522.917977:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934400 00000100:00100000:2.0:1782759522.917984:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934400 00000100:00100000:2.0:1782759522.918037:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:2.0:1782759522.918047:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759522.918815:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934400:12345-0@lo:1000:mdt00_001.0 Request processed in 769us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.918823:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00000100:00100000:3.0:1782759522.919230:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934400:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.919287:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934528:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.919324:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.919358:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759522.919381:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934528 00000100:00100000:0.0:1782759522.919388:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934528 00000100:00100000:0.0:1782759522.919442:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:0.0:1782759522.919461:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759522.919645:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934528:12345-0@lo:1000:mdt00_001.0 Request processed in 185us (319us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759522.919651:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00100000:3.0:1782759522.919944:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934528:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.920048:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934656:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.920075:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.920100:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759522.920124:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934656 00000100:00100000:2.0:1782759522.920128:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934656 00000100:00100000:2.0:1782759522.920173:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:2.0:1782759522.920182:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759522.920249:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934656:12345-0@lo:1000:mdt00_001.0 Request processed in 69us (173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759522.920255:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1782759522.920501:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934656:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.920543:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934784:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.920566:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.920584:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759522.920644:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934784 00000100:00100000:0.0:1782759522.920648:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934784 00000100:00100000:0.0:1782759522.920672:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:0.0:1782759522.920679:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759522.920734:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934784:12345-0@lo:1000:mdt00_001.0 Request processed in 56us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.920741:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1782759522.921551:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934784:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.921625:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934912:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.921652:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.921681:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759522.921693:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232934912 00000100:00100000:2.0:1782759522.921699:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232934912 00000100:00100000:2.0:1782759522.921749:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:2.0:1782759522.921758:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759522.921844:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232934912:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.921851:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00100000:3.0:1782759522.921916:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232934912:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.921978:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232935040:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759522.921994:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.922010:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759522.922050:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935040 00000100:00100000:0.0:1782759522.922054:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935040 00000100:00100000:0.0:1782759522.922085:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00100000:0.0:1782759522.922100:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232935040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759522.922149:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355232935040:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.922155:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00100000:3.0:1782759522.922215:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355232935040:0@lo:1000:mdt00_001.0 00000040:00080000:3.0:1782759522.923016:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].35, 992 off66960 00000040:00080000:3.0:1782759522.923073:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].35, 1144 off71392 00000004:00080000:3.0:1782759522.923077:0:6532:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cdec93a2180 with version 70 00000004:00080000:1.0:1782759522.923204:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 70 rpc_version 70 00000020:00100000:1.0:1782759522.923225:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1782759522.923230:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc542f800 x1869355232935296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782759522.923251:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232935296:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759522.923283:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759522.923312:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48d0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759522.923324:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935296 00000100:00100000:2.0:1782759522.923329:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935296 00000100:00100000:2.0:1782759522.923389:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00100000:2.0:1782759522.923398:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355232935296:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759522.923854:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355232935296:12345-0@lo:1000:osp_up0-1.0 Request processed in 457us (569us total) trans 4294968014 rc 0/0 00000100:00100000:2.0:1782759522.923861:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00100000:1.0:1782759522.923954:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232935296:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1782759522.924078:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924091:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924100:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759522.924114:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e872d67f reply state 0000000076f5aa55 transno 4294967702 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924122:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924127:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759522.924129:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759522.924131:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759522.924143:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00080000:3.0:1782759522.924149:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1782759522.924157:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924174:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924179:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924193:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1782759522.924198:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1782759522.924203:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924210:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.924219:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759522.924225:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.924232:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:2.0:1782759522.924237:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759522.924245:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.924270:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.924276:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759522.924289:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109388:x1869355218533248:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 9603us (10142us total) trans 4294967702 rc 0/0 00000100:00100000:3.0:1782759522.924296:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2928 00000100:00100000:1.0:1782759522.924505:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232935424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759522.924538:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759522.924657:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.924710:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de5200/0xd5b45c7f5c60ccc6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60cccd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.924723:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759522.924725:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759522.924727:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759522.924754:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935424 00000100:00100000:3.0:1782759522.924758:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935424 00000100:00100000:3.0:1782759522.924788:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1782759522.924795:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3664:x1869355232935424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759522.924807:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759522.924823:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cccd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccc6 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.924834:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759522.924841:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759522.924877:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3664:x1869355232935424:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759522.924882:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1782759522.924970:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232935424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759522.939038:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759522.939109:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218533376 00000100:00100000:2.0:1782759522.939117:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218533376 00000100:00100000:2.0:1782759522.939189:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2929 00000100:00100000:2.0:1782759522.939200:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109389:x1869355218533376:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759522.939218:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759522.939234:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27417 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939299:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939310:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939318:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939325:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939331:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccd4 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939348:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939372:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ccd4 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759522.939384:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1869355232935552:0@lo:104: 00000100:00100000:2.0:1782759522.939421:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.939466:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935552 00000100:00100000:3.0:1782759522.939489:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935552 00000100:00100000:2.0:1782759522.939533:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759522.939537:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1782759522.939548:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6533:x1869355232935552:12345-0@lo:104: 00010000:00010000:3.0:1782759522.939569:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.939762:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759522.939770:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6533:x1869355232935552:12345-0@lo:104: Request processed in 224us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.939778:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00010000:00010000:1.0:1782759522.939789:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759522.939801:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.939811:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759522.939817:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759522.939826:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759522.939835:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6533:1869355232935552:0@lo:104: 00010000:00010000:3.0:1782759522.939854:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.939861:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.939867:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759522.939919:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232935680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759522.939944:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759522.939984:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935680 00010000:00010000:1.0:1782759522.939987:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759522.939991:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935680 00010000:00010000:1.0:1782759522.939999:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc3de4e00/0xd5b45c7f5c60ccd4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ccdb expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.940014:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccd4 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.940017:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759522.940021:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759522.940024:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759522.940050:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1782759522.940059:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355232935680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759522.940069:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1782759522.942083:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968014 is committed 00010000:00010000:0.0:1782759522.942324:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60ccdb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccd4 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.942337:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cdecd4e3c00) 00010000:00010000:0.0:1782759522.942340:0:9534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.942347:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.942352:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.942375:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759522.942454:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.942463:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759522.942484:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232935680:12345-0@lo:103:ldlm_bl.0 Request processed in 2414us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.942502:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1782759522.942564:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232935680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759522.942778:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232935808:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759522.942815:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759522.942842:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4eaa540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759522.942936:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935808 00000100:00100000:0.0:1782759522.942940:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935808 00000100:00100000:0.0:1782759522.942982:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:0.0:1782759522.942987:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6533:x1869355232935808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782759522.943113:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6533:x1869355232935808:12345-0@lo:1000:mdt00_002.0 Request processed in 124us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.943120:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:3.0:1782759522.943604:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6533:1869355232935808:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1782759522.943666:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ccfe lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943679:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ccfe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943698:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ccfe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759522.943720:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ccfe lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943734:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943740:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943746:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943752:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943758:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759522.943762:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943769:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943779:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759522.943782:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759522.943786:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943791:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60ccf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943809:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943815:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943820:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943824:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759522.943826:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943829:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943835:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cdecd4e3c00) 00010000:00010000:3.0:1782759522.943836:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759522.943838:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943841:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ccf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943874:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27417 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943888:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ccfe lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27417 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.943903:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759522.943905:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759522.943907:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759522.943947:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109389:x1869355218533376:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 4749us (4918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759522.943954:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2929 00000100:00100000:0.0:1782759522.946345:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759522.946415:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218533504 00000100:00100000:2.0:1782759522.946425:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218533504 00000100:00100000:2.0:1782759522.946506:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2930 00000100:00100000:2.0:1782759522.946518:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109389:x1869355218533504:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759522.946551:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759522.946568:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cd05 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2741e expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.946657:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd0c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.946681:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd0c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.946692:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd0c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759522.946757:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:2.0:1782759522.946761:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759522.946795:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cd05 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2741e expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.946810:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd0c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2741e expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.946819:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:2.0:1782759522.946822:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759522.946825:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759522.946891:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109389:x1869355218533504:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 375us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.946899:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2930 00000100:00100000:1.0:1782759522.951807:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759522.951895:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218533760 00000100:00100000:3.0:1782759522.951905:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218533760 00000100:00100000:3.0:1782759522.951970:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2931 00000100:00100000:3.0:1782759522.951980:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109389:x1869355218533760:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:3.0:1782759522.952028:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759522.952062:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd0c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2741e expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.952080:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759522.952085:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759522.952108:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.952119:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.952127:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759522.957203:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967703 is committed 00000004:00010000:3.0:1782759522.957305:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004ec810c8 reply state 00000000e7b9ad98 transno 4294967703 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.957343:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759522.957353:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:3.0:1782759522.957356:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782759522.957360:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759522.957372:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00010000:00080000:3.0:1782759522.957487:0:6531:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1782759522.957508:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109389:x1869355218533760:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 5526us (5707us total) trans 4294967703 rc 0/0 00000100:00100000:3.0:1782759522.957523:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2931 00010000:00010000:2.0:1782759522.958136:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.958146:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.958151:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.958169:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759522.958173:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.958181:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.958192:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:2.0:1782759522.958194:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759522.958197:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.958204:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd13 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960775:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960790:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960797:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960802:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759522.960806:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960813:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960826:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4800) 00010000:00010000:0.0:1782759522.960829:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759522.960832:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.960855:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cce2 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759522.978966:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759522.979044:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218533888 00000100:00100000:2.0:1782759522.979054:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218533888 00000100:00100000:2.0:1782759522.979166:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2932 00000100:00100000:2.0:1782759522.979185:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109390:x1869355218533888:12345-192.168.202.31@tcp:101:chgrp.0 00010000:00010000:2.0:1782759522.979212:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759522.979250:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cd1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27425 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979361:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979375:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979385:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979422:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979429:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979435:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979501:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cd2f lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979510:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cd2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979820:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cd2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759522.979843:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cd2f lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979855:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979862:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979868:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979874:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979890:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759522.979894:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979901:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979913:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759522.979916:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759522.979920:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979926:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cd21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979940:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979946:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979951:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979956:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759522.979959:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.979965:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.980005:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cddc3500e00) 00010000:00010000:2.0:1782759522.980008:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759522.980011:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.980017:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cd28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.980060:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cd1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27425 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.980087:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cd2f lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27425 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.980106:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:2.0:1782759522.980109:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759522.980111:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759522.980191:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109390:x1869355218533888:12345-192.168.202.31@tcp:101:chgrp.0 Request processed in 1008us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.980212:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2932 00000100:00100000:1.0:1782759522.983146:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759522.983213:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759522.983292:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218534144 00000100:00100000:0.0:1782759522.983301:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218534144 00000100:00100000:0.0:1782759522.983360:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 402 00000100:00100000:0.0:1782759522.983369:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218534144:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759522.983383:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759522.983410:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cd2f lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27425 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759522.983430:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:0.0:1782759522.983434:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759522.983495:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218534144:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 126us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759522.983502:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 402 00000100:00100000:2.0:1782759522.984094:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218534016 00000100:00100000:2.0:1782759522.984099:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218534016 00000100:00100000:2.0:1782759522.984169:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2933 00000100:00100000:2.0:1782759522.984177:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109390:x1869355218534016:12345-192.168.202.31@tcp:101:chgrp.0 00010000:00010000:2.0:1782759522.984201:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759522.984217:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cd36 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2742c expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.984278:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cd3d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.984290:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cd3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.984301:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cd3d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759522.984340:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:2.0:1782759522.984344:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759522.984386:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60cd36 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2742c expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.984411:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cd3d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2742c expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.984418:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759522.984421:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759522.984423:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759522.984464:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109390:x1869355218534016:12345-192.168.202.31@tcp:101:chgrp.0 Request processed in 288us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759522.984487:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2933 00000100:00100000:1.0:1782759522.987045:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759522.987110:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218534400 00000100:00100000:2.0:1782759522.987118:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218534400 00000100:00100000:2.0:1782759522.987201:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2934 00000100:00100000:2.0:1782759522.987211:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109390:x1869355218534400:12345-192.168.202.31@tcp:36:chgrp.0 00010000:00010000:2.0:1782759522.987269:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759522.987292:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cd3d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2742c expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.987310:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759522.987320:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759522.987341:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.987353:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.987362:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759522.996907:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967704 is committed 00000004:00010000:2.0:1782759522.997257:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c96ba08 reply state 0000000000e03b41 transno 4294967704 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.997280:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759522.997290:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759522.997293:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782759522.997297:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759522.997308:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00010000:00080000:2.0:1782759522.997411:0:6532:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1782759522.997433:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109390:x1869355218534400:12345-192.168.202.31@tcp:36:chgrp.0 Request processed in 10219us (10390us total) trans 4294967704 rc 0/0 00000100:00100000:2.0:1782759522.997442:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2934 00010000:00010000:1.0:1782759522.997926:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.997935:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.997942:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.997948:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759522.997952:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.997961:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.997973:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:1.0:1782759522.997975:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759522.997979:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759522.997986:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cd44 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759523.002425:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.002690:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218534528 00000100:00100000:3.0:1782759523.002700:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218534528 00000100:00100000:3.0:1782759523.002768:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2935 00000100:00100000:3.0:1782759523.002777:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109208:x1869355218534528:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1782759523.002794:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759523.002812:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27433 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002864:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002877:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002886:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002897:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002915:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002922:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002969:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cd60 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002976:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cd60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.002982:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cd60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759523.003002:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cd60 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003015:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003021:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003026:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003031:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003036:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759523.003039:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003051:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003061:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759523.003064:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759523.003068:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003074:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60cd52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003086:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003091:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003096:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003101:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759523.003103:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003108:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003113:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759523.003115:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759523.003118:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003131:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cd59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003155:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27433 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003165:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cd60 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27433 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.003171:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759523.003173:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759523.003175:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:3.0:1782759523.003231:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109208:x1869355218534528:12345-192.168.202.31@tcp:101:bash.0 Request processed in 456us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.003238:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2935 00000100:00080000:0.0:1782759523.003312:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759523.005121:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.005157:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.005225:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218534784 00000100:00100000:0.0:1782759523.005233:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218534784 00000100:00100000:0.0:1782759523.005284:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 403 00000100:00100000:0.0:1782759523.005293:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218534784:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759523.005306:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759523.005324:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60cd60 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27433 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.005355:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:0.0:1782759523.005359:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759523.005408:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218534784:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 115us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.005415:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 403 00000100:00100000:1.0:1782759523.005890:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218534656 00000100:00100000:1.0:1782759523.005895:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218534656 00000100:00100000:1.0:1782759523.005969:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2936 00000100:00100000:1.0:1782759523.005976:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109208:x1869355218534656:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1782759523.005992:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759523.006009:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd67 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2743a expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.006063:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.006074:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.006083:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759523.006124:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:1.0:1782759523.006127:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759523.006171:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd67 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.006186:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.006202:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:1.0:1782759523.006205:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1782759523.006207:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759523.006239:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109208:x1869355218534656:12345-192.168.202.31@tcp:101:bash.0 Request processed in 264us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759523.006246:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2936 00000100:00080000:0.0:1782759523.007060:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759523.015086:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.015191:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218535040 00000100:00100000:0.0:1782759523.015201:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218535040 00000100:00100000:0.0:1782759523.015307:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2937 00000100:00100000:0.0:1782759523.015317:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109208:x1869355218535040:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1782759523.015338:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759523.015358:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cd75 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27441 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.015447:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.015484:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.015496:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.015511:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.015518:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.015543:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759523.015716:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232935936:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782759523.015757:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759523.015799:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759523.015977:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232935936 00000100:00100000:3.0:1782759523.015982:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232935936 00000100:00100000:3.0:1782759523.016031:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:3.0:1782759523.016040:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232935936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782759523.016107:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6531:x1869355232935936:12345-0@lo:1000:mdt00_000.0 Request processed in 68us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.016114:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:1.0:1782759523.016257:0:6531:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968014 gen 2 00000004:00080000:1.0:1782759523.016263:0:6531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968014 committed transno 4294968014 00000020:00080000:1.0:1782759523.016269:0:6531:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cdec93a2240 refcount 2 committed 0 result 0 batchid 34 00000020:00080000:1.0:1782759523.016272:0:6531:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3cea200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cdec93a2180 00000020:00080000:1.0:1782759523.016280:0:6531:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].35 00000020:00080000:1.0:1782759523.016282:0:6531:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cddc3cea900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4ab8c00 00000020:00080000:1.0:1782759523.016284:0:6531:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].35 00000100:00100000:1.0:1782759523.016310:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6531:1869355232935936:0@lo:1000:mdt00_000.0 00000020:00080000:3.0:1782759523.016692:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 34 committed batchid 33 00000020:00080000:3.0:1782759523.016732:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 33 00000004:00080000:1.0:1782759523.016921:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x16:0x0], index 0: 0 00010000:00010000:1.0:1782759523.017075:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd8a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017089:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd8a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017099:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd8a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017134:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017142:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017149:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017155:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017162:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759523.017166:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017174:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017195:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:1.0:1782759523.017198:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759523.017203:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017209:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cd7c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759523.017223:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054220011 reply state 0000000023c5ee7a transno 4294967705 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017234:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017241:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x121d9c5e (ffff8cddc3502a00) 00010000:00010000:1.0:1782759523.017243:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759523.017246:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759523.017276:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cd75 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27441 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017291:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd8a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27441 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.017298:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cdecd4e3300) 00010000:00010000:1.0:1782759523.017301:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759523.017303:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759523.017406:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109208:x1869355218535040:12345-192.168.202.31@tcp:101:bash.0 Request processed in 2090us (2329us total) trans 4294967705 rc 0/0 00000100:00100000:1.0:1782759523.017413:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2937 00000100:00100000:3.0:1782759523.022955:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.023048:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218535168 00000100:00100000:2.0:1782759523.023071:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218535168 00000100:00100000:2.0:1782759523.023187:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1082 00000100:00100000:2.0:1782759523.023207:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109208:x1869355218535168:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:2.0:1782759523.023224:0:8600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759523.023245:0:8600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1872e70/0xd5b45c7f5c60cd98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27448 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759523.023269:0:8600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1782759523.023290:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=3563s v=(0 0) 00010000:00010000:2.0:1782759523.023295:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759523.023306:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1872e70/0xd5b45c7f5c60cd98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27448 expref: 7 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.023324:0:8600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1872e70/0xd5b45c7f5c60cd98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27448 expref: 7 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.023338:0:8600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759523.023400:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109208:x1869355218535168:12345-192.168.202.31@tcp:101:bash.0 Request processed in 203us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.023414:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1082 00000100:00080000:0.0:1782759523.023670:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759523.028664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.029193:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218535424 00000100:00100000:3.0:1782759523.029204:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218535424 00000100:00100000:3.0:1782759523.029269:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 339 00000100:00100000:3.0:1782759523.029279:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109208:x1869355218535424:12345-192.168.202.31@tcp:35:bash.0 00000100:00100000:3.0:1782759523.029716:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109208:x1869355218535424:12345-192.168.202.31@tcp:35:bash.0 Request processed in 437us (1059us total) trans 4294967706 rc 0/0 00000100:00100000:3.0:1782759523.029726:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 339 00000100:00100000:1.0:1782759523.043924:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.044194:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218535680 00000100:00100000:3.0:1782759523.044203:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218535680 00000100:00100000:3.0:1782759523.044265:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2938 00000100:00100000:3.0:1782759523.044275:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109391:x1869355218535680:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:3.0:1782759523.044325:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759523.044352:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60cd8a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27441 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.044372:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cdecd4e3300) 00010000:00010000:3.0:1782759523.044382:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759523.044541:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.044555:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.044565:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759523.044877:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001fabef49 reply state 0000000052335dd8 transno 4294967707 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.044902:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.044909:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759523.044912:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1782759523.044914:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759523.045007:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:109391:x1869355218535680:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 733us (1092us total) trans 4294967707 rc 0/0 00000100:00100000:3.0:1782759523.045015:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2938 00000100:00100000:1.0:1782759523.047739:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.048372:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218535808 00000100:00100000:2.0:1782759523.048380:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218535808 00000100:00100000:2.0:1782759523.048454:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2939 00000100:00100000:2.0:1782759523.048465:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:109391:x1869355218535808:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759523.048495:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759523.048512:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cda6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2744f expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.048622:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cda6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2744f expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.048637:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cda6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2744f expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.048657:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:2.0:1782759523.048660:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759523.048662:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759523.048707:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109391:x1869355218535808:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 245us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.048713:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2939 00000100:00100000:2.0:1782759523.051996:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.052071:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218535936 00000100:00100000:0.0:1782759523.052079:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218535936 00000100:00100000:0.0:1782759523.052124:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1083 00000100:00100000:0.0:1782759523.052130:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218535936:12345-192.168.202.31@tcp:2:chmod.0 00002000:00010000:0.0:1782759523.052280:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759523.052283:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1782759523.052285:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1782759523.052286:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 0 -> 1782759523 00002000:00010000:0.0:1782759523.052288:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782759523.052337:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218535936:12345-192.168.202.31@tcp:2:chmod.0 Request processed in 206us (348us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1782759523.052341:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1083 00000100:00100000:1.0:1782759523.073690:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.074059:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218536064 00000100:00100000:2.0:1782759523.074067:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218536064 00000100:00100000:2.0:1782759523.074122:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2940 00000100:00100000:2.0:1782759523.074129:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109392:x1869355218536064:12345-192.168.202.31@tcp:101:chgrp.0 00010000:00010000:2.0:1782759523.074146:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759523.074164:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cdad lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27456 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074225:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074239:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074267:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074276:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074282:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074286:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074344:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074349:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074353:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759523.074383:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00000004:00200000:2.0:1782759523.074386:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759523.074412:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074420:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074427:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074438:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074442:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074446:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074449:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759523.074452:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074457:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074478:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:2.0:1782759523.074481:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759523.074486:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074492:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdb4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074506:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074512:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074518:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074529:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759523.074532:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074538:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074546:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x121d9c5e (ffff8cddc3502a00) 00010000:00010000:2.0:1782759523.074549:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759523.074552:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074558:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60cdbb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074718:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60cdad lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27456 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074732:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27456 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.074739:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:2.0:1782759523.074741:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759523.074744:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759523.074887:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:109392:x1869355218536064:12345-192.168.202.31@tcp:101:chgrp.0 Request processed in 757us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.074893:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2940 00000100:00100000:1.0:1782759523.082027:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.082104:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218536192 00000100:00100000:2.0:1782759523.082125:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218536192 00000100:00100000:2.0:1782759523.082190:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2941 00000100:00100000:2.0:1782759523.082200:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:109392:x1869355218536192:12345-192.168.202.31@tcp:101:chgrp.0 00010000:00010000:2.0:1782759523.082219:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759523.082238:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdc9 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2745d expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.082274:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cdd0 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.082288:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cdd0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.082299:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cdd0 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.082409:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdc9 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2745d expref: 15 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.082426:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cdd0 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2745d expref: 14 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.082434:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:2.0:1782759523.082437:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759523.082440:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759523.082544:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:109392:x1869355218536192:12345-192.168.202.31@tcp:101:chgrp.0 Request processed in 346us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.082551:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2941 00000100:00100000:2.0:1782759523.087967:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759523.089851:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218536448 00000100:00100000:1.0:1782759523.089865:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218536448 00000100:00100000:1.0:1782759523.089978:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2942 00000100:00100000:1.0:1782759523.089999:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:109392:x1869355218536448:12345-192.168.202.31@tcp:36:chgrp.0 00010000:00010000:1.0:1782759523.090044:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759523.090069:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cdc2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27456 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.090088:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:1.0:1782759523.090093:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759523.090121:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.090134:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.090143:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759523.090351:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 88 off9624 00000004:00080000:1.0:1782759523.090361:0:12673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3563366782420ns, next at 3564366780720ns, rc = 0 00000004:00010000:1.0:1782759523.092895:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b354c7ae reply state 00000000669828e2 transno 4294967708 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.092919:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.092936:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:1.0:1782759523.092938:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1782759523.092942:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759523.093072:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:109392:x1869355218536448:12345-192.168.202.31@tcp:36:chgrp.0 Request processed in 3072us (5110us total) trans 4294967708 rc 0/0 00000100:00100000:1.0:1782759523.093081:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2942 00000100:00100000:3.0:1782759523.096203:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.096282:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218536576 00000100:00100000:2.0:1782759523.096293:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218536576 00000100:00100000:2.0:1782759523.096357:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1084 00000100:00100000:2.0:1782759523.096368:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218536576:12345-192.168.202.31@tcp:2:chgrp.0 00002000:00010000:2.0:1782759523.096543:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759523.096547:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782759523.096549:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782759523.096551:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1782759523 -> 1782759523 00002000:00010000:2.0:1782759523.096553:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782759523.096818:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218536576:12345-192.168.202.31@tcp:2:chgrp.0 Request processed in 453us (623us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1782759523.096826:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1084 00000100:00100000:2.0:1782759523.116409:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.117661:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218536704 00000100:00100000:3.0:1782759523.117673:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218536704 00000100:00100000:0.0:1782759523.117877:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2943 00000100:00100000:0.0:1782759523.117888:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:109393:x1869355218536704:12345-192.168.202.31@tcp:101:setfacl.0 00010000:00010000:0.0:1782759523.117911:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759523.117929:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cdde lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27464 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.117999:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118010:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118021:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118030:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118036:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118041:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118110:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118118:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118123:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759523.118238:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00000004:00200000:0.0:1782759523.118242:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759523.118278:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118297:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118306:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118312:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118317:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118322:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118327:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759523.118383:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118389:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118400:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:0.0:1782759523.118403:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759523.118454:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118560:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cde5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118649:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118665:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118671:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118676:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dce00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759523.118680:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118687:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118695:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x121d9c5e (ffff8cddc3502a00) 00010000:00010000:0.0:1782759523.118698:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759523.118701:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118707:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60cdec lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118732:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60cdde lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118744:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.118750:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:0.0:1782759523.118752:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759523.118760:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4ddc00, rc 0) 00000100:00100000:0.0:1782759523.118868:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:109393:x1869355218536704:12345-192.168.202.31@tcp:101:setfacl.0 Request processed in 981us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.118877:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2943 00000100:00100000:0.0:1782759523.122965:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.123082:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218536960 00000100:00100000:2.0:1782759523.123091:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218536960 00000100:00100000:2.0:1782759523.123239:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2944 00000100:00100000:2.0:1782759523.123252:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:109393:x1869355218536960:12345-192.168.202.31@tcp:36:setfacl.0 00010000:00010000:2.0:1782759523.123300:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759523.123337:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60cdd0 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2745d expref: 16 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.123356:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:2.0:1782759523.123361:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759523.123449:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.123554:0:8593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.126334:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 4/0,1 mode: --/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.126381:0:8593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.126408:0:8593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 15 pid: 6532 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.126423:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232936064:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759523.126536:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f716c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759523.129133:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355232936064:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759523.129173:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759523.130566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.130816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537088 00000100:00100000:3.0:1782759523.130825:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537088 00010000:00010000:3.0:1782759523.130865:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 16 pid: 6532 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759523.130943:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 806 00000100:00100000:3.0:1782759523.130953:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5717c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:2402:x1869355218537088:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759523.130969:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759523.130977:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 16 pid: 6532 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.130989:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 16 pid: 6532 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.131015:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cdf3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27464 expref: 16 pid: 6532 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.131044:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759523.131049:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.131059:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.131068:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.131098:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759523.131165:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5717c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2402:x1869355218537088:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 212us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.131174:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 806 00010000:00010000:2.0:1782759523.131503:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.131513:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759523.131741:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e95c6023 reply state 0000000043cd032b transno 4294967709 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.131761:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759523.131769:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:2.0:1782759523.131785:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782759523.131789:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759523.131848:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:109393:x1869355218536960:12345-192.168.202.31@tcp:36:setfacl.0 Request processed in 8599us (8891us total) trans 4294967709 rc 0/0 00000100:00100000:2.0:1782759523.131861:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2944 00000100:00100000:0.0:1782759523.144963:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.145045:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537216 00000100:00100000:3.0:1782759523.145054:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537216 00000100:00100000:3.0:1782759523.145132:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2945 00000100:00100000:3.0:1782759523.145140:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:109394:x1869355218537216:12345-192.168.202.31@tcp:101:setfacl.0 00010000:00010000:3.0:1782759523.145174:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759523.145232:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2746b expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.145283:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.145295:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.145322:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759523.145360:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:3.0:1782759523.145363:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759523.145380:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.145410:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.145428:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.145435:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:3.0:1782759523.145437:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759523.145439:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759523.145519:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:109394:x1869355218537216:12345-192.168.202.31@tcp:101:setfacl.0 Request processed in 370us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.145525:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2945 00000100:00100000:3.0:1782759523.149438:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759523.149519:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537472 00000100:00100000:1.0:1782759523.149529:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537472 00000100:00100000:1.0:1782759523.149652:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2946 00000100:00100000:1.0:1782759523.149661:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:109394:x1869355218537472:12345-192.168.202.31@tcp:36:setfacl.0 00010000:00010000:1.0:1782759523.149723:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.149734:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 17 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.149740:0:6531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.149746:0:6531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 5/0,1 mode: --/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.149770:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.149779:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759523.149803:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1869355232936192:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759523.149874:0:6531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 17 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.149881:0:6531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 17 pid: 12673 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759523.149887:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1869355232936320:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759523.149903:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48d0840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759523.152331:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759523.152352:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1869355232936320:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759523.152535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537600 00000100:00100000:0.0:1782759523.152542:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537600 00010000:00010000:0.0:1782759523.152614:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 18 pid: 12673 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759523.152643:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 807 00000100:00100000:0.0:1782759523.152653:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2405:x1869355218537600:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759523.152667:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759523.152674:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 18 pid: 12673 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.152685:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 18 pid: 12673 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.152707:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cd6e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2743a expref: 18 pid: 12673 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.152723:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:0.0:1782759523.152728:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.152752:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.152759:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759523.152919:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:2405:x1869355218537600:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 266us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.152928:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 807 00000100:00100000:0.0:1782759523.156306:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6531:1869355232936192:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759523.156379:0:6531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.156915:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.156976:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537728 00000100:00100000:0.0:1782759523.156982:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537728 00010000:00010000:0.0:1782759523.157015:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759523.157049:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 808 00000100:00100000:0.0:1782759523.157059:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:2402:x1869355218537728:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759523.157076:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759523.157083:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.157096:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.157117:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ce08 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2746b expref: 17 pid: 42628 timeout: 3663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.157146:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:0.0:1782759523.157151:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: --/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.157162:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.157170:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.157195:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759523.157305:0:6531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.157369:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759523.158574:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:2402:x1869355218537728:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1511us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.158596:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 808 00000001:00080000:3.0:1782759523.163802:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967710 is committed 00000004:00080000:3.0:1782759523.163819:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 90 committed 00010000:00010000:1.0:1782759523.163980:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.163984:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1782759523.163996:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.164004:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232936448:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1782759523.164007:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164015:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759523.164020:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164045:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.164060:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759523.164062:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x121d9c5e (ffff8cddc3502a00) 00010000:00010000:1.0:1782759523.164066:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759523.164072:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164079:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cd83 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.164096:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232936448 00000100:00100000:2.0:1782759523.164102:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232936448 00010000:00010000:1.0:1782759523.164105:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164113:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164119:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164125:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759523.164129:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164136:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.164143:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00010000:00010000:1.0:1782759523.164145:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:1.0:1782759523.164149:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782759523.164153:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232936448:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1782759523.164155:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164167:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60cd9f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164182:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164188:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164195:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164201:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759523.164205:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164210:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164218:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:1.0:1782759523.164220:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759523.164223:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164228:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60cdd7 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164240:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164247:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164258:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164264:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759523.164266:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164273:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164281:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:1.0:1782759523.164284:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759523.164287:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.164293:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cdfa lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759523.164353:0:8600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759523.164357:0:8600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782759523.164359:0:8600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782759523.164362:0:8600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1782759523 -> 1782759523 00002000:00010000:2.0:1782759523.164365:0:8600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00080000:0.0:1782759523.164379:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759523.164506:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232936448:12345-0@lo:2:osp-syn-0-1.0 Request processed in 355us (445us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1782759523.164522:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000004:00080000:1.0:1782759523.164653:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4434380/2, rc 0, transno 4294967420 00000100:00100000:1.0:1782759523.164659:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232936448:0@lo:2:osp-syn-0-1.0 00000020:00080000:3.0:1782759523.164757:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 34 batchid updated 00000020:00080000:1.0:1782759523.164837:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 34 00000004:00080000:1.0:1782759523.164879:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cdec93a2180 with version 71 00000020:00080000:1.0:1782759523.164917:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 34 cancel update log [0x200000401:0x2:0x0].35: rc = 0 00000020:00080000:1.0:1782759523.164979:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 34 cancel update log [0x240000400:0x2:0x0].35: rc = 0 00000020:00080000:1.0:1782759523.164988:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 34 00000004:00080000:2.0:1782759523.165017:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 71 rpc_version 71 00000020:00100000:2.0:1782759523.165040:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1782759523.165048:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddc4435500 x1869355232936704/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000001:00080000:0.0:1782759523.165063:0:6531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967710 00000100:00100000:2.0:1782759523.165068:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232936704:0@lo:1000:osp_up0-1.0 00000004:00010000:0.0:1782759523.165114:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092147204 reply state 00000000489dd94c transno 4294967711 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759523.165124:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759523.165136:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.165145:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:0.0:1782759523.165148:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782759523.165151:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759523.165153:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759523.165215:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109394:x1869355218537472:12345-192.168.202.31@tcp:36:setfacl.0 Request processed in 15553us (15783us total) trans 4294967711 rc 0/0 00000100:00100000:0.0:1782759523.165224:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2946 00000020:00080000:0.0:1782759523.165228:0:6531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782759523.165278:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232936704 00000100:00100000:1.0:1782759523.165283:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232936704 00000100:00100000:1.0:1782759523.165332:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:1.0:1782759523.165346:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355232936704:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759523.165952:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355232936704:12345-0@lo:1000:osp_up0-1.0 Request processed in 604us (829us total) trans 4294968015 rc 0/0 00000100:00100000:1.0:1782759523.165960:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1782759523.166152:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355232936704:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1782759523.182755:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.182842:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537856 00000100:00100000:3.0:1782759523.182850:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537856 00000100:00100000:3.0:1782759523.182908:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2947 00000100:00100000:3.0:1782759523.182915:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109395:x1869355218537856:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1782759523.182932:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759523.182947:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27472 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.182992:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183002:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183010:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183019:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183023:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183026:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183065:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ce2b lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183070:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ce2b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183073:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ce2b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759523.183098:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ce2b lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183108:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183112:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183116:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183120:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183123:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759523.183125:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183130:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183139:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759523.183141:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759523.183144:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183147:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183171:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183179:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183183:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183185:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759523.183187:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183191:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183195:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759523.183196:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759523.183198:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183201:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183226:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27472 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183239:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ce2b lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27472 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.183246:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759523.183248:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759523.183256:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759523.183309:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:109395:x1869355218537856:12345-192.168.202.31@tcp:101:ls.0 Request processed in 393us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759523.183315:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2947 00000100:00100000:2.0:1782759523.186079:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759523.186141:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759523.186200:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218537984 00000100:00100000:1.0:1782759523.186208:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218537984 00000100:00100000:1.0:1782759523.186260:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2948 00000100:00100000:1.0:1782759523.186268:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109395:x1869355218537984:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759523.186288:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759523.186302:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60ce32 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27479 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.186350:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60ce39 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.186362:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60ce39 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.186373:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60ce39 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759523.186413:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:1.0:1782759523.186416:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759523.186457:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60ce32 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27479 expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.186486:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60ce39 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27479 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759523.186521:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:1.0:1782759523.186524:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759523.186526:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759523.186571:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109395:x1869355218537984:12345-192.168.202.31@tcp:101:ls.0 Request processed in 304us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759523.186598:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2948 00000100:00100000:0.0:1782759523.187206:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218538112 00000100:00100000:0.0:1782759523.187212:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218538112 00000100:00100000:0.0:1782759523.187257:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 404 00000100:00100000:0.0:1782759523.187265:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218538112:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759523.187276:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759523.187293:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60ce2b lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27472 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.187307:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:0.0:1782759523.187310:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759523.187350:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218538112:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 86us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.187356:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 404 00000100:00100000:2.0:1782759523.191067:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.191124:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218538368 00000100:00100000:0.0:1782759523.191132:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218538368 00000100:00100000:0.0:1782759523.191188:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2949 00000100:00100000:0.0:1782759523.191195:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109395:x1869355218538368:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759523.191213:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759523.191235:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60ce40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27480 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759523.191330:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00010000:00010000:0.0:1782759523.191558:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60ce40 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27480 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.191569:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cddc3502600) 00010000:00010000:0.0:1782759523.191572:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759523.191618:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dce00/0xd5b45c7f5c60ce40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27480 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759523.191631:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dce00, rc 0) 00000100:00100000:0.0:1782759523.191669:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109395:x1869355218538368:12345-192.168.202.31@tcp:101:ls.0 Request processed in 475us (611us total) trans 4294967712 rc 301/301 00000100:00100000:0.0:1782759523.191674:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2949 00000100:00100000:1.0:1782759523.194675:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.194765:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218538496 00000100:00100000:0.0:1782759523.194775:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218538496 00000100:00100000:0.0:1782759523.194832:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 340 00000100:00100000:0.0:1782759523.194843:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109395:x1869355218538496:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:0.0:1782759523.198491:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109395:x1869355218538496:12345-192.168.202.31@tcp:37:ls.0 Request processed in 3638us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759523.198505:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 340 00000100:00100000:2.0:1782759523.202735:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759523.202852:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218538624 00000100:00100000:3.0:1782759523.202860:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218538624 00000100:00100000:3.0:1782759523.202924:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2950 00000100:00100000:3.0:1782759523.202931:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109395:x1869355218538624:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1782759523.202947:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759523.202963:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce4e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27487 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203009:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203019:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203027:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203036:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203040:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203045:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203187:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203207:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203215:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759523.203256:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00000004:00200000:3.0:1782759523.203260:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759523.203285:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203297:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203307:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203313:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203320:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203326:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203332:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759523.203337:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203344:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203368:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:3.0:1782759523.203371:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759523.203376:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203383:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60ce55 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203396:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203403:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203409:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203415:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759523.203418:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203424:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203432:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x121d9c5e (ffff8cddc34f4300) 00010000:00010000:3.0:1782759523.203435:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759523.203438:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203444:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ce5c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x121d9c5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203492:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce4e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27487 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203506:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27487 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759523.203849:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759523.203851:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759523.203854:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:2.0:1782759523.204038:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:109395:x1869355218538624:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1105us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759523.204048:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2950 00000100:00100000:1.0:1782759523.208449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759523.208518:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218538880 00000100:00100000:0.0:1782759523.208529:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218538880 00000100:00100000:0.0:1782759523.208617:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 341 00000100:00100000:0.0:1782759523.208628:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:109395:x1869355218538880:12345-192.168.202.31@tcp:35:ls.0 00000100:00100000:0.0:1782759523.208986:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109395:x1869355218538880:12345-192.168.202.31@tcp:35:ls.0 Request processed in 359us (545us total) trans 4294967713 rc 0/0 00000100:00100000:0.0:1782759523.208994:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 341 00010000:00010000:0.0:1782759523.661186:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759524.235142:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232936832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759524.235212:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759524.235348:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232936832 00000100:00100000:2.0:1782759524.235357:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232936832 00000100:00100000:2.0:1782759524.235423:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:2.0:1782759524.235434:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232936832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759524.235491:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:2.0:1782759524.235544:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232936832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759524.235550:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:1.0:1782759524.235619:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232936832:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759524.683799:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759525.259606:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759525.259629:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232936960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759525.259695:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.259767:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232936960 00000100:00100000:1.0:1782759525.259774:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232936960 00000100:00100000:1.0:1782759525.259826:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:1.0:1782759525.259836:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232936960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759525.259863:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759525.259903:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232936960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.259910:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00080000:1.0:1782759525.259931:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759525.259965:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3c50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232936960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759525.264921:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759525.264942:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232937088:0@lo:400:kworker.0 00000100:00100000:2.0:1782759525.265009:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759525.265092:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232937472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759525.265119:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.266608:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232937344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.266663:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.266697:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759525.266703:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232937216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.266731:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.266763:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937472 00000100:00100000:1.0:1782759525.266771:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937472 00000100:00100000:1.0:1782759525.266813:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937216 00000100:00100000:1.0:1782759525.266816:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937216 00000100:00100000:1.0:1782759525.266836:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5066 00000100:00100000:1.0:1782759525.266843:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232937472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.266893:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232937472:12345-0@lo:400:kworker.0 Request processed in 50us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.266900:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5066 00000100:00100000:1.0:1782759525.266916:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5067 00000100:00100000:1.0:1782759525.266922:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232937216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.266949:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232937216:12345-0@lo:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.266955:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5067 00000100:00100000:1.0:1782759525.266970:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937344 00000100:00100000:1.0:1782759525.266973:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937344 00000100:00100000:1.0:1782759525.267009:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:1.0:1782759525.267014:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232937344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.267042:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:3663:x1869355232937344:12345-0@lo:400:kworker.0 Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.267048:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:1.0:1782759525.267098:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232937216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.267110:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232937344:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267322:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232937728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267350:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759525.267369:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232938240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267387:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759525.267403:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782759525.267408:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232937856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267428:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759525.267440:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232938368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267472:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759525.267495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937088 00000100:00100000:3.0:1782759525.267499:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937088 00000100:00100000:3.0:1782759525.267526:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3229 00000100:00100000:3.0:1782759525.267533:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232937088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267562:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232937088:12345-0@lo:400:kworker.0 Request processed in 30us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759525.267568:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3229 00000100:00100000:3.0:1782759525.267633:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937728 00000100:00100000:3.0:1782759525.267637:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937728 00000100:00100000:3.0:1782759525.267663:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938240 00000100:00100000:3.0:1782759525.267665:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938240 00000100:00100000:3.0:1782759525.267680:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937856 00000100:00100000:3.0:1782759525.267682:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937856 00000100:00100000:3.0:1782759525.267693:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938368 00000100:00100000:3.0:1782759525.267696:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938368 00000100:00100000:3.0:1782759525.267708:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5068 00000100:00100000:3.0:1782759525.267715:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232937728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267746:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232937728:12345-0@lo:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759525.267752:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5068 00000100:00100000:3.0:1782759525.267764:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5069 00000100:00100000:3.0:1782759525.267769:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232938240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267796:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232938240:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759525.267801:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5069 00000100:00100000:3.0:1782759525.267813:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070 00000100:00100000:3.0:1782759525.267819:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232937856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267844:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232937856:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759525.267850:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070 00000100:00100000:3.0:1782759525.267859:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5071 00000100:00100000:3.0:1782759525.267865:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232938368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267888:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232938368:12345-0@lo:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759525.267902:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5071 00000100:00100000:3.0:1782759525.267930:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232937856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267940:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232938368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267949:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232937728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.267957:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232938240:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268194:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232938112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268224:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.268253:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782759525.268259:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232937984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268279:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759525.268296:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232938496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268316:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759525.268344:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759525.268348:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759525.268358:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938112 00000100:00100000:1.0:1782759525.268361:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938112 00000100:00100000:1.0:1782759525.268391:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937984 00000100:00100000:1.0:1782759525.268394:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937984 00000100:00100000:1.0:1782759525.268413:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938496 00000100:00100000:1.0:1782759525.268416:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938496 00000100:00100000:1.0:1782759525.268432:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:1.0:1782759525.268437:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232938112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268485:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232938112:12345-0@lo:400:kworker.0 Request processed in 48us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.268491:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:1.0:1782759525.268502:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1782759525.268508:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232937984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268533:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232937984:12345-0@lo:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.268538:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1782759525.268556:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:1.0:1782759525.268562:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232938496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268611:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232938496:12345-0@lo:400:kworker.0 Request processed in 49us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759525.268617:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00080000:1.0:1782759525.268639:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759525.268641:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759525.268657:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232937984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268665:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232938496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759525.268674:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232938112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759525.269235:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759525.269248:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232937600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759525.269282:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759525.269329:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232937472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759525.269338:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232937088:0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.269484:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232937600 00000100:00100000:3.0:1782759525.269489:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232937600 00000100:00100000:3.0:1782759525.269534:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:3.0:1782759525.269540:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232937600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759525.269599:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232937600:12345-0@lo:400:kworker.0 Request processed in 59us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759525.269605:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:2.0:1782759525.269663:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232937600:0@lo:400:kworker.0 00010000:00010000:1.0:1782759525.706710:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759525.770680:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232938624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759525.770751:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759525.770814:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938624 00000100:00100000:0.0:1782759525.770822:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938624 00000100:00100000:0.0:1782759525.770870:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1782759525.770878:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232938624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759525.770900:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759525.770944:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc56fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232938624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759525.770951:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1782759525.770997:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232938624:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1782759525.820393:0:150417:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb1535400 20000000:00000080:3.0:1782759525.820410:0:150417:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc36fb400 uarg=0000000000000000 10000000:01000000:3.0:1782759525.820961:0:150417:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759525.820982:0:150417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.821000:0:150417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.821009:0:150417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.821047:0:150417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.821072:0:150417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 23 pid: 6524 timeout: 3716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759525.821086:0:150417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150417:1869355232938752:0@lo:104: 00000100:00100000:3.0:1782759525.821150:0:150417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759525.821248:0:150417:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759525.821368:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759525.821381:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938752 00000100:00100000:2.0:1782759525.821388:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938752 00000100:00100000:2.0:1782759525.821486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1782759525.821496:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf957c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:150417:x1869355232938752:12345-0@lo:104: 00010000:00010000:2.0:1782759525.821508:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759525.821573:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759525.821599:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf957c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:150417:x1869355232938752:12345-0@lo:104: Request processed in 106us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759525.821606:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00010000:00010000:0.0:1782759525.821685:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759525.821692:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821700:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759525.821704:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821713:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759525.821720:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759525.821725:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759525.821753:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821759:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759525.821778:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821795:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ccb8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ccbf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821810:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759525.821812:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759525.821813:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759525.821824:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232938880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759525.821854:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759525.821892:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232938880 00000100:00100000:0.0:1782759525.821896:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232938880 00010000:00010000:0.0:1782759525.821911:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 24 pid: 6524 timeout: 3716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759525.821930:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1782759525.821936:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232938880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759525.821945:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759525.821949:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 24 pid: 6524 timeout: 3716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821958:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 24 pid: 6524 timeout: 3716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821972:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821979:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.821999:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822005:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822011:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822016:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822021:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759525.822025:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822032:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822039:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759525.822047:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759525.822072:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232938880:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759525.822078:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1782759525.822112:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232938880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759525.822201:0:150417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60ccbf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ccb8 expref: 23 pid: 6524 timeout: 3716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759525.822210:0:150417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150417:1869355232938752:0@lo:104: 00010000:00010000:3.0:1782759525.822225:0:150417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.822233:0:150417:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.822239:0:150417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759525.822245:0:150417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ce6a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759526.283544:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232939008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759526.283647:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759526.283923:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939008 00000100:00100000:0.0:1782759526.283931:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939008 00000100:00100000:0.0:1782759526.284021:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:0.0:1782759526.284031:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232939008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759526.284062:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759526.284123:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232939008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759526.284131:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:1.0:1782759526.284194:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232939008:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1782759526.474357:0:150466:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda5fc4930 20000000:00000080:0.0:1782759526.474375:0:150466:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4bb5400 uarg=0000000000000000 10000000:01000000:0.0:1782759526.474546:0:150466:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759526.474842:0:150466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474858:0:150466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474868:0:150466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474876:0:150466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474884:0:150466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474891:0:150466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474908:0:150466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759526.474913:0:150466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474920:0:150466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474933:0:150466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474940:0:150466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759526.474948:0:150466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ce71 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759526.699372:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759526.699421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759526.699479:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539136 00000100:00100000:1.0:1782759526.699488:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539136 00000100:00100000:1.0:1782759526.699550:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5072 00000100:00100000:1.0:1782759526.699560:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218539136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759526.699652:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218539136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759526.699660:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5072 00000100:00080000:1.0:1782759526.699680:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759526.699707:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759526.699812:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759526.699838:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759526.699871:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539264 00000100:00100000:1.0:1782759526.699875:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539264 00000100:00100000:1.0:1782759526.699906:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5073 00000100:00100000:1.0:1782759526.699912:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2404:x1869355218539264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759526.699948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2404:x1869355218539264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759526.699954:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5073 00000100:00100000:1.0:1782759526.699970:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539392 00000100:00100000:1.0:1782759526.699974:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539392 00000100:00100000:1.0:1782759526.700007:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539520 00000100:00100000:1.0:1782759526.700010:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539520 00000100:00100000:1.0:1782759526.700032:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2924 00000100:00100000:1.0:1782759526.700038:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218539392:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759526.700065:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218539392:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759526.700071:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2924 00000100:00100000:1.0:1782759526.700083:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1086 00000100:00100000:1.0:1782759526.700089:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218539520:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782759526.700104:0:8445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60c59c 00000100:00080000:1.0:1782759526.700112:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cded3bdd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759526.700153:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967410 00000100:00100000:1.0:1782759526.700279:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+2:2401:x1869355218539520:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 189us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759526.700287:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1086 00000100:00080000:1.0:1782759526.700303:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759526.700306:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759526.700314:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1782759526.700390:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759526.700551:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539008 00000100:00100000:3.0:1782759526.700556:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539008 00000100:00100000:3.0:1782759526.700633:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3230 00000100:00100000:3.0:1782759526.700640:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218539008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759526.700670:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218539008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759526.700686:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3230 00010000:00010000:1.0:1782759526.732649:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759526.794722:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232939264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759526.794729:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232939136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759526.794854:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759526.794892:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939136 00000100:00100000:3.0:1782759526.794901:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939136 00000100:00100000:3.0:1782759526.794961:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:3.0:1782759526.794972:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232939136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759526.795000:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1782759526.795044:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232939136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759526.795051:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:0.0:1782759526.795115:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759526.795840:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939264 00000100:00100000:2.0:1782759526.795845:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939264 00000100:00100000:2.0:1782759526.795887:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:2.0:1782759526.795895:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232939264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759526.795909:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1782759526.795946:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232939264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759526.795952:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:2.0:1782759526.795993:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232939264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759526.796037:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232939136:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782759527.372470:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759527.372478:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759527.372483:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759527.372524:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372536:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372547:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759527.372571:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232939392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759527.372646:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759527.372689:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759527.372711:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939392 00000100:00100000:2.0:1782759527.372716:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939392 00000100:00100000:2.0:1782759527.372761:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231 00000100:00100000:2.0:1782759527.372768:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232939392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759527.372780:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759527.372792:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ce78 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372812:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372821:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372841:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759527.372870:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232939392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759527.372877:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231 00000100:00100000:2.0:1782759527.372917:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232939392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759527.372929:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372938:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759527.372955:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759527.372959:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759527.372966:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759527.757284:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759528.158896:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759528.158939:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759528.158999:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539776 00000100:00100000:0.0:1782759528.159008:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539776 00000100:00100000:0.0:1782759528.159070:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1087 00000100:00100000:0.0:1782759528.159080:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218539776:12345-192.168.202.31@tcp:16:kworker.0 00000100:00100000:0.0:1782759528.159181:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218539776:12345-192.168.202.31@tcp:16:kworker.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759528.159188:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1087 00000100:00100000:2.0:1782759528.159247:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539648 00000100:00100000:2.0:1782759528.159251:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539648 00002000:00100000:2.0:1782759528.159286:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->2) req@ffff8cddc208e680 x1869355218539648/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:689/0 lens 496/0 e 0 to 0 dl 1782759539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759528.159295:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cddc208e680 with x1869355218539648 ext(0->2) 00002000:00010000:2.0:1782759528.159301:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cddc208e680 00000100:00100000:2.0:1782759528.159326:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 47 00000100:00100000:2.0:1782759528.159334:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218539648:12345-192.168.202.31@tcp:4:bash.0 00000100:00080000:1.0:1782759528.160247:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759528.160457:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:2404:x1869355218539648:12345-192.168.202.31@tcp:4:bash.0 Request processed in 1121us (1564us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1782759528.160467:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 47 00002000:00100000:2.0:1782759528.160476:0:8452:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000400:0x16:0x0] (0->2) req@ffff8cddc208e680 x1869355218539648/t4294967421(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:689/0 lens 496/448 e 0 to 0 dl 1782759539 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782759528.160484:0:8452:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8cddc208e680 with x1869355218539648 ext(0->2) 00002000:00010000:2.0:1782759528.160489:0:8452:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cddc208e680 00000001:00080000:0.0:1782759528.166833:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967421 is committed 00000001:00080000:0.0:1782759528.166861:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967420 is committed 00010000:00010000:3.0:1782759528.779232:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759528.851789:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967713 is committed 00010000:00010000:2.0:1782759528.852474:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759528.852489:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759528.852499:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759528.852506:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759528.852512:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759528.852521:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759528.852543:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:2.0:1782759528.852546:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759528.852551:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759528.852557:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60ce0f lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759528.856749:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968015 is committed 00000020:00000080:2.0:1782759529.303271:0:150614:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe245d3a80 20000000:00000080:2.0:1782759529.303293:0:150614:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3ecf400 uarg=0000000000000000 10000000:01000000:2.0:1782759529.303956:0:150614:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759529.304042:0:150614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.304063:0:150614:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.304073:0:150614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.304119:0:150614:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.304482:0:150614:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 23 pid: 6524 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759529.304502:0:150614:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150614:1869355232939520:0@lo:104: 00000100:00100000:2.0:1782759529.304761:0:150614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759529.304867:0:150614:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759529.304917:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939520 00000100:00100000:0.0:1782759529.304925:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939520 00000100:00100000:0.0:1782759529.305061:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1782759529.305072:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:150614:x1869355232939520:12345-0@lo:104: 00010000:00010000:0.0:1782759529.305088:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759529.305153:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759529.305159:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:150614:x1869355232939520:12345-0@lo:104: Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759529.305167:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00010000:00010000:1.0:1782759529.305210:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759529.305218:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.305226:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759529.305230:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.305240:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759529.305248:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759529.305253:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759529.305287:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.305293:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759529.305314:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.305321:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60ce78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ce7f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759529.305357:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759529.305359:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759529.305360:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759529.305381:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759529.305392:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232939648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759529.305441:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759529.305519:0:150614:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150614:1869355232939520:0@lo:104: 00010000:00010000:2.0:1782759529.305550:0:150614:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759529.305609:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939648 00000100:00100000:2.0:1782759529.305613:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939648 00010000:00010000:2.0:1782759529.305633:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 24 pid: 6524 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759529.305668:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1782759529.305675:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232939648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759529.305695:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759529.305701:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 24 pid: 6524 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305711:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 24 pid: 6524 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305725:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce7f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce78 expref: 24 pid: 6524 timeout: 3719 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305739:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305747:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305760:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305767:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305775:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305782:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305797:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759529.305802:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305809:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305820:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305830:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759529.305852:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232939648:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759529.305859:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00010000:00010000:2.0:1782759529.305878:0:150614:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305884:0:150614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759529.305891:0:150614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60ce86 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759529.307014:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232939648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759529.355701:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232939776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759529.355792:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759529.355868:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939776 00000100:00100000:1.0:1782759529.355876:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939776 00000100:00100000:1.0:1782759529.355954:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:1.0:1782759529.355964:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232939776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759529.356007:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759529.356053:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232939776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759529.356060:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00100000:1.0:1782759529.356109:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968015 gen 2 00000004:00080000:1.0:1782759529.356115:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968015 committed transno 4294968015 00000100:00100000:1.0:1782759529.356146:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232939776:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759529.805227:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759530.384969:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232940160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759530.385063:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.385130:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232940672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759530.385158:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.385184:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232941184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759530.385205:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.385229:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759530.385235:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232940288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759530.385258:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.385275:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232940800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759530.385299:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.385316:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232941312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759530.385349:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.385436:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940160 00000100:00100000:0.0:1782759530.385445:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940160 00000100:00100000:0.0:1782759530.385533:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282 00000100:00100000:0.0:1782759530.385543:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232940160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.385856:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232940032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.385891:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.385919:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232940544:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.385943:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.385961:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232941056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.385982:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.386009:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782759530.386016:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232939904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.386048:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.386070:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232940416:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.386120:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.386138:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232940928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.386166:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.386196:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232941440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.386221:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.386254:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940672 00000100:00100000:3.0:1782759530.386260:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940672 00000100:00100000:3.0:1782759530.386303:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941184 00000100:00100000:3.0:1782759530.386307:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941184 00000100:00100000:3.0:1782759530.386321:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940288 00000100:00100000:3.0:1782759530.386323:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940288 00000100:00100000:3.0:1782759530.386347:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940032 00000100:00100000:3.0:1782759530.386350:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940032 00000100:00100000:3.0:1782759530.386361:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940544 00000100:00100000:3.0:1782759530.386363:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940544 00000100:00100000:3.0:1782759530.386378:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941056 00000100:00100000:3.0:1782759530.386381:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941056 00000100:00100000:3.0:1782759530.386395:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5074 00000100:00100000:3.0:1782759530.386402:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232940672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.390600:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232940672:12345-0@lo:400:kworker.0 Request processed in 4167us (5410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.390617:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5074 00000100:00100000:3.0:1782759530.390668:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5075 00000100:00100000:3.0:1782759530.390692:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232941184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.390725:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232941184:12345-0@lo:400:kworker.0 Request processed in 50us (5519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.390731:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5075 00000100:00100000:3.0:1782759530.390743:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5076 00000100:00100000:3.0:1782759530.390751:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232940288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.390779:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232940288:12345-0@lo:400:kworker.0 Request processed in 30us (5521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.390808:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5076 00000100:00100000:3.0:1782759530.390820:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077 00000100:00100000:3.0:1782759530.390826:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232940032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.390866:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232940032:12345-0@lo:400:kworker.0 Request processed in 40us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.390872:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077 00000100:00100000:3.0:1782759530.390883:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078 00000100:00100000:3.0:1782759530.390889:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232940544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.390917:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232940544:12345-0@lo:400:kworker.0 Request processed in 29us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.390923:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078 00000100:00100000:3.0:1782759530.390935:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079 00000100:00100000:3.0:1782759530.390942:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232941056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.390971:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232941056:12345-0@lo:400:kworker.0 Request processed in 30us (4989us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.390977:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079 00000100:00100000:3.0:1782759530.391014:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232939904 00000100:00100000:3.0:1782759530.391023:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232939904 00000100:00100000:3.0:1782759530.391064:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232 00000100:00100000:3.0:1782759530.391071:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232939904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391102:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232939904:12345-0@lo:400:kworker.0 Request processed in 32us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.391109:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232 00000100:00100000:3.0:1782759530.391144:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940416 00000100:00100000:3.0:1782759530.391148:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940416 00000100:00100000:3.0:1782759530.391175:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:3.0:1782759530.391180:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232940416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391215:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232940416:12345-0@lo:400:kworker.0 Request processed in 35us (5095us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.391221:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:3.0:1782759530.391241:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940800 00000100:00100000:3.0:1782759530.391245:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940800 00000100:00100000:3.0:1782759530.391281:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941312 00000100:00100000:3.0:1782759530.391285:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941312 00000100:00100000:3.0:1782759530.391298:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232940928 00000100:00100000:3.0:1782759530.391301:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232940928 00000100:00100000:3.0:1782759530.391312:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941440 00000100:00100000:3.0:1782759530.391315:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941440 00000100:00100000:3.0:1782759530.391328:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:3.0:1782759530.391334:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232940800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391366:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232940800:12345-0@lo:400:kworker.0 Request processed in 32us (6066us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.391372:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:3.0:1782759530.391382:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:3.0:1782759530.391388:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232941312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391429:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232941312:12345-0@lo:400:kworker.0 Request processed in 40us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.391436:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:3.0:1782759530.391446:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1782759530.391452:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232940928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391479:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232940928:12345-0@lo:400:kworker.0 Request processed in 28us (5312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.391495:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:3.0:1782759530.391507:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1782759530.391512:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232941440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391542:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232941440:12345-0@lo:400:kworker.0 Request processed in 30us (5320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.391548:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00080000:3.0:1782759530.391565:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759530.391571:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759530.391574:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759530.391601:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759530.391644:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232939904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391660:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232940416:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391673:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232940928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391685:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232941440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391696:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232940032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391708:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232940544:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391718:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232941056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391857:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232940288:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391868:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967420 gen 2 00000004:00080000:3.0:1782759530.391874:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4434380, transno 4294967420 00000100:00100000:3.0:1782759530.391884:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232940800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391896:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232941312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391919:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232940672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759530.391932:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232941184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759530.394810:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232941568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759530.411563:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759530.417751:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941568 00000100:00100000:2.0:1782759530.417772:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941568 00000100:00100000:2.0:1782759530.417882:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1782759530.417897:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232941568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759530.417951:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759530.418141:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232941568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 245us (6585us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759530.418170:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:2.0:1782759530.418287:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232941568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759530.440841:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232940160:12345-0@lo:400:kworker.0 Request processed in 55284us (55762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759530.440861:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282 00000100:00100000:0.0:1782759530.441107:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232940160:0@lo:400:kworker.0 10000000:01000000:3.0:1782759530.573483:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759530.573492:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759530.573497:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759530.573541:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.573554:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.573564:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759530.573614:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232941696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759530.573680:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759530.573725:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c5ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759530.574322:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941696 00000100:00100000:0.0:1782759530.574330:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941696 00000100:00100000:0.0:1782759530.574394:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233 00000100:00100000:0.0:1782759530.574413:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232941696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759530.574429:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759530.574445:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ce8d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.574473:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.574484:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.574493:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759530.574539:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232941696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759530.574547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233 00000100:00100000:2.0:1782759530.577445:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232941696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759530.577472:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759530.577483:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759530.577504:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759530.577510:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759530.577517:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759530.596047:0:150662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8d3b3ed0 20000000:00000080:2.0:1782759530.596066:0:150662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd712000 uarg=0000000000000000 10000000:01000000:2.0:1782759530.596498:0:150662:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759530.596521:0:150662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759530.596541:0:150662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759530.596550:0:150662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759530.596678:0:150662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759530.596693:0:150662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 23 pid: 6526 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759530.596709:0:150662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150662:1869355232941824:0@lo:104: 00000100:00100000:2.0:1782759530.596770:0:150662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759530.596858:0:150662:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759530.597137:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941824 00000100:00100000:3.0:1782759530.597144:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941824 00000100:00100000:3.0:1782759530.597359:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1782759530.597369:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:150662:x1869355232941824:12345-0@lo:104: 00010000:00010000:3.0:1782759530.597381:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759530.597453:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759530.597460:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:150662:x1869355232941824:12345-0@lo:104: Request processed in 93us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759530.597467:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1782759530.597534:0:150662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150662:1869355232941824:0@lo:104: 00010000:00010000:0.0:1782759530.597561:0:150662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.597695:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759530.597704:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.597719:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759530.597723:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.597732:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759530.597741:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759530.597747:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759530.597784:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.597791:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759530.597813:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.597820:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60ce8d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ce94 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.597834:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759530.597836:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759530.597838:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759530.597849:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232941952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759530.597881:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759530.597923:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232941952 00000100:00100000:1.0:1782759530.597926:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232941952 00010000:00010000:1.0:1782759530.597946:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 24 pid: 6526 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759530.597977:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1782759530.597984:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232941952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759530.597995:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759530.598001:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 24 pid: 6526 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598012:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 24 pid: 6526 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598025:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60ce94 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ce8d expref: 24 pid: 6526 timeout: 3720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598038:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598046:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598059:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598067:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598074:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598081:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598097:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759530.598102:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598110:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598124:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598134:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759530.598163:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232941952:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759530.598170:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:1.0:1782759530.598218:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232941952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759530.598235:0:150662:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598243:0:150662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759530.598249:0:150662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60ce9b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759530.826733:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759530.891217:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232942080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759530.891302:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759530.891708:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942080 00000100:00100000:0.0:1782759530.891716:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942080 00000100:00100000:0.0:1782759530.891766:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:0.0:1782759530.891775:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232942080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759530.891801:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759530.891856:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232942080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759530.891864:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:1.0:1782759530.892363:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232942080:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1782759531.391652:0:150710:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef9a21c10 20000000:00000080:1.0:1782759531.391667:0:150710:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd4e9800 uarg=0000000000000000 10000000:01000000:1.0:1782759531.392084:0:150710:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759531.392105:0:150710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392121:0:150710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392132:0:150710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392139:0:150710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392146:0:150710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392153:0:150710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392160:0:150710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759531.392164:0:150710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392171:0:150710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392183:0:150710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392190:0:150710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759531.392213:0:150710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428c00/0xd5b45c7f5c60cea2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759531.424485:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232942208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759531.424611:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759531.427540:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942208 00000100:00100000:0.0:1782759531.427559:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942208 00000100:00100000:0.0:1782759531.427673:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:0.0:1782759531.427685:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232942208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759531.427738:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759531.427844:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232942208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759531.427853:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00100000:0.0:1782759531.427918:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232942208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759531.743614:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759531.743665:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759531.743704:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759531.743724:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540288 00000100:00100000:1.0:1782759531.743736:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759531.743737:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540288 00000100:00100000:1.0:1782759531.743760:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218539904 00000100:00100000:1.0:1782759531.743764:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218539904 00000100:00100000:3.0:1782759531.743811:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2929 00000100:00100000:1.0:1782759531.743811:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3234 00000100:00100000:3.0:1782759531.743823:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218540288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759531.743823:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218539904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759531.743929:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218540288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 108us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759531.743938:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2929 00000100:00080000:3.0:1782759531.743964:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759531.744053:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540032 00000100:00100000:0.0:1782759531.744058:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540032 00000100:00100000:0.0:1782759531.744104:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540160 00000100:00100000:0.0:1782759531.744107:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540160 00000100:00100000:0.0:1782759531.744129:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5080 00000100:00100000:0.0:1782759531.744136:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218540032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759531.744194:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5081 00000100:00100000:3.0:1782759531.744201:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218540160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759531.745225:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218539904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1397us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759531.745237:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3234 00000100:00080000:2.0:1782759531.745640:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759531.745647:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759531.748440:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218540032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 4279us (4817us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759531.748483:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5080 00000100:00100000:2.0:1782759531.757349:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218540160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 13117us (13580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759531.757375:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5081 00010000:00010000:0.0:1782759531.851753:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759531.916748:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232942336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759531.916855:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759531.916866:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232942464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759531.916956:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759531.925057:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942336 00000100:00100000:2.0:1782759531.925076:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942336 00000100:00100000:1.0:1782759531.925104:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942464 00000100:00100000:1.0:1782759531.925117:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942464 00000100:00100000:2.0:1782759531.925177:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1782759531.925195:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232942336:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759531.925205:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:1.0:1782759531.925219:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232942464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759531.925250:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00002000:00000024:1.0:1782759531.925257:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759531.943428:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232942464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 18204us (26469us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759531.943443:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:0.0:1782759531.944077:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232942464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759531.951160:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232942336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 25959us (34293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759531.951226:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:0.0:1782759531.954381:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232942336:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1782759532.110368:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759532.110379:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759532.110387:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759532.110473:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.110495:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.110509:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759532.110541:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232942592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759532.110663:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759532.110739:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc1095f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759532.110744:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942592 00000100:00100000:3.0:1782759532.110758:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942592 00000100:00100000:3.0:1782759532.110862:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3235 00000100:00100000:3.0:1782759532.110872:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232942592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759532.110887:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759532.110904:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cea9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759532.110929:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759532.110939:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759532.110949:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759532.111029:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232942592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759532.111047:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3235 00000100:00100000:0.0:1782759532.115137:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232942592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759532.115173:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.115200:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759532.115236:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759532.115243:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.115252:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1782759532.442484:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:2.0:1782759532.442494:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cded3bdc800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:0.0:1782759532.442551:0:1371:0:(genops.c:865:class_export_destroy()) destroying export ffff8cded3bdc800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:0.0:1782759532.442712:0:1371:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cded3bdd000 for lustre-OST0001 00000020:00000080:1.0:1782759532.449562:0:150758:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde6c599f0 20000000:00000080:1.0:1782759532.449607:0:150758:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd4ea800 uarg=0000000000000000 10000000:01000000:1.0:1782759532.449825:0:150758:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759532.449846:0:150758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759532.449863:0:150758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759532.449871:0:150758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759532.449910:0:150758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759532.449924:0:150758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 23 pid: 6525 timeout: 3722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759532.449939:0:150758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150758:1869355232942720:0@lo:104: 00000100:00100000:1.0:1782759532.450049:0:150758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759532.450186:0:150758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d08f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759532.450234:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942720 00000100:00100000:3.0:1782759532.450241:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942720 00000100:00100000:3.0:1782759532.450282:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1782759532.450291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:150758:x1869355232942720:12345-0@lo:104: 00010000:00010000:3.0:1782759532.450303:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759532.450405:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759532.450411:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:150758:x1869355232942720:12345-0@lo:104: Request processed in 122us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759532.450418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1782759532.450475:0:150758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:150758:1869355232942720:0@lo:104: 00010000:00010000:1.0:1782759532.450493:0:150758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.451191:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759532.451200:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.451210:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759532.451214:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.451224:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759532.451232:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759532.451252:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759532.451295:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.451301:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759532.451353:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232942848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759532.451403:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782759532.451504:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.451512:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60cea9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ceb0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759532.451527:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759532.451529:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759532.451531:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759532.451857:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942848 00000100:00100000:0.0:1782759532.451863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942848 00010000:00010000:0.0:1782759532.451885:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 24 pid: 6525 timeout: 3722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759532.451913:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:0.0:1782759532.451919:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5714850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232942848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759532.451934:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759532.451938:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 24 pid: 6525 timeout: 3722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451945:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 24 pid: 6525 timeout: 3722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451954:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60ceb0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cea9 expref: 24 pid: 6525 timeout: 3722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451964:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451969:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451978:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451982:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451987:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451991:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.451994:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759532.451997:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.452009:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.452039:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759532.452048:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759532.452162:0:150758:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759532.452169:0:150758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759532.452174:0:150758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60ceb7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759532.454486:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5714850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232942848:12345-0@lo:103:ldlm_bl.0 Request processed in 2558us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759532.454501:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00100000:3.0:1782759532.457877:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232942848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759532.877721:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759533.300547:0:150806:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc77003920 20000000:00000080:0.0:1782759533.300564:0:150806:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12e9c00 uarg=0000000000000000 00010000:00010000:0.0:1782759533.300835:0:150806:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759533.300870:0:150806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:0.0:1782759533.300874:0:150806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759533.300886:0:150806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ccfe lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27417 expref: 5 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.300908:0:150806:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759533.300935:0:150806:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1782759533.300954:0:150806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:0.0:1782759533.300957:0:150806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759533.300962:0:150806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60cda6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2744f expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.300978:0:150806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:0.0:1782759533.300981:0:150806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759533.300993:0:150806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ce63 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27487 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301013:0:150806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdecd4e3a00) 00010000:00010000:0.0:1782759533.301015:0:150806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759533.301020:0:150806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60ce39 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27479 expref: 5 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301043:0:150806:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 3 locks, left on hash table 0. 10000000:01000000:0.0:1782759533.301252:0:150806:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759533.301269:0:150806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301283:0:150806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301293:0:150806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301300:0:150806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301362:0:150806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301369:0:150806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301376:0:150806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759533.301391:0:150806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301408:0:150806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301418:0:150806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301425:0:150806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759533.301431:0:150806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc000/0xd5b45c7f5c60cebe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 150806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759533.902560:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759534.155923:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759534.155931:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759534.155936:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759534.155980:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759534.155993:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759534.156004:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759534.156029:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232942976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759534.156094:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759534.156149:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f71900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759534.156290:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232942976 00000100:00100000:3.0:1782759534.156298:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232942976 00000100:00100000:3.0:1782759534.156354:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3236 00000100:00100000:3.0:1782759534.156363:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232942976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759534.156387:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759534.156401:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cec5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759534.156424:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759534.156435:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759534.156450:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:3.0:1782759534.156489:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232942976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759534.156496:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3236 00000100:00100000:2.0:1782759534.156859:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232942976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759534.156874:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759534.156884:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759534.156904:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759534.156909:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759534.156918:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759534.474742:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759534.474773:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232943104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759534.474861:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759534.475029:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943104 00000100:00100000:0.0:1782759534.475038:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943104 00000100:00100000:0.0:1782759534.475117:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3285 00000100:00100000:0.0:1782759534.475126:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232943104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759534.475169:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:0.0:1782759534.475230:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232943104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759534.475238:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3285 00000100:00100000:1.0:1782759534.475358:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232943104:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759534.929284:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759535.515380:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232943232:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515465:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515515:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232943744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515543:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515561:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232944256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515604:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515632:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232944768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515656:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515680:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782759535.515686:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232943616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515711:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515729:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232944128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515749:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515766:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232944640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515787:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515816:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232943360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515840:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515862:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232943872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515883:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515899:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232944384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.515918:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.515935:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759535.516735:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232943488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.516786:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.516807:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232944000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.516831:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.516847:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232944512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.516866:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.516901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943232 00000100:00100000:0.0:1782759535.516908:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943232 00000100:00100000:3.0:1782759535.517827:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943616 00000100:00100000:3.0:1782759535.517833:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943616 00000100:00100000:3.0:1782759535.517861:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943360 00000100:00100000:3.0:1782759535.517864:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943360 00000100:00100000:3.0:1782759535.517875:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943872 00000100:00100000:3.0:1782759535.517878:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943872 00000100:00100000:3.0:1782759535.517901:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944384 00000100:00100000:3.0:1782759535.517905:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944384 00000100:00100000:3.0:1782759535.517917:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944000 00000100:00100000:3.0:1782759535.517919:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944000 00000100:00100000:3.0:1782759535.517931:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944512 00000100:00100000:3.0:1782759535.517933:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944512 00000100:00100000:0.0:1782759535.518040:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:0.0:1782759535.518058:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232943232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.518121:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232943232:12345-0@lo:400:kworker.0 Request processed in 65us (2656us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.518128:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00100000:0.0:1782759535.518164:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943744 00000100:00100000:0.0:1782759535.518168:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943744 00000100:00100000:0.0:1782759535.518205:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232943488 00000100:00100000:0.0:1782759535.518208:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232943488 00000100:00100000:0.0:1782759535.518222:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:3.0:1782759535.518259:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5082 00000100:00100000:3.0:1782759535.518266:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232943616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759535.518406:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232943616:12345-0@lo:400:kworker.0 Request processed in 139us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759535.518451:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5082 00000100:00100000:3.0:1782759535.518466:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5083 00000100:00100000:3.0:1782759535.518472:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232943360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759535.518509:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232943360:12345-0@lo:400:kworker.0 Request processed in 37us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759535.518515:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5083 00000100:00100000:3.0:1782759535.518527:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5084 00000100:00100000:3.0:1782759535.518540:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232943872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759535.518571:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232943872:12345-0@lo:400:kworker.0 Request processed in 32us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759535.518595:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5084 00000100:00100000:3.0:1782759535.518608:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5085 00000100:00100000:3.0:1782759535.518614:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232944384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759535.518642:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232944384:12345-0@lo:400:kworker.0 Request processed in 28us (2723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759535.518647:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5085 00000100:00100000:3.0:1782759535.518659:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5086 00000100:00100000:3.0:1782759535.518665:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232944000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759535.518692:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232944000:12345-0@lo:400:kworker.0 Request processed in 28us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759535.518698:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5086 00000100:00100000:3.0:1782759535.518709:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5087 00000100:00100000:3.0:1782759535.518715:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232944512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759535.518742:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232944512:12345-0@lo:400:kworker.0 Request processed in 28us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759535.518748:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5087 00000100:00080000:3.0:1782759535.518765:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759535.518768:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759535.520504:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232943744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.520573:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232943744:12345-0@lo:400:kworker.0 Request processed in 87us (5027us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.520596:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00000100:00100000:0.0:1782759535.520624:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1782759535.520631:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232943488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.520663:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232943488:12345-0@lo:400:kworker.0 Request processed in 33us (3877us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.520669:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:0.0:1782759535.520695:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944256 00000100:00100000:0.0:1782759535.520702:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944256 00000100:00100000:0.0:1782759535.520748:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944768 00000100:00100000:0.0:1782759535.520752:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944768 00000100:00100000:0.0:1782759535.520764:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944128 00000100:00100000:0.0:1782759535.520767:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944128 00000100:00100000:0.0:1782759535.520779:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944640 00000100:00100000:0.0:1782759535.520782:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944640 00000100:00100000:0.0:1782759535.520796:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:0.0:1782759535.520802:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232944256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.520850:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232944256:12345-0@lo:400:kworker.0 Request processed in 48us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.520857:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:0.0:1782759535.520869:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:0.0:1782759535.520874:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232944768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.520902:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232944768:12345-0@lo:400:kworker.0 Request processed in 28us (5245us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.520908:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:0.0:1782759535.520919:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:0.0:1782759535.520924:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232944128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.522725:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:1.0:1782759535.522739:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232944640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.522834:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232944640:12345-0@lo:400:kworker.0 Request processed in 100us (7045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759535.522842:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:0.0:1782759535.522894:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232944128:12345-0@lo:400:kworker.0 Request processed in 1968us (7142us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.522901:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00080000:0.0:1782759535.522932:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759535.522936:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759535.522998:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759535.523014:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232944896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759535.523052:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759535.523088:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232944896 00000100:00100000:0.0:1782759535.523094:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232944896 00000100:00100000:0.0:1782759535.523124:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1782759535.523129:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232944896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759535.523149:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759535.523184:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232944896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759535.523190:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1782759535.524528:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232943616:0@lo:400:kworker.0 00000100:00100000:2.0:1782759535.524563:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232944128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759535.524598:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232944640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759535.524618:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232943232:0@lo:400:kworker.0 00000100:00100000:2.0:1782759535.524642:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232943744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759535.524655:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232944896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759535.524668:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232943488:0@lo:400:kworker.0 00000100:00100000:2.0:1782759535.524670:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232944256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759535.524697:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232944768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.524708:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232944000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.524730:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232944512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.524757:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232943360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.524774:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232943872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759535.524787:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232944384:0@lo:400:kworker.0 00010000:00010000:2.0:1782759535.946855:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759536.012563:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759536.015400:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232945024:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759536.015528:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759536.017411:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945024 00000100:00100000:1.0:1782759536.017421:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945024 00000100:00100000:1.0:1782759536.018098:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1782759536.018110:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232945024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759536.018134:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759536.018208:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232945024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759536.018222:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:2.0:1782759536.018299:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232945024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759536.522850:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232945152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759536.522930:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759536.523111:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945152 00000100:00100000:0.0:1782759536.523119:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945152 00000100:00100000:0.0:1782759536.523184:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:0.0:1782759536.523194:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232945152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759536.523230:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759536.523287:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232945152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759536.523295:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:2.0:1782759536.523384:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232945152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759536.862949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759536.863060:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759536.863097:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759536.863155:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540416 00000100:00100000:2.0:1782759536.863165:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540416 00000100:00100000:2.0:1782759536.863226:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3238 00000100:00100000:2.0:1782759536.863237:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218540416:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759536.863309:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218540416:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 74us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759536.863317:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3238 00000100:00100000:1.0:1782759536.863608:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759536.863800:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540800 00000100:00100000:2.0:1782759536.863804:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540800 00000100:00100000:2.0:1782759536.863850:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2934 00000100:00100000:2.0:1782759536.863858:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218540800:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759536.863892:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218540800:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759536.863898:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2934 00000100:00080000:1.0:1782759536.863967:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759536.872153:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540672 00000100:00100000:0.0:1782759536.872167:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540672 00000100:00080000:1.0:1782759536.873331:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759536.873552:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540544 00000100:00100000:1.0:1782759536.873558:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540544 00000100:00100000:1.0:1782759536.873629:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5088 00000100:00100000:1.0:1782759536.873641:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218540672:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759536.873742:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218540672:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 103us (10681us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759536.873749:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5088 00000100:00100000:1.0:1782759536.873769:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5089 00000100:00100000:1.0:1782759536.873776:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218540544:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759536.873803:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218540544:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (10706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759536.873809:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5089 00000100:00080000:0.0:1782759536.874757:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759536.970780:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759537.034941:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759537.034964:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232945408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759537.035088:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232945280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759537.035145:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759537.035216:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945408 00000100:00100000:0.0:1782759537.035245:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945408 00000100:00080000:2.0:1782759537.035286:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759537.035340:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:0.0:1782759537.035360:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232945408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759537.035391:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759537.035440:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232945408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759537.035447:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1782759537.035501:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232945408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759537.035513:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759537.035571:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945280 00000100:00100000:3.0:1782759537.035599:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945280 00000100:00100000:3.0:1782759537.035639:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:3.0:1782759537.035647:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232945280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759537.035657:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759537.035693:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5646680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232945280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00080000:2.0:1782759537.035698:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759537.035699:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:0.0:1782759537.035858:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232945280:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1782759537.995836:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759539.024009:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759539.323459:0:151002:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffffb8a69c0 20000000:00000080:2.0:1782759539.323505:0:151002:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3516c00 uarg=0000000000000000 00010000:00010000:2.0:1782759539.323988:0:151002:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759539.324007:0:151002:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759539.324030:0:151002:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759539.324041:0:151002:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759539.324060:0:151002:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759539.324082:0:151002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.324105:0:151002:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.324115:0:151002:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.324168:0:151002:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.324185:0:151002:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 23 pid: 6526 timeout: 3729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759539.324201:0:151002:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151002:1869355232945536:0@lo:104: 00000100:00100000:2.0:1782759539.325907:0:151002:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759539.326026:0:151002:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded234f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759539.327004:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945536 00000100:00100000:3.0:1782759539.327016:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945536 00000100:00100000:3.0:1782759539.327091:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1782759539.327102:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:151002:x1869355232945536:12345-0@lo:104: 00010000:00010000:3.0:1782759539.327122:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759539.327210:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759539.327216:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:151002:x1869355232945536:12345-0@lo:104: Request processed in 116us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759539.327222:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1782759539.329452:0:151002:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151002:1869355232945536:0@lo:104: 00010000:00010000:2.0:1782759539.329508:0:151002:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.340064:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759539.340085:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.340132:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759539.340138:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.340151:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759539.340159:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759539.340166:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759539.340246:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.340254:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759539.340300:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.340309:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649c00/0xd5b45c7f5c60cec5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cecc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.340347:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759539.340350:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759539.340351:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759539.340395:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759539.340425:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232945664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759539.340530:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759539.341844:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945664 00000100:00100000:1.0:1782759539.341856:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945664 00010000:00010000:1.0:1782759539.341900:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 24 pid: 6526 timeout: 3729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759539.341940:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:1.0:1782759539.341962:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232945664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759539.341978:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759539.341985:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 24 pid: 6526 timeout: 3729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.341997:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 24 pid: 6526 timeout: 3729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342015:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60cecc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cec5 expref: 24 pid: 6526 timeout: 3729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342033:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342042:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342062:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342071:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342079:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342086:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342093:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759539.342097:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342112:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342134:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759539.342147:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759539.342279:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232945664:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759539.342288:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00010000:00010000:2.0:1782759539.343904:0:151002:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.343940:0:151002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759539.343947:0:151002:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60ced3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151002 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759539.410848:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5644a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232945664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759539.594854:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232945792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759539.594952:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759539.595073:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945792 00000100:00100000:1.0:1782759539.595083:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945792 00000100:00100000:1.0:1782759539.595169:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:1.0:1782759539.595181:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232945792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759539.595230:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759539.595287:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232945792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759539.595295:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:2.0:1782759539.595387:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5644380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232945792:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759540.043512:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759540.618878:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759540.618899:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232945920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759540.619034:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759540.619119:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232945920 00000100:00100000:1.0:1782759540.619127:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232945920 00000100:00100000:0.0:1782759540.619219:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232946432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.619292:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759540.619360:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:1.0:1782759540.619371:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232945920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759540.619399:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759540.619438:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232945920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759540.619451:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00080000:1.0:1782759540.619472:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759540.619485:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232946304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759540.619509:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759540.619604:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232946048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.619640:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759540.627934:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232946176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759540.628045:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759540.628154:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232946944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.628363:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759540.628432:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232947456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.628457:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759540.628500:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946432 00000100:00100000:0.0:1782759540.628507:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946432 00000100:00100000:0.0:1782759540.628555:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946176 00000100:00100000:0.0:1782759540.628559:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946176 00000100:00100000:0.0:1782759540.628601:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5090 00000100:00100000:0.0:1782759540.628610:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232946432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.628665:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232946432:12345-0@lo:400:kworker.0 Request processed in 56us (9373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.628672:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5090 00000100:00100000:0.0:1782759540.628691:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5091 00000100:00100000:0.0:1782759540.628697:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232946176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.628724:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232946176:12345-0@lo:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.628730:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5091 00000100:00100000:0.0:1782759540.628754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946048 00000100:00100000:0.0:1782759540.628759:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946048 00000100:00100000:0.0:1782759540.628786:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00100000:0.0:1782759540.628792:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232946048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.628822:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232946048:12345-0@lo:400:kworker.0 Request processed in 30us (9181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.628828:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:0.0:1782759540.628870:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946944 00000100:00100000:0.0:1782759540.628873:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946944 00000100:00100000:0.0:1782759540.628907:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947456 00000100:00100000:0.0:1782759540.628910:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947456 00000100:00100000:0.0:1782759540.629228:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1782759540.629236:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232946944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.629291:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232946944:12345-0@lo:400:kworker.0 Request processed in 56us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.629297:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00100000:0.0:1782759540.629310:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:0.0:1782759540.629317:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232947456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.629392:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232947456:12345-0@lo:400:kworker.0 Request processed in 55us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.629412:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000100:00080000:0.0:1782759540.629470:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759540.629474:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759540.629532:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232947456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.629564:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232946432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.629594:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232946944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.629644:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946304 00000100:00100000:0.0:1782759540.629649:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946304 00000100:00100000:0.0:1782759540.629687:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:0.0:1782759540.629694:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232946304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.629731:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232946304:12345-0@lo:400:kworker.0 Request processed in 37us (10220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.629737:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:1.0:1782759540.632847:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232946304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759540.632864:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232946816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759540.633050:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759540.633101:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232947328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759540.633131:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759540.633134:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946816 00000100:00100000:0.0:1782759540.633149:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946816 00000100:00100000:0.0:1782759540.633227:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947328 00000100:00100000:0.0:1782759540.633231:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947328 00000100:00100000:0.0:1782759540.633268:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5092 00000100:00100000:0.0:1782759540.633279:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232946816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.633360:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232946048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.633369:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232946560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.633406:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232946816:12345-0@lo:400:kworker.0 Request processed in 126us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.633419:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5092 00000100:00100000:3.0:1782759540.633421:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759540.633451:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5093 00000100:00100000:3.0:1782759540.633457:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232947072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.633462:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232947328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.633512:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232947328:12345-0@lo:400:kworker.0 Request processed in 53us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.633525:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5093 00000100:00100000:3.0:1782759540.633526:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759540.633560:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759540.633643:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947072 00000100:00100000:0.0:1782759540.633649:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947072 00000100:00100000:3.0:1782759540.633674:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946560 00000100:00100000:3.0:1782759540.633682:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946560 00000100:00100000:0.0:1782759540.633699:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:0.0:1782759540.633710:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232947072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.633749:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:3.0:1782759540.633761:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232946560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759540.633769:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232947072:12345-0@lo:400:kworker.0 Request processed in 59us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759540.633778:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00080000:0.0:1782759540.633799:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759540.633825:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232946560:12345-0@lo:400:kworker.0 Request processed in 65us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759540.633835:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:3.0:1782759540.633869:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232946560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.633881:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232947072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759540.634327:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5646300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232945920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759540.634365:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232946816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759540.634376:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232947328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759540.635479:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232946176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759540.635494:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232946688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759540.635735:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759540.635766:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232947200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759540.635796:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759540.635941:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232946688 00000100:00100000:3.0:1782759540.635948:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232946688 00000100:00100000:3.0:1782759540.636024:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947200 00000100:00100000:3.0:1782759540.636027:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947200 00000100:00100000:3.0:1782759540.636051:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5094 00000100:00100000:3.0:1782759540.636060:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232946688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.636113:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232946688:12345-0@lo:400:kworker.0 Request processed in 53us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759540.636120:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5094 00000100:00100000:3.0:1782759540.636140:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5095 00000100:00100000:3.0:1782759540.636147:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232947200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759540.636174:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232947200:12345-0@lo:400:kworker.0 Request processed in 28us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759540.636179:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5095 00000100:00100000:2.0:1782759540.636266:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232946688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759540.636276:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232947200:0@lo:400:kworker.0 00000100:00080000:1.0:1782759540.636420:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759541.067542:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759541.071598:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759541.071605:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759541.071610:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759541.071654:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759541.071678:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759541.071688:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759541.071714:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232947584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759541.071779:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759541.072369:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759541.076368:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947584 00000100:00100000:1.0:1782759541.076395:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947584 00000100:00100000:0.0:1782759541.076637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:0.0:1782759541.076650:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232947584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759541.076667:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759541.076686:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ceda expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759541.076714:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759541.076724:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759541.076734:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dce00, rc 0) 00000100:00100000:0.0:1782759541.076815:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232947584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (5035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759541.076822:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00100000:3.0:1782759541.076919:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232947584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759541.076950:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.076960:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759541.076981:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759541.076988:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759541.076996:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759541.130840:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759541.130862:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232947712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759541.130932:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759541.131020:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947712 00000100:00100000:0.0:1782759541.131028:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947712 00000100:00100000:0.0:1782759541.131092:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1782759541.131101:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232947712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759541.131125:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759541.131167:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232947712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759541.131174:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:2.0:1782759541.131247:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232947712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759541.643716:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759541.643747:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232947840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759541.643817:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759541.643882:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947840 00000100:00100000:2.0:1782759541.643889:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947840 00000100:00100000:2.0:1782759541.643958:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3292 00000100:00100000:2.0:1782759541.643967:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232947840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759541.644001:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1782759541.644045:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232947840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759541.644052:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3292 00000100:00100000:2.0:1782759541.644096:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232947840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759541.989156:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759541.989201:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759541.989236:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759541.989269:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759541.989299:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541056 00000100:00100000:1.0:1782759541.989319:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541056 00000100:00100000:0.0:1782759541.989361:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541312 00000100:00100000:0.0:1782759541.989367:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541312 00000100:00100000:1.0:1782759541.989389:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541184 00000100:00100000:1.0:1782759541.989394:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541184 00000100:00100000:2.0:1782759541.989421:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5096 00000100:00100000:0.0:1782759541.989422:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2938 00000100:00100000:1.0:1782759541.989431:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5097 00000100:00100000:2.0:1782759541.989439:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218541056:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759541.989439:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218541312:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759541.989505:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218541184:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759541.989514:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218541056:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759541.989522:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5096 00000100:00100000:3.0:1782759541.989526:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218540928 00000100:00100000:3.0:1782759541.989531:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218540928 00000100:00100000:3.0:1782759541.989571:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3241 00000100:00100000:3.0:1782759541.989687:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218540928:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759541.991365:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218541312:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1927us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759541.991376:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2938 00000100:00080000:0.0:1782759541.996642:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759541.996650:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759541.996653:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759542.003779:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218541184:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 14083us (14252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759542.003795:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5097 00000100:00100000:3.0:1782759542.013789:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218540928:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24196us (24626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759542.013806:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3241 00010000:00010000:1.0:1782759542.090755:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759542.155768:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759542.155801:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232947968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759542.155993:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759542.156010:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232948096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759542.156095:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759542.156195:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948096 00000100:00100000:2.0:1782759542.156202:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948096 00000100:00100000:2.0:1782759542.156282:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:2.0:1782759542.156320:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232948096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759542.156367:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759542.156451:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232948096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759542.156489:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00080000:2.0:1782759542.156517:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759542.156573:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232948096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759542.157387:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759542.157532:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232947968 00000100:00100000:1.0:1782759542.157538:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232947968 00000100:00100000:1.0:1782759542.157641:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1782759542.157649:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232947968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759542.157672:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759542.157728:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232947968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759542.157737:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1782759542.157800:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232947968:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782759542.157895:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759543.114870:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759544.140899:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759544.718070:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232948224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759544.718272:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759544.718518:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948224 00000100:00100000:0.0:1782759544.718526:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948224 00000100:00100000:0.0:1782759544.718677:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293 00000100:00100000:0.0:1782759544.718686:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232948224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759544.718735:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:0.0:1782759544.725300:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232948224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6596us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759544.725351:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293 00000100:00100000:3.0:1782759544.729653:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232948224:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759545.179969:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759545.738785:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759545.738815:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232948352:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.738910:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.739004:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232948480:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739037:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.739079:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948480 00000100:00100000:2.0:1782759545.739089:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948480 00000100:00100000:2.0:1782759545.739164:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5098 00000100:00100000:2.0:1782759545.739176:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232948480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739243:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232948480:12345-0@lo:400:kworker.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.739251:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5098 00000100:00100000:2.0:1782759545.739338:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232948480:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739376:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759545.739381:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232948608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739409:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.739435:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948608 00000100:00100000:2.0:1782759545.739438:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948608 00000100:00100000:2.0:1782759545.739487:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294 00000100:00100000:2.0:1782759545.739496:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232948608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739535:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232948608:12345-0@lo:400:kworker.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.739558:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00100000:2.0:1782759545.739611:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232948608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739645:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232948736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739669:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.739696:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948736 00000100:00100000:2.0:1782759545.739699:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948736 00000100:00100000:2.0:1782759545.739727:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5099 00000100:00100000:2.0:1782759545.739735:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739770:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232948736:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.739776:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5099 00000100:00100000:2.0:1782759545.739803:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232948736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739830:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759545.739838:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232948864:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739862:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.739886:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948864 00000100:00100000:2.0:1782759545.739889:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948864 00000100:00100000:2.0:1782759545.739917:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:2.0:1782759545.739924:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232948864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.739958:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232948864:12345-0@lo:400:kworker.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.739964:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:2.0:1782759545.739987:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232948864:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.740015:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232948992:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.740047:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.740076:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948992 00000100:00100000:2.0:1782759545.740080:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948992 00000100:00100000:2.0:1782759545.740115:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5100 00000100:00100000:2.0:1782759545.740122:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232948992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.740155:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232948992:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.740162:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5100 00000100:00080000:2.0:1782759545.740178:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759545.740197:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232948992:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.740221:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759545.740228:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232949120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.740250:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.740271:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949120 00000100:00100000:2.0:1782759545.740274:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949120 00000100:00100000:0.0:1782759545.740644:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232948352 00000100:00100000:0.0:1782759545.740650:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232948352 00000100:00100000:0.0:1782759545.740686:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3242 00000100:00100000:0.0:1782759545.740693:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232948352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759545.740738:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232948352:12345-0@lo:400:kworker.0 Request processed in 46us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759545.740745:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3242 00000100:00100000:2.0:1782759545.741447:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5101 00000100:00100000:2.0:1782759545.741459:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232949120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.741502:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232949120:12345-0@lo:400:kworker.0 Request processed in 48us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.741508:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5101 00000100:00100000:2.0:1782759545.741543:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232948352:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.741570:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232949120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.741630:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232949248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.741660:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.741693:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949248 00000100:00100000:2.0:1782759545.741708:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949248 00000100:00080000:0.0:1782759545.743478:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759545.743486:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759545.743502:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232949376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759545.743568:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759545.744346:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232949888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759545.744382:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759545.746657:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232949760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759545.750473:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355232949632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759545.750548:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759545.750590:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759545.750597:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232949504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759545.750623:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.750706:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949376 00000100:00100000:2.0:1782759545.750718:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949376 00000100:00100000:2.0:1782759545.750739:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949632 00000100:00100000:2.0:1782759545.750742:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949632 00000100:00100000:2.0:1782759545.750819:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949504 00000100:00100000:2.0:1782759545.750822:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949504 00000100:00100000:2.0:1782759545.750850:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5102 00000100:00100000:2.0:1782759545.750862:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355232949632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.750932:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355232949632:12345-0@lo:400:kworker.0 Request processed in 72us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.750940:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5102 00000100:00100000:2.0:1782759545.750960:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5103 00000100:00100000:2.0:1782759545.750968:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232949504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.750996:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232949504:12345-0@lo:400:kworker.0 Request processed in 30us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.751002:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5103 00000100:00100000:2.0:1782759545.751045:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232949504:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.751056:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355232949632:0@lo:400:kworker.0 00000100:00080000:2.0:1782759545.751091:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759545.751096:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759545.751125:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759545.751153:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949888 00000100:00100000:2.0:1782759545.751157:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949888 00000100:00100000:2.0:1782759545.751178:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1782759545.751187:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232949248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.751226:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232949248:12345-0@lo:400:kworker.0 Request processed in 42us (9566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.751251:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00100000:2.0:1782759545.751264:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:2.0:1782759545.751271:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232949376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.751351:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232949376:12345-0@lo:400:kworker.0 Request processed in 81us (7782us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.751357:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:2.0:1782759545.751617:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:2.0:1782759545.751626:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232949888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.751658:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232949888:12345-0@lo:400:kworker.0 Request processed in 34us (7276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.751665:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:2.0:1782759545.751695:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232949376:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.751706:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232949888:0@lo:400:kworker.0 00000100:00080000:2.0:1782759545.751723:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759545.753405:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759545.753498:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232949248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.753631:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232949760 00000100:00100000:2.0:1782759545.753638:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232949760 00000100:00100000:2.0:1782759545.753707:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1782759545.753718:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232949760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759545.753795:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232949760:12345-0@lo:400:kworker.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.753803:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1782759545.753832:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232949760:0@lo:400:kworker.0 00000100:00080000:3.0:1782759545.753900:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759545.966208:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759545.966239:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232950016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759545.966381:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759545.966446:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950016 00000100:00100000:2.0:1782759545.966455:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950016 00000100:00100000:2.0:1782759545.966522:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2640 00000100:00100000:2.0:1782759545.966534:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232950016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759545.967163:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759545.967297:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232950016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 760us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759545.967309:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2640 00000100:00100000:0.0:1782759545.967598:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232950016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759546.251024:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759546.251047:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232950144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759546.251119:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759546.251183:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950144 00000100:00100000:0.0:1782759546.251190:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950144 00000100:00100000:0.0:1782759546.251254:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1782759546.251262:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232950144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759546.251301:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759546.251350:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232950144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759546.251357:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2641 00000100:00100000:0.0:1782759546.251402:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232950144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759546.618565:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759547.059867:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759547.059899:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232950272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759547.060002:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759547.060129:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950272 00000100:00100000:2.0:1782759547.060142:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950272 00000100:00100000:2.0:1782759547.060367:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:2.0:1782759547.060381:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232950272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759547.060430:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1782759547.060491:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232950272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759547.060498:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:1.0:1782759547.066923:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232950272:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759547.117927:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759547.117978:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759547.118017:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759547.118044:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541696 00000100:00100000:0.0:1782759547.118057:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541696 00000100:00100000:0.0:1782759547.118131:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541568 00000100:00100000:0.0:1782759547.118135:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541568 00000100:00100000:0.0:1782759547.118164:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5104 00000100:00100000:0.0:1782759547.118175:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218541696:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759547.118350:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218541696:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 175us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759547.118359:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5104 00000100:00100000:0.0:1782759547.118380:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5105 00000100:00100000:0.0:1782759547.118386:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218541568:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759547.118413:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218541568:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759547.118419:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5105 00000100:00100000:0.0:1782759547.118472:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759547.118637:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541824 00000100:00100000:0.0:1782759547.118651:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541824 00000100:00100000:0.0:1782759547.118689:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2943 00000100:00100000:0.0:1782759547.118696:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218541824:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:1.0:1782759547.118876:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759547.118883:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759547.118885:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759547.120437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218541440 00000100:00100000:3.0:1782759547.120449:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218541440 00000100:00100000:3.0:1782759547.120512:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3243 00000100:00100000:3.0:1782759547.120519:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218541440:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759547.120725:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218541824:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2017us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759547.120735:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2943 00000100:00100000:3.0:1782759547.130597:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218541440:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 10050us (12657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759547.130616:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3243 00000100:00100000:3.0:1782759547.275982:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759547.276010:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232950400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759547.276084:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759547.276458:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950400 00000100:00100000:0.0:1782759547.276467:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950400 00000100:00100000:0.0:1782759547.276567:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00080000:1.0:1782759547.276622:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759547.276641:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232950400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759547.276677:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759547.276727:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232950400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759547.276734:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1782759547.277015:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232950400:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759547.277034:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759547.277106:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759547.277161:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950528 00000100:00100000:0.0:1782759547.277256:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950528 00000100:00100000:0.0:1782759547.277364:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1782759547.277373:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232950528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759547.277385:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759547.277423:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232950528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759547.277430:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1782759547.277467:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232950528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759547.279726:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759547.661338:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759548.687692:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759549.716565:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759549.845104:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759549.845141:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232950656:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759549.845262:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759549.845370:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950656 00000100:00100000:1.0:1782759549.845381:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950656 00000100:00100000:1.0:1782759549.845465:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:1.0:1782759549.845476:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232950656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759549.845522:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759549.845604:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232950656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759549.845612:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:1.0:1782759549.845673:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5645c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232950656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759550.264145:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759550.265902:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218542080 00000100:00100000:2.0:1782759550.265920:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218542080 00000100:00100000:2.0:1782759550.266030:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2951 00000100:00100000:2.0:1782759550.266052:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109743:x1869355218542080:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:2.0:1782759550.266088:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759550.266092:0:42628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782759550.266097:0:42628:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60ce39) 00010000:00010000:2.0:1782759550.266100:0:42628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759550.266133:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cee8 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2748e expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.268680:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.268705:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.268721:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.268941:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.268966:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.268980:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759550.269039:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00010000:00010000:2.0:1782759550.269059:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269067:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269074:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269081:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269103:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759550.269108:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269117:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269130:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34fd900) 00010000:00010000:2.0:1782759550.269132:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759550.269137:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269144:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ceef lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269160:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269167:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269173:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269177:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759550.269179:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269183:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269213:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xe065f617 (ffff8cddc34fd700) 00010000:00010000:2.0:1782759550.269216:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759550.269219:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269226:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cef6 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269393:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cee8 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2748e expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269405:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34fd900) 00010000:00010000:2.0:1782759550.269408:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759550.269411:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60cee8 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2748e expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.269424:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759550.269504:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109743:x1869355218542080:12345-192.168.202.31@tcp:101:touch.500 Request processed in 3463us (5372us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759550.269514:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2951 00000100:00080000:1.0:1782759550.270894:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759550.275490:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759550.276205:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218542336 00000100:00100000:0.0:1782759550.276253:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218542336 00000100:00100000:0.0:1782759550.276347:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2952 00000100:00100000:0.0:1782759550.276362:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109743:x1869355218542336:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:0.0:1782759550.276391:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759550.276424:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cefd lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27495 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.276637:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.276656:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.276671:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.276687:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.276711:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.276720:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759550.277519:0:8593:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x16:0x0], index 1: 0 00010000:00010000:0.0:1782759550.278171:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf12 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.278190:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf12 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.278221:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf12 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279117:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279131:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279138:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279146:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279152:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759550.279157:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279165:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279182:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759550.279186:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759550.279193:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279200:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf04 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759550.279216:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf3830dd reply state 00000000d136e8b1 transno 4294967714 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279252:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279259:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xe065f617 (ffff8cddc3502700) 00010000:00010000:0.0:1782759550.279262:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759550.279266:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759550.279320:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cefd lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27495 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279343:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf12 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27495 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.279351:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc3502f00) 00010000:00010000:0.0:1782759550.279353:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759550.279356:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4ddc00, rc 0) 00000100:00100000:0.0:1782759550.279458:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109743:x1869355218542336:12345-192.168.202.31@tcp:101:touch.500 Request processed in 3099us (3976us total) trans 4294967714 rc 0/0 00000100:00100000:0.0:1782759550.279470:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2952 00000100:00100000:2.0:1782759550.282842:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759550.283353:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218542592 00000100:00100000:0.0:1782759550.283369:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218542592 00000100:00100000:0.0:1782759550.283451:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2953 00000100:00100000:0.0:1782759550.283464:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109743:x1869355218542592:12345-192.168.202.31@tcp:36:touch.500 00010000:00010000:0.0:1782759550.283543:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759550.283617:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf12 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27495 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.283640:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc3502f00) 00010000:00010000:0.0:1782759550.283676:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759550.285001:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.285023:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.285035:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759550.285185:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a62e7f51 reply state 0000000099d1651b transno 4294967715 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.285199:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759550.285206:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc3502000) 00010000:00010000:0.0:1782759550.285209:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759550.285212:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759550.285375:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109743:x1869355218542592:12345-192.168.202.31@tcp:36:touch.500 Request processed in 1909us (2542us total) trans 4294967715 rc 0/0 00000100:00100000:0.0:1782759550.285385:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2953 00000100:00100000:0.0:1782759550.289265:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759550.289403:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218542720 00000100:00100000:2.0:1782759550.289418:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218542720 00000100:00100000:2.0:1782759550.289510:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2954 00000100:00100000:2.0:1782759550.289522:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109743:x1869355218542720:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:2.0:1782759550.289547:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759550.290292:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cf27 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2749c expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.290459:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cf27 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2749c expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.290486:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cf27 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2749c expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759550.290514:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc3502000) 00010000:00010000:2.0:1782759550.290518:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759550.290521:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648a00, rc 0) 00000100:00100000:2.0:1782759550.290844:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109743:x1869355218542720:12345-192.168.202.31@tcp:101:touch.500 Request processed in 1323us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.290853:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2954 00000100:00100000:2.0:1782759550.297442:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759550.311513:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218542848 00000100:00100000:1.0:1782759550.311533:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218542848 00000100:00100000:1.0:1782759550.311645:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1088 00000100:00100000:1.0:1782759550.311657:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1869355218542848:12345-192.168.202.31@tcp:8:touch.500 00010000:00080000:1.0:1782759550.312279:0:82628:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp t0 exp 0000000000000000 cur 3590 last 0 00000020:00000080:1.0:1782759550.312326:0:82628:0:(genops.c:1406:class_connect()) connect: client e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0, cookie 0xd5b45c7f5c60cf2e 00002000:00100000:1.0:1782759550.312357:0:82628:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0/ffff8cddc4925800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759550.312385:0:82628:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782759550.312510:0:82628:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782759550.312556:0:82628:0:(import.c:65:import_set_state_nolock()) ffff8cddc4922800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759550.320940:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2401:x1869355218542848:12345-192.168.202.31@tcp:8:touch.500 Request processed in 9263us (23487us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759550.320963:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1088 00000100:00100000:3.0:1782759550.333253:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759550.333467:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218542976 00000100:00100000:2.0:1782759550.333481:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218542976 00000100:00100000:2.0:1782759550.333607:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1089 00000100:00100000:2.0:1782759550.333635:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:0:x1869355218542976:12345-192.168.202.31@tcp:2:touch.500 00000100:00080000:3.0:1782759550.335884:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1782759550.337947:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967411 is committed 00000001:00100000:2.0:1782759550.337961:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000100:00100000:3.0:1782759550.338199:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:0:x1869355218542976:12345-192.168.202.31@tcp:2:touch.500 Request processed in 4574us (4962us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1782759550.338214:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1089 00000100:00100000:3.0:1782759550.347558:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759550.347942:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218543232 00000100:00100000:0.0:1782759550.347956:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218543232 00000100:00100000:0.0:1782759550.348029:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 342 00000100:00100000:0.0:1782759550.348041:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109743:x1869355218543232:12345-192.168.202.31@tcp:35:touch.500 00000100:00100000:0.0:1782759550.348490:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:109743:x1869355218543232:12345-192.168.202.31@tcp:35:touch.500 Request processed in 450us (948us total) trans 4294967716 rc 0/0 00000100:00100000:0.0:1782759550.348499:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 342 00010000:00010000:3.0:1782759550.731813:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759550.858940:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232950912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859006:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859048:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232951424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859066:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859092:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232951936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859115:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859138:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1782759550.859143:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232950784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859183:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859217:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232951296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859252:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859268:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232951808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859290:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859307:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232952320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859329:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859366:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232951040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859388:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859405:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232951552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859426:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859443:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232952064:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859461:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859477:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782759550.859482:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232951168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859499:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859510:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232951680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859527:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859540:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232952192:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859557:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759550.859620:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950912 00000100:00100000:2.0:1782759550.859628:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950912 00000100:00100000:2.0:1782759550.859672:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951424 00000100:00100000:2.0:1782759550.859675:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951424 00000100:00100000:2.0:1782759550.859692:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951936 00000100:00100000:2.0:1782759550.859695:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951936 00000100:00100000:2.0:1782759550.859709:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951552 00000100:00100000:2.0:1782759550.859711:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951552 00000100:00100000:2.0:1782759550.859723:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952064 00000100:00100000:2.0:1782759550.859725:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952064 00000100:00100000:2.0:1782759550.859736:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951168 00000100:00100000:2.0:1782759550.859738:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951168 00000100:00100000:2.0:1782759550.859753:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5106 00000100:00100000:2.0:1782759550.859762:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232950912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859815:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232950912:12345-0@lo:400:kworker.0 Request processed in 54us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.859822:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5106 00000100:00100000:2.0:1782759550.859839:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5107 00000100:00100000:2.0:1782759550.859847:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232951424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859872:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232951424:12345-0@lo:400:kworker.0 Request processed in 28us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.859878:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5107 00000100:00100000:2.0:1782759550.859889:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5108 00000100:00100000:2.0:1782759550.859895:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232951936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859920:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232951936:12345-0@lo:400:kworker.0 Request processed in 26us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.859925:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5108 00000100:00100000:2.0:1782759550.859936:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5109 00000100:00100000:2.0:1782759550.859944:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232951552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.859982:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232951552:12345-0@lo:400:kworker.0 Request processed in 40us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.859987:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5109 00000100:00100000:2.0:1782759550.859998:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5110 00000100:00100000:2.0:1782759550.860005:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232952064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860026:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232952064:12345-0@lo:400:kworker.0 Request processed in 23us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860032:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5110 00000100:00100000:2.0:1782759550.860040:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5111 00000100:00100000:2.0:1782759550.860045:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232951168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860063:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232951168:12345-0@lo:400:kworker.0 Request processed in 19us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860069:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5111 00000100:00100000:2.0:1782759550.860093:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232950784 00000100:00100000:2.0:1782759550.860096:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232950784 00000100:00100000:2.0:1782759550.860124:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244 00000100:00100000:2.0:1782759550.860131:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232950784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860167:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232950784:12345-0@lo:400:kworker.0 Request processed in 37us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860174:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244 00000100:00100000:2.0:1782759550.860200:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951296 00000100:00100000:2.0:1782759550.860204:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951296 00000100:00100000:2.0:1782759550.860432:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951040 00000100:00100000:2.0:1782759550.860437:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951040 00000100:00100000:2.0:1782759550.860457:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3298 00000100:00100000:2.0:1782759550.860463:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232951296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860503:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232951296:12345-0@lo:400:kworker.0 Request processed in 41us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860509:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3298 00000100:00100000:2.0:1782759550.860520:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1782759550.860526:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232951040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860548:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232951040:12345-0@lo:400:kworker.0 Request processed in 23us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860553:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1782759550.860568:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951808 00000100:00100000:2.0:1782759550.860571:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951808 00000100:00100000:2.0:1782759550.860613:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952320 00000100:00100000:2.0:1782759550.860616:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952320 00000100:00100000:2.0:1782759550.860628:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:2.0:1782759550.860633:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232951808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860661:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232951808:12345-0@lo:400:kworker.0 Request processed in 28us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860666:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:2.0:1782759550.860674:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232951680 00000100:00100000:2.0:1782759550.860676:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232951680 00000100:00100000:2.0:1782759550.860686:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952192 00000100:00100000:2.0:1782759550.860689:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952192 00000100:00100000:2.0:1782759550.860700:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:2.0:1782759550.860705:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232952320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860726:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232952320:12345-0@lo:400:kworker.0 Request processed in 21us (1397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860731:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:2.0:1782759550.860739:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1782759550.860751:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232951680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860774:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232951680:12345-0@lo:400:kworker.0 Request processed in 25us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860785:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1782759550.860794:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1782759550.860800:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232952192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860819:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232952192:12345-0@lo:400:kworker.0 Request processed in 21us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759550.860825:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1782759550.860878:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232951168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860888:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232951680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860896:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232952192:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860904:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232951040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860913:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232951552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860921:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232952064:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860961:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232950784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860970:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232951296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860980:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232951808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860988:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232952320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.860998:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232950912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.861017:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232951424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759550.861026:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232951936:0@lo:400:kworker.0 00000100:00080000:3.0:1782759550.861595:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759550.861600:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759550.861603:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759550.861605:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759551.370767:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759551.370796:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232952448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759551.370885:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759551.370975:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952448 00000100:00100000:0.0:1782759551.370985:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952448 00000100:00100000:0.0:1782759551.371037:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:0.0:1782759551.371047:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232952448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759551.371076:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759551.371123:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232952448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759551.371131:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:0.0:1782759551.371198:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc474ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232952448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759551.371384:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759551.371395:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759551.371427:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759551.371455:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952576 00000100:00100000:2.0:1782759551.371459:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952576 00000100:00100000:2.0:1782759551.371503:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:2.0:1782759551.371511:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232952576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759551.371523:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759551.371553:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232952576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759551.371560:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:2.0:1782759551.371621:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232952576:0@lo:13:osp-pre-1-0.0 02000000:00000400:0.0:1782759551.464884:0:151247:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0001_int: flush entry ffff8cdecdb0b600: key 500, ref 0, fl 0, cur 1782759551, ex 3620/4790 00000100:00100000:3.0:1782759551.636288:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759551.636426:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218543360 00000100:00100000:0.0:1782759551.636441:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218543360 00000100:00100000:0.0:1782759551.636525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2955 00000100:00100000:0.0:1782759551.636537:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:109780:x1869355218543360:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:0.0:1782759551.636564:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759551.636614:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274a3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636708:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636769:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636792:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636811:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636819:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636825:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636924:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cf4a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636932:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cf4a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636939:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cf4a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759551.636965:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cf4a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636980:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.636987:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637004:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637011:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637018:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dda00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759551.637023:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637031:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637046:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759551.637049:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759551.637055:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637062:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60cf3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637081:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637087:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637093:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637098:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759551.637108:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637114:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637122:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x53d908c2 (ffff8cddc3502f00) 00010000:00010000:0.0:1782759551.637125:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759551.637127:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637132:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60cf43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x53d908c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637169:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60cf35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274a3 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637183:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cf4a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274a3 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.637191:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759551.637193:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759551.637196:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc400, rc 0) 00000100:00100000:0.0:1782759551.637401:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:109780:x1869355218543360:12345-192.168.202.31@tcp:101:touch.500 Request processed in 865us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759551.637410:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2955 00000100:00080000:3.0:1782759551.637950:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759551.641361:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759551.641415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759551.641458:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218543616 00000100:00100000:0.0:1782759551.641469:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218543616 00000100:00100000:0.0:1782759551.641572:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 405 00000100:00100000:0.0:1782759551.641600:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218543616:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759551.641624:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759551.641656:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60cf4a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274a3 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.641681:0:140594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc3502300) 00010000:00010000:0.0:1782759551.641695:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759551.643646:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218543488 00000100:00100000:3.0:1782759551.643666:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218543488 00000100:00100000:3.0:1782759551.643892:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2956 00000100:00100000:3.0:1782759551.643906:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:109780:x1869355218543488:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:3.0:1782759551.643940:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759551.643970:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cf51 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274aa expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.644060:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cf58 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.644076:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cf58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.644090:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cf58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759551.644153:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:3.0:1782759551.644158:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1782759551.644212:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60cf51 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274aa expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759551.644566:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218543616:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 2966us (3146us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759551.644593:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 405 00010000:00010000:3.0:1782759551.645401:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cf58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274aa expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.645416:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cded3a3b100) 00010000:00010000:3.0:1782759551.645420:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1782759551.645424:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5000, rc 0) 00000100:00100000:3.0:1782759551.645481:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109780:x1869355218543488:12345-192.168.202.31@tcp:101:touch.500 Request processed in 1578us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759551.645511:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2956 00000100:00100000:0.0:1782759551.652949:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759551.655943:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218543872 00000100:00100000:3.0:1782759551.655966:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218543872 00000100:00100000:3.0:1782759551.656133:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2957 00000100:00100000:3.0:1782759551.656146:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109780:x1869355218543872:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:3.0:1782759551.656178:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759551.656206:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf5f lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274b1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.656420:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.656438:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.656452:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.657914:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.657938:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.657951:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759551.658052:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00010000:00010000:3.0:1782759551.658067:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658091:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658097:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658104:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658110:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759551.658115:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658122:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658133:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cded3a3b100) 00010000:00010000:3.0:1782759551.658136:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759551.658139:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658145:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cf66 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658220:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658246:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658251:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658262:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759551.658265:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658271:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658278:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xaeae4fd0 (ffff8cded3a3bc00) 00010000:00010000:3.0:1782759551.658280:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759551.658282:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658288:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cf6d lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658345:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf5f lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274b1 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658357:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cded3a3b100) 00010000:00010000:3.0:1782759551.658359:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759551.658363:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf5f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274b1 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.658372:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759551.658446:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109780:x1869355218543872:12345-192.168.202.31@tcp:101:touch.500 Request processed in 2303us (5511us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759551.658455:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2957 00000100:00100000:3.0:1782759551.660685:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759551.673922:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218544128 00000100:00100000:0.0:1782759551.673942:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218544128 00000100:00100000:0.0:1782759551.674040:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2958 00000100:00100000:0.0:1782759551.674054:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:109780:x1869355218544128:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:0.0:1782759551.674082:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759551.674115:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf74 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274b8 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674309:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674325:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674338:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674374:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674381:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674387:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759551.674803:0:42628:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x17:0x0], index 0: 0 00010000:00010000:0.0:1782759551.674956:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60cf89 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674966:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60cf89 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.674974:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60cf89 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675019:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675026:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675033:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675041:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675047:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759551.675060:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675069:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675084:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cded3a3b100) 00010000:00010000:0.0:1782759551.675087:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759551.675093:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675100:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60cf7b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759551.675116:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf531d5a reply state 0000000042079d70 transno 4294967717 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675128:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675134:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xaeae4fd0 (ffff8cddc3502500) 00010000:00010000:0.0:1782759551.675136:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759551.675139:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759551.675171:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60cf74 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274b8 expref: 15 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675184:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60cf89 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274b8 expref: 14 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759551.675192:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc3502e00) 00010000:00010000:0.0:1782759551.675194:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759551.675202:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d000, rc 0) 00000100:00100000:0.0:1782759551.681869:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:109780:x1869355218544128:12345-192.168.202.31@tcp:101:touch.500 Request processed in 7800us (21172us total) trans 4294967717 rc 0/0 00000100:00100000:0.0:1782759551.681890:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2958 00000100:00100000:1.0:1782759551.688641:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759551.689088:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218544384 00000100:00100000:2.0:1782759551.689103:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218544384 00000100:00100000:2.0:1782759551.689183:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2959 00000100:00100000:2.0:1782759551.689196:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:109780:x1869355218544384:12345-192.168.202.31@tcp:36:touch.500 00010000:00010000:2.0:1782759551.689296:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759551.689337:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60cf89 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274b8 expref: 15 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759551.689365:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc3502e00) 00010000:00010000:2.0:1782759551.689379:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759551.689462:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759551.689487:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759551.689498:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759551.690548:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049ee04ca reply state 00000000e7e5d06f transno 4294967718 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759551.691868:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759551.691881:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:2.0:1782759551.691884:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759551.691890:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759551.692106:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:109780:x1869355218544384:12345-192.168.202.31@tcp:36:touch.500 Request processed in 2906us (3466us total) trans 4294967718 rc 0/0 00000100:00100000:2.0:1782759551.692119:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2959 00000100:00100000:2.0:1782759551.703437:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759551.703732:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218544512 00000100:00100000:3.0:1782759551.703743:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218544512 00000100:00100000:3.0:1782759551.703789:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2960 00000100:00100000:3.0:1782759551.703797:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:109780:x1869355218544512:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:3.0:1782759551.703830:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759551.703848:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf9e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274bf expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.703903:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf9e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274bf expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.703919:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf9e lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274bf expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759551.703938:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:3.0:1782759551.703941:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759551.703945:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759551.704029:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:109780:x1869355218544512:12345-192.168.202.31@tcp:101:touch.500 Request processed in 231us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759551.704036:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2960 00000100:00100000:0.0:1782759551.708485:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759551.708557:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218544640 00000100:00100000:2.0:1782759551.708567:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218544640 00000100:00100000:2.0:1782759551.708658:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1090 00000100:00100000:2.0:1782759551.708677:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218544640:12345-192.168.202.31@tcp:2:touch.500 00000100:00100000:2.0:1782759551.708891:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218544640:12345-192.168.202.31@tcp:2:touch.500 Request processed in 223us (414us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1782759551.708898:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1090 00000100:00080000:3.0:1782759551.709269:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759551.721772:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759551.721872:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218544896 00000100:00100000:1.0:1782759551.721887:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218544896 00000100:00100000:1.0:1782759551.721938:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 343 00000100:00100000:1.0:1782759551.721946:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec7789850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:109780:x1869355218544896:12345-192.168.202.31@tcp:35:touch.500 00000100:00100000:1.0:1782759551.722349:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec7789850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:109780:x1869355218544896:12345-192.168.202.31@tcp:35:touch.500 Request processed in 402us (585us total) trans 4294967719 rc 0/0 00000100:00100000:1.0:1782759551.722357:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 343 00010000:00010000:2.0:1782759551.755816:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759552.394986:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759552.395172:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232952704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759552.395286:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759552.395419:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952704 00000100:00100000:2.0:1782759552.395451:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952704 00000100:00100000:2.0:1782759552.395594:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:2.0:1782759552.395614:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232952704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759552.395647:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759552.395699:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232952704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759552.395706:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:2.0:1782759552.395769:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759552.395778:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232952832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759552.395805:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759552.395829:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952832 00000100:00100000:2.0:1782759552.395833:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952832 00000100:00100000:2.0:1782759552.395860:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2647 00000100:00100000:2.0:1782759552.395868:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232952832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759552.395881:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759552.395910:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232952832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759552.395916:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2647 00000100:00100000:2.0:1782759552.395971:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232952832:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782759552.396141:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759552.396166:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232952704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759552.397690:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232952960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759552.397743:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759552.397846:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232952960 00000100:00100000:3.0:1782759552.397863:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232952960 00000100:00100000:3.0:1782759552.397925:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:3.0:1782759552.397932:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232952960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759552.397961:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759552.398307:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232952960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 374us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759552.398322:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00100000:0.0:1782759552.398405:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232952960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759552.419873:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759552.419923:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759552.419963:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759552.419996:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759552.420021:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759552.420059:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218545536 00000100:00100000:2.0:1782759552.420072:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218545536 00000100:00100000:2.0:1782759552.420139:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218545408 00000100:00100000:2.0:1782759552.420169:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218545408 00000100:00100000:2.0:1782759552.420207:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2948 00000100:00100000:2.0:1782759552.420218:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218545536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759552.420346:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218545536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 129us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759552.420355:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2948 00000100:00100000:1.0:1782759552.420501:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2949 00000100:00100000:1.0:1782759552.420513:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218545408:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759552.420549:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218545408:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759552.420556:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2949 00000100:00100000:0.0:1782759552.420853:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218545280 00000100:00100000:0.0:1782759552.420859:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218545280 00000100:00100000:0.0:1782759552.420909:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218545152 00000100:00100000:0.0:1782759552.420913:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218545152 00000100:00100000:0.0:1782759552.420941:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5112 00000100:00100000:0.0:1782759552.420948:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2405:x1869355218545280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759552.420988:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2405:x1869355218545280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759552.420995:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5112 00000100:00100000:0.0:1782759552.421011:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5113 00000100:00100000:0.0:1782759552.421018:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218545152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759552.421043:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218545152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759552.421049:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5113 00000100:00100000:3.0:1782759552.421993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218545024 00000100:00100000:3.0:1782759552.422003:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218545024 00000100:00100000:3.0:1782759552.422059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3245 00000100:00100000:3.0:1782759552.422068:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218545024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759552.422128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218545024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 61us (2271us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759552.422135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3245 00000100:00080000:3.0:1782759552.422182:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759552.422188:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759552.779421:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759553.802869:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 02000000:00000400:0.0:1782759554.306506:0:151295:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0000_int: flush entry ffff8cddc4874400: key 500, ref 0, fl 0, cur 1782759554, ex 3621/4791 02000000:00000400:0.0:1782759554.312551:0:151295:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0001_int: flush entry ffff8cddc4874a00: key 500, ref 0, fl 0, cur 1782759554, ex 3621/4791 00010000:00010000:2.0:1782759554.828256:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759554.959573:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759554.959631:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232953088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759554.959701:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759554.961287:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953088 00000100:00100000:1.0:1782759554.961298:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953088 00000100:00100000:1.0:1782759554.961364:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:1.0:1782759554.961372:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232953088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759554.961403:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759554.961463:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232953088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759554.961469:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:1.0:1782759554.961519:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232953088:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1782759555.479049:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967719 is committed 00010000:00010000:3.0:1782759555.479122:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479135:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479142:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479148:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759555.479153:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479630:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479648:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xe065f617 (ffff8cddc3502700) 00010000:00010000:3.0:1782759555.479651:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759555.479656:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479662:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60cf0b lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479701:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479708:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479714:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479718:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759555.479721:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479735:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479745:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc3502000) 00010000:00010000:3.0:1782759555.479747:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759555.479750:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479762:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60cf20 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479774:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479780:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479787:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479792:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759555.479795:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479800:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479806:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xaeae4fd0 (ffff8cddc3502500) 00010000:00010000:3.0:1782759555.479809:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759555.479812:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479817:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d200/0xd5b45c7f5c60cf82 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479831:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479836:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479848:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479853:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759555.479856:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479862:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479870:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:3.0:1782759555.479873:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759555.479876:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.479881:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60cf97 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759555.486009:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759555.486076:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218545792 00000100:00100000:1.0:1782759555.486085:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218545792 00000100:00100000:1.0:1782759555.486164:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2961 00000100:00100000:1.0:1782759555.486174:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109852:x1869355218545792:12345-192.168.202.31@tcp:101:cat.500 00010000:00010000:1.0:1782759555.486215:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759555.486237:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cfa5 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274c6 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486369:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486401:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486418:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759555.486430:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00010000:00010000:1.0:1782759555.486461:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486468:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486474:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486478:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759555.486482:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486489:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486500:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cdf02149500) 00010000:00010000:1.0:1782759555.486508:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759555.486513:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486519:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60cfac lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486559:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cfa5 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274c6 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486568:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cded3a3b100) 00010000:00010000:1.0:1782759555.486570:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759555.486574:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60cfa5 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274c6 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.486613:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759555.486671:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109852:x1869355218545792:12345-192.168.202.31@tcp:101:cat.500 Request processed in 499us (672us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759555.486679:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2961 00000100:00080000:3.0:1782759555.487094:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759555.489655:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759555.490004:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546048 00000100:00100000:3.0:1782759555.490015:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546048 00000100:00100000:3.0:1782759555.490075:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2962 00000100:00100000:3.0:1782759555.490085:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:109852:x1869355218546048:12345-192.168.202.31@tcp:101:cat.500 00010000:00010000:3.0:1782759555.490103:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759555.490131:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cfb3 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274cd expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.490944:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cfba lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.490967:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cfba lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.490979:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cfba lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759555.490993:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00010000:00010000:3.0:1782759555.491386:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60cfb3 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274cd expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.491403:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cfba lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274cd expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759555.491412:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759555.491415:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759555.491419:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759555.491486:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109852:x1869355218546048:12345-192.168.202.31@tcp:101:cat.500 Request processed in 1401us (1836us total) trans 4294967720 rc 0/0 00000100:00100000:3.0:1782759555.491495:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2962 00000100:00100000:1.0:1782759555.497355:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759555.497400:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759555.497430:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546432 00000100:00100000:1.0:1782759555.497440:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546432 00000100:00100000:1.0:1782759555.497499:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 406 00000100:00100000:1.0:1782759555.497509:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2404:x1869355218546432:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759555.497526:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759555.497550:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60cfba lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274cd expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759555.497600:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:1.0:1782759555.497611:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759555.497660:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5646d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218546432:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 152us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759555.497669:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 406 00000100:00100000:3.0:1782759555.497737:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546304 00000100:00100000:3.0:1782759555.497741:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546304 00000100:00100000:3.0:1782759555.497778:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 344 00000100:00100000:3.0:1782759555.497786:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:109852:x1869355218546304:12345-192.168.202.31@tcp:35:cat.500 00000100:00100000:3.0:1782759555.498038:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:109852:x1869355218546304:12345-192.168.202.31@tcp:35:cat.500 Request processed in 253us (692us total) trans 4294967721 rc 0/0 00000100:00100000:3.0:1782759555.498044:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 344 00010000:00010000:1.0:1782759555.850935:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759555.981719:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232953216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.982252:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.982334:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232953728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.982362:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.982389:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232954240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.982418:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.982435:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232954752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.982453:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984267:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1782759555.984283:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232953600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984336:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984360:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232954112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984383:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984401:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232954624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984423:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984462:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232953344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984485:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984518:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232953856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984541:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984556:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232954368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984572:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984601:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759555.984607:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232953472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984628:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984643:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232953984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984658:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984672:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232954496:0@lo:400:kworker.0 00000100:00100000:2.0:1782759555.984688:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759555.984720:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954240 00000100:00100000:2.0:1782759555.984727:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954240 00000100:00100000:1.0:1782759555.986541:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953728 00000100:00100000:1.0:1782759555.986555:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953728 00000100:00100000:1.0:1782759555.986634:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953472 00000100:00100000:1.0:1782759555.986637:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953472 00000100:00100000:1.0:1782759555.986657:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302 00000100:00100000:1.0:1782759555.986666:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232953728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759555.986756:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232953728:12345-0@lo:400:kworker.0 Request processed in 90us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759555.986763:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302 00000100:00100000:1.0:1782759555.986780:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:1.0:1782759555.986786:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232953472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759555.986837:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232953472:12345-0@lo:400:kworker.0 Request processed in 35us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759555.986845:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:3.0:1782759555.994121:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953216 00000100:00100000:3.0:1782759555.994144:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953216 00000100:00100000:1.0:1782759555.998314:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232953472:0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001290:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953600 00000100:00100000:0.0:1782759556.001305:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953600 00000100:00100000:0.0:1782759556.001356:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953344 00000100:00100000:0.0:1782759556.001359:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953344 00000100:00100000:0.0:1782759556.001371:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953856 00000100:00100000:0.0:1782759556.001374:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953856 00000100:00100000:0.0:1782759556.001389:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954368 00000100:00100000:0.0:1782759556.001392:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954368 00000100:00100000:0.0:1782759556.001415:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232953984 00000100:00100000:0.0:1782759556.001418:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232953984 00000100:00100000:0.0:1782759556.001430:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954496 00000100:00100000:0.0:1782759556.001432:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954496 00000100:00100000:0.0:1782759556.001450:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5114 00000100:00100000:0.0:1782759556.001460:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232953600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001564:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232953600:12345-0@lo:400:kworker.0 Request processed in 105us (17226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.001571:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5114 00000100:00100000:0.0:1782759556.001618:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5115 00000100:00100000:0.0:1782759556.001624:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232953344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001665:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232953344:12345-0@lo:400:kworker.0 Request processed in 41us (17178us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.001671:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5115 00000100:00100000:0.0:1782759556.001682:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5116 00000100:00100000:0.0:1782759556.001687:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232953856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001727:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232953856:12345-0@lo:400:kworker.0 Request processed in 41us (17185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.001733:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5116 00000100:00100000:0.0:1782759556.001742:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5117 00000100:00100000:0.0:1782759556.001746:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232954368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001767:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232954368:12345-0@lo:400:kworker.0 Request processed in 20us (17194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.001772:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5117 00000100:00100000:0.0:1782759556.001781:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118 00000100:00100000:0.0:1782759556.001787:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232953984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001813:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232953984:12345-0@lo:400:kworker.0 Request processed in 27us (17154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.001819:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118 00000100:00100000:0.0:1782759556.001829:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5119 00000100:00100000:0.0:1782759556.001835:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232954496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001864:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232954496:12345-0@lo:400:kworker.0 Request processed in 29us (17174us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.001870:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5119 00000100:00100000:0.0:1782759556.001900:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954752 00000100:00100000:0.0:1782759556.001903:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954752 00000100:00100000:0.0:1782759556.001919:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954112 00000100:00100000:0.0:1782759556.001921:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954112 00000100:00100000:0.0:1782759556.001932:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954624 00000100:00100000:0.0:1782759556.001934:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954624 00000100:00100000:0.0:1782759556.001946:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:0.0:1782759556.001953:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232954240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.001996:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232954240:12345-0@lo:400:kworker.0 Request processed in 43us (19576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.002002:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:0.0:1782759556.002013:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:0.0:1782759556.002018:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232954752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.002040:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232954752:12345-0@lo:400:kworker.0 Request processed in 22us (19586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.002046:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00100000:0.0:1782759556.002057:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:0.0:1782759556.002062:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232954112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.002085:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232954112:12345-0@lo:400:kworker.0 Request processed in 24us (17702us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.002090:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00100000:0.0:1782759556.002098:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:0.0:1782759556.002103:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232954624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759556.002129:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232954624:12345-0@lo:400:kworker.0 Request processed in 26us (17705us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759556.002135:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:1.0:1782759556.002268:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232953984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.002282:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232954496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.002294:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232953344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.002313:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232953856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.002323:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232954368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759556.014113:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:3.0:1782759556.014126:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232953216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759556.014232:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232953216:12345-0@lo:400:kworker.0 Request processed in 109us (31982us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759556.014240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00080000:3.0:1782759556.015873:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759556.015881:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759556.015884:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759556.015886:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759556.017689:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232953600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.017709:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232954112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.017720:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232954624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.017731:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232953216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.017742:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232953728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.017753:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232954240:0@lo:400:kworker.0 00000100:00100000:1.0:1782759556.017776:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232954752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759556.494285:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759556.494305:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232954880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759556.494369:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759556.494427:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232954880 00000100:00100000:2.0:1782759556.494434:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232954880 00000100:00100000:2.0:1782759556.494482:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:2.0:1782759556.494490:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232954880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759556.494518:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759556.494560:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232954880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759556.494566:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:2.0:1782759556.494630:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232954880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759556.495901:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232955008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759556.495944:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759556.495984:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955008 00000100:00100000:2.0:1782759556.495990:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955008 00000100:00100000:2.0:1782759556.496026:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:2.0:1782759556.496035:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232955008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759556.496052:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759556.496087:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232955008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759556.496094:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:2.0:1782759556.496126:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232955008:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759556.876087:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759557.260152:0:151440:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc023629e0 20000000:00000080:1.0:1782759557.260177:0:151440:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedb958400 uarg=0000000000000000 00010000:00010000:1.0:1782759557.261743:0:151440:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759557.261764:0:151440:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759557.261787:0:151440:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1782759557.261821:0:151440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:1.0:1782759557.261825:0:151440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759557.261841:0:151440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60cf9e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274bf expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.261869:0:151440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc3502000) 00010000:00010000:1.0:1782759557.261873:0:151440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782759557.261877:0:151440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60cf27 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2749c expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.261911:0:151440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cded3a3b100) 00010000:00010000:1.0:1782759557.261914:0:151440:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1782759557.261919:0:151440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60cf58 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274aa expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.261933:0:151440:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 3 locks, left on hash table 0. 10000000:01000000:1.0:1782759557.261993:0:151440:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759557.262009:0:151440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.262024:0:151440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.262034:0:151440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.262081:0:151440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759557.262098:0:151440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 23 pid: 6525 timeout: 3747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759557.262115:0:151440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5647b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151440:1869355232955136:0@lo:104: 00000100:00100000:1.0:1782759557.262210:0:151440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759557.262267:0:151440:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759557.262458:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955136 00000100:00100000:2.0:1782759557.262468:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955136 00000100:00100000:2.0:1782759557.262530:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1782759557.262541:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:151440:x1869355232955136:12345-0@lo:104: 00010000:00010000:2.0:1782759557.262557:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759557.262646:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759557.262652:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:151440:x1869355232955136:12345-0@lo:104: Request processed in 113us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759557.262660:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00010000:00010000:2.0:1782759557.262682:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759557.262688:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759557.262695:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dcc00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759557.262699:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759557.262714:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759557.262721:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759557.262728:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759557.262756:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759557.262763:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759557.262781:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759557.262788:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dcc00/0xd5b45c7f5c60ceda lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cee1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759557.262801:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759557.262803:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759557.262804:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759557.262816:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232955264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759557.262847:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759557.262912:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955264 00000100:00100000:0.0:1782759557.262917:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955264 00010000:00010000:0.0:1782759557.262940:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 24 pid: 6525 timeout: 3747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759557.262969:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:0.0:1782759557.262975:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232955264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759557.262985:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759557.262997:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 24 pid: 6525 timeout: 3747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263007:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 24 pid: 6525 timeout: 3747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263023:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263044:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263059:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263066:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263074:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263080:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263084:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759557.263089:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263096:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263103:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263127:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759557.263156:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232955264:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759557.263164:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00010000:00010000:0.0:1782759557.263221:0:151440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60cee1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ceda expref: 23 pid: 6525 timeout: 3747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759557.263233:0:151440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5647b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151440:1869355232955136:0@lo:104: 00010000:00010000:0.0:1782759557.263252:0:151440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263262:0:151440:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263269:0:151440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759557.263276:0:151440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60cfc8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759557.264744:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec680ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232955264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759557.527472:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232955392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759557.527539:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759557.527618:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759557.527625:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232955520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759557.527651:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759557.527684:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955392 00000100:00100000:3.0:1782759557.527691:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955392 00000100:00100000:3.0:1782759557.527747:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:3.0:1782759557.527756:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232955392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759557.527789:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759557.527831:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232955392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759557.527838:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00000100:00100000:3.0:1782759557.527859:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955520 00000100:00100000:3.0:1782759557.527863:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955520 00000100:00100000:3.0:1782759557.527904:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1782759557.527909:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232955520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759557.527937:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759557.527971:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232955520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759557.527976:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00080000:3.0:1782759557.527994:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759557.528026:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232955520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759557.528054:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232955392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759557.542405:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759557.542429:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232955648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759557.542499:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759557.548397:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955648 00000100:00100000:0.0:1782759557.548410:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955648 00000100:00100000:0.0:1782759557.548467:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1782759557.548477:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232955648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759557.548501:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759557.548612:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232955648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (6113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759557.548620:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:0.0:1782759557.548672:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232955648:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1782759557.555679:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967422 is committed 00000100:00100000:2.0:1782759557.855268:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759557.855300:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759557.855390:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759557.855409:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759557.855466:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546560 00000100:00100000:0.0:1782759557.855477:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546560 00000100:00100000:0.0:1782759557.855525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3247 00000100:00100000:0.0:1782759557.855535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218546560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759557.855625:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218546560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759557.855633:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3247 00000100:00100000:0.0:1782759557.855664:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547072 00000100:00100000:0.0:1782759557.855668:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547072 00000100:00100000:0.0:1782759557.855711:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2954 00000100:00100000:0.0:1782759557.855717:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218547072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759557.855743:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218547072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759557.855749:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2954 00000100:00080000:0.0:1782759557.855775:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759557.857547:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759557.857803:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546816 00000100:00100000:1.0:1782759557.857810:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546816 00000100:00100000:0.0:1782759557.857827:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546944 00000100:00100000:0.0:1782759557.857831:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546944 00000100:00100000:1.0:1782759557.857851:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218546688 00000100:00100000:1.0:1782759557.857859:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218546688 00000100:00100000:0.0:1782759557.857863:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2955 00000100:00100000:0.0:1782759557.857870:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218546944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759557.857881:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5120 00000100:00100000:1.0:1782759557.857888:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218546816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759557.857940:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec680ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218546816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 52us (2638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759557.857947:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5120 00000100:00100000:1.0:1782759557.857962:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5121 00000100:00100000:1.0:1782759557.857967:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218546688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759557.857991:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218546688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (2581us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759557.857997:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5121 00000100:00080000:2.0:1782759557.858172:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759557.858186:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759557.858188:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759557.858488:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218546944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 616us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759557.858503:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2955 00010000:00010000:1.0:1782759557.898693:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759558.922782:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759558.937028:0:151488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe473e0610 20000000:00000080:2.0:1782759558.937046:0:151488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf954400 uarg=0000000000000000 00010000:00010000:2.0:1782759558.938758:0:151488:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759558.938778:0:151488:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759558.938799:0:151488:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759558.938809:0:151488:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759558.938831:0:151488:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759558.938850:0:151488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938865:0:151488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938876:0:151488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938883:0:151488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938888:0:151488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938894:0:151488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938899:0:151488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759558.938904:0:151488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938922:0:151488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938934:0:151488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938941:0:151488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.938946:0:151488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfcf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759558.988028:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759558.988036:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759558.988041:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759558.988090:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759558.988102:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759558.988113:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759558.988138:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232955776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759558.988231:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759558.988298:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759558.988383:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955776 00000100:00100000:2.0:1782759558.988391:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955776 00000100:00100000:2.0:1782759558.988462:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3248 00000100:00100000:2.0:1782759558.988474:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232955776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759558.988487:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759558.988500:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cfd6 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.988523:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.988534:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759558.988543:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759558.988845:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232955776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 374us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759558.988874:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3248 00000100:00100000:3.0:1782759558.998400:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232955776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759558.998430:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759558.998465:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759558.998490:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759558.998497:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759558.998505:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759559.956804:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759560.075962:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232955904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759560.076040:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759560.076184:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232955904 00000100:00100000:1.0:1782759560.076193:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232955904 00000100:00100000:1.0:1782759560.076269:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305 00000100:00100000:1.0:1782759560.076279:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232955904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759560.076322:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759560.076371:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232955904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759560.076378:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305 00000100:00100000:2.0:1782759560.076491:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5647480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232955904:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759560.974190:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759561.117223:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232956160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117302:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.117354:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232956672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117377:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.117393:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232957184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117409:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.117428:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759561.117433:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232956288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117452:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.117468:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232956800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117484:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.117494:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232957312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117509:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.117536:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956160 00000100:00100000:0.0:1782759561.117542:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956160 00000100:00100000:0.0:1782759561.117605:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956672 00000100:00100000:0.0:1782759561.117609:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956672 00000100:00100000:0.0:1782759561.117629:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957184 00000100:00100000:0.0:1782759561.117632:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957184 00000100:00100000:0.0:1782759561.117643:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956800 00000100:00100000:0.0:1782759561.117645:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956800 00000100:00100000:0.0:1782759561.117655:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957312 00000100:00100000:0.0:1782759561.117658:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957312 00000100:00100000:0.0:1782759561.117673:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5122 00000100:00100000:0.0:1782759561.117680:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232956160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117741:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232956160:12345-0@lo:400:kworker.0 Request processed in 60us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.117748:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5122 00000100:00100000:0.0:1782759561.117765:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5123 00000100:00100000:0.0:1782759561.117771:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232956672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117799:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232956672:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.117805:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5123 00000100:00100000:0.0:1782759561.117816:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5124 00000100:00100000:0.0:1782759561.117822:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232957184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117848:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232957184:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.117854:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5124 00000100:00100000:0.0:1782759561.117864:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5125 00000100:00100000:0.0:1782759561.117870:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232956800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232956800:12345-0@lo:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.117896:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5125 00000100:00100000:0.0:1782759561.117905:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5126 00000100:00100000:0.0:1782759561.117909:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232957312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.117928:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232957312:12345-0@lo:400:kworker.0 Request processed in 19us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.117933:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5126 00000100:00100000:0.0:1782759561.117949:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956288 00000100:00100000:0.0:1782759561.117952:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956288 00000100:00100000:0.0:1782759561.117991:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1782759561.117996:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232956288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.118023:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232956288:12345-0@lo:400:kworker.0 Request processed in 27us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.118028:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1782759561.118063:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232956288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.118075:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232956800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.118082:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232957312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.118089:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232956160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.118096:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232956672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.118104:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232957184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118409:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232956032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118444:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118474:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232956544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118496:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118512:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232957056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118544:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118571:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232957568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118612:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118632:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782759561.118638:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232956416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118659:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118675:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232956928:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118696:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118712:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232957440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118731:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759561.118755:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956416 00000100:00100000:1.0:1782759561.118758:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956416 00000100:00100000:1.0:1782759561.118786:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5127 00000100:00100000:1.0:1782759561.118792:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232956416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.118827:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232956416:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759561.118833:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5127 00000100:00100000:1.0:1782759561.118856:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956544 00000100:00100000:1.0:1782759561.118859:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956544 00000100:00100000:1.0:1782759561.118889:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3307 00000100:00100000:1.0:1782759561.118895:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232956544:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759561.118926:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759561.118931:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759561.118941:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957056 00000100:00100000:1.0:1782759561.118942:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232956544:12345-0@lo:400:kworker.0 Request processed in 47us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759561.118944:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957056 00000100:00100000:1.0:1782759561.118948:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3307 00000100:00100000:1.0:1782759561.118966:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957568 00000100:00100000:1.0:1782759561.118969:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957568 00000100:00100000:2.0:1782759561.118975:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956928 00000100:00100000:2.0:1782759561.118977:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956928 00000100:00100000:1.0:1782759561.118989:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957440 00000100:00100000:1.0:1782759561.118991:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957440 00000100:00100000:2.0:1782759561.118997:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:2.0:1782759561.119004:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232957056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119026:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1782759561.119033:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232957568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759561.119036:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232957056:12345-0@lo:400:kworker.0 Request processed in 34us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759561.119042:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:2.0:1782759561.119055:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:1.0:1782759561.119060:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232957568:12345-0@lo:400:kworker.0 Request processed in 29us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759561.119061:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232956928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119066:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:1.0:1782759561.119077:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1782759561.119082:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232957440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759561.119084:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232956928:12345-0@lo:400:kworker.0 Request processed in 25us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759561.119089:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00080000:2.0:1782759561.119101:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759561.119103:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759561.119103:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232957440:12345-0@lo:400:kworker.0 Request processed in 22us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759561.119109:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:1.0:1782759561.119138:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232956416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119167:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232956928:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119176:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232957440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119184:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232956544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119192:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232957056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759561.119200:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232957568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.121711:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232956032 00000100:00100000:0.0:1782759561.121724:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232956032 00000100:00100000:0.0:1782759561.121806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:0.0:1782759561.121816:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232956032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.121889:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232956032:12345-0@lo:400:kworker.0 Request processed in 75us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.121896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:2.0:1782759561.134144:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232956032:0@lo:400:kworker.0 00000100:00100000:0.0:1782759561.659452:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232957696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759561.659518:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.659624:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759561.659630:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232957824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759561.659652:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.659701:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957696 00000100:00100000:0.0:1782759561.659707:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957696 00000100:00100000:0.0:1782759561.659757:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957824 00000100:00100000:0.0:1782759561.659760:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957824 00000100:00100000:0.0:1782759561.659776:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:0.0:1782759561.659784:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232957696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759561.659811:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759561.659850:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232957696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.659856:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:0.0:1782759561.659872:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:0.0:1782759561.659878:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232957824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759561.659890:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759561.659913:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232957824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759561.659919:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:0.0:1782759561.659964:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232957824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759561.659980:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232957696:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1782759561.721723:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967721 is committed 00000020:00000080:0.0:1782759561.766485:0:151536:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffe4fd0380 20000000:00000080:0.0:1782759561.766502:0:151536:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf95f400 uarg=0000000000000000 00010000:00010000:0.0:1782759561.766762:0:151536:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759561.766780:0:151536:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759561.766804:0:151536:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759561.766816:0:151536:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759561.766836:0:151536:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759561.766853:0:151536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759561.766876:0:151536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759561.766886:0:151536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759561.766926:0:151536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759561.766939:0:151536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 23 pid: 6526 timeout: 3752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759561.766954:0:151536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151536:1869355232957952:0@lo:104: 00000100:00100000:0.0:1782759561.767020:0:151536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759561.767116:0:151536:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759561.767802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232957952 00000100:00100000:3.0:1782759561.767811:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232957952 00000100:00100000:3.0:1782759561.767868:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:3.0:1782759561.767878:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:151536:x1869355232957952:12345-0@lo:104: 00010000:00010000:3.0:1782759561.767891:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.767965:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759561.767971:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:151536:x1869355232957952:12345-0@lo:104: Request processed in 95us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759561.767978:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00010000:00010000:3.0:1782759561.767999:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759561.768005:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768012:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759561.768016:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768034:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759561.768042:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759561.768048:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759561.768080:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768086:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759561.768106:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768113:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfd6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cfdd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768126:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759561.768127:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759561.768129:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759561.768207:0:151536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151536:1869355232957952:0@lo:104: 00010000:00010000:1.0:1782759561.768229:0:151536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759561.768307:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232958080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759561.768339:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759561.768417:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958080 00000100:00100000:2.0:1782759561.768427:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958080 00010000:00010000:2.0:1782759561.768455:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 24 pid: 6526 timeout: 3752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759561.768488:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:2.0:1782759561.768496:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232958080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759561.768506:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759561.768511:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 24 pid: 6526 timeout: 3752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768520:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 24 pid: 6526 timeout: 3752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768532:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60cfdd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cfd6 expref: 24 pid: 6526 timeout: 3752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768543:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768551:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768563:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768569:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768612:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768619:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768630:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759561.768635:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768642:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768658:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759561.768669:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759561.768698:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232958080:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759561.768704:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1782759561.768846:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232958080:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759561.768867:0:151536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768874:0:151536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759561.768889:0:151536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c400/0xd5b45c7f5c60cfe4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759561.994764:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759562.530988:0:151584:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcaf1c45a0 20000000:00000080:3.0:1782759562.531006:0:151584:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdee7f13400 uarg=0000000000000000 00010000:00010000:3.0:1782759562.531329:0:151584:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759562.531345:0:151584:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759562.531364:0:151584:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759562.531374:0:151584:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759562.531391:0:151584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759562.531410:0:151584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531425:0:151584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531434:0:151584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531441:0:151584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531448:0:151584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531455:0:151584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531462:0:151584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759562.531473:0:151584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531481:0:151584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531493:0:151584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531500:0:151584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759562.531507:0:151584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cfeb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759562.634927:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232958208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759562.634953:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232958336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759562.634994:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759562.634994:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759562.635050:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759562.635056:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232958464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759562.635080:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759562.635120:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958208 00000100:00100000:0.0:1782759562.635127:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958208 00000100:00100000:1.0:1782759562.635169:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958464 00000100:00100000:1.0:1782759562.635179:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958464 00000100:00100000:0.0:1782759562.635273:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1782759562.635283:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232958208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759562.635310:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759562.635357:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232958208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759562.635374:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1782759562.635390:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1782759562.635396:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232958464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759562.635406:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759562.635434:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232958464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759562.635440:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1782759562.640368:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958336 00000100:00100000:0.0:1782759562.640383:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958336 00000100:00100000:0.0:1782759562.640456:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1782759562.640464:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232958336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759562.640500:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759562.640608:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232958336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759562.640616:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1782759562.640666:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232958208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759562.640710:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232958464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759562.640722:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232958336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759562.973957:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759562.978762:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547328 00000100:00100000:3.0:1782759562.978779:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547328 00000100:00100000:3.0:1782759562.978862:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5128 00000100:00100000:3.0:1782759562.978873:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218547328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759562.978956:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218547328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 84us (5009us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759562.978964:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5128 00000100:00080000:0.0:1782759562.979558:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759562.980990:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759562.981067:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547200 00000100:00100000:3.0:1782759562.981076:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547200 00000100:00100000:3.0:1782759562.981140:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3250 00000100:00100000:3.0:1782759562.981151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218547200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759562.981419:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218547200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 135us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759562.981428:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3250 00000100:00100000:3.0:1782759562.983913:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759562.983968:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759562.983998:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759562.984026:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547456 00000100:00100000:3.0:1782759562.984035:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547456 00000100:00100000:3.0:1782759562.984212:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5129 00000100:00100000:3.0:1782759562.984229:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218547456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759562.984313:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218547456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759562.984321:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5129 00000100:00100000:3.0:1782759562.984344:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547584 00000100:00100000:3.0:1782759562.984348:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547584 00000100:00100000:3.0:1782759562.984378:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547712 00000100:00100000:3.0:1782759562.984381:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547712 00000100:00100000:3.0:1782759562.984402:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2960 00000100:00100000:3.0:1782759562.984408:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218547584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759562.984565:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218547584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 156us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759562.984573:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2960 00000100:00100000:3.0:1782759562.985160:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2961 00000100:00100000:3.0:1782759562.985169:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218547712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759562.985204:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218547712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759562.985223:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2961 00000100:00080000:3.0:1782759562.985244:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759562.985248:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759562.985251:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782759563.018869:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759563.276298:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759563.276306:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759563.276311:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759563.276358:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759563.276384:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759563.276396:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759563.276421:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232958592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759563.276487:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759563.276541:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759563.277659:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958592 00000100:00100000:3.0:1782759563.277669:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958592 00000100:00100000:3.0:1782759563.277734:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1782759563.277744:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232958592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759563.277760:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759563.277776:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60cff2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759563.277801:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759563.277812:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759563.277821:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759563.277877:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232958592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759563.277884:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1782759563.277934:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232958592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759563.277949:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759563.277958:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759563.277984:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759563.277989:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759563.277997:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759564.051522:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759565.071326:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759565.195109:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759565.195168:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232958720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759565.195263:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759565.195690:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958720 00000100:00100000:1.0:1782759565.195701:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958720 00000100:00100000:1.0:1782759565.195788:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:1.0:1782759565.195799:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232958720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759565.195856:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759565.195924:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232958720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759565.195931:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1782759565.196188:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232958720:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759566.096548:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759566.223281:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232959232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223393:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223485:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232959744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223519:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223542:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232960256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223568:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223642:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1782759566.223649:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232958848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223683:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223708:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232959360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223733:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223748:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232959872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223769:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223785:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232960384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.223805:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.223864:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959744 00000100:00100000:3.0:1782759566.223874:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959744 00000100:00100000:3.0:1782759566.223941:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960256 00000100:00100000:3.0:1782759566.223945:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960256 00000100:00100000:3.0:1782759566.223959:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959872 00000100:00100000:3.0:1782759566.223962:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959872 00000100:00100000:3.0:1782759566.223988:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960384 00000100:00100000:3.0:1782759566.223990:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960384 00000100:00100000:3.0:1782759566.224008:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:3.0:1782759566.224018:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232959744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224278:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232959744:12345-0@lo:400:kworker.0 Request processed in 260us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.224287:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:3.0:1782759566.224307:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1782759566.224314:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232960256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224344:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232960256:12345-0@lo:400:kworker.0 Request processed in 30us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.224351:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:3.0:1782759566.224361:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1782759566.224367:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232959872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224393:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232959872:12345-0@lo:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.224399:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:3.0:1782759566.224408:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:3.0:1782759566.224415:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232960384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224441:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232960384:12345-0@lo:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.224458:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:3.0:1782759566.224484:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958848 00000100:00100000:3.0:1782759566.224489:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958848 00000100:00100000:3.0:1782759566.224518:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252 00000100:00100000:3.0:1782759566.224524:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232958848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224557:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232958848:12345-0@lo:400:kworker.0 Request processed in 33us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.224563:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252 00000100:00080000:3.0:1782759566.224633:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759566.224639:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759566.224681:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232958848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224700:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232959872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224709:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232960384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224719:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232959744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.224728:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232960256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.224865:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232958976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.224906:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759566.224931:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232959488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.224952:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759566.224968:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232960000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.224987:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759566.225009:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759566.225015:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232959104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225057:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759566.225076:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232959616:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225097:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759566.225129:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232960128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225151:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759566.225180:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959232 00000100:00100000:1.0:1782759566.225185:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959232 00000100:00100000:1.0:1782759566.225231:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232958976 00000100:00100000:1.0:1782759566.225244:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232958976 00000100:00100000:1.0:1782759566.225265:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959488 00000100:00100000:1.0:1782759566.225267:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959488 00000100:00100000:1.0:1782759566.225287:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960000 00000100:00100000:1.0:1782759566.225289:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960000 00000100:00100000:1.0:1782759566.225301:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959616 00000100:00100000:1.0:1782759566.225303:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959616 00000100:00100000:1.0:1782759566.225314:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960128 00000100:00100000:1.0:1782759566.225317:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960128 00000100:00100000:1.0:1782759566.225329:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5130 00000100:00100000:1.0:1782759566.225335:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232959232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225374:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232959232:12345-0@lo:400:kworker.0 Request processed in 39us (1982us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225381:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5130 00000100:00100000:1.0:1782759566.225395:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5131 00000100:00100000:1.0:1782759566.225401:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232958976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225432:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232958976:12345-0@lo:400:kworker.0 Request processed in 31us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225437:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5131 00000100:00100000:1.0:1782759566.225449:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5132 00000100:00100000:1.0:1782759566.225455:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232959488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225482:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232959488:12345-0@lo:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225488:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5132 00000100:00100000:1.0:1782759566.225498:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5133 00000100:00100000:1.0:1782759566.225504:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232960000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225530:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232960000:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225542:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5133 00000100:00100000:1.0:1782759566.225553:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5134 00000100:00100000:1.0:1782759566.225559:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232959616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225617:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232959616:12345-0@lo:400:kworker.0 Request processed in 58us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225624:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5134 00000100:00100000:1.0:1782759566.225635:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5135 00000100:00100000:1.0:1782759566.225641:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232960128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225669:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232960128:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225674:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5135 00000100:00100000:1.0:1782759566.225697:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959360 00000100:00100000:1.0:1782759566.225702:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959360 00000100:00100000:1.0:1782759566.225749:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232959104 00000100:00100000:1.0:1782759566.225752:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232959104 00000100:00100000:1.0:1782759566.225764:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1782759566.225769:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232959360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225803:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232959360:12345-0@lo:400:kworker.0 Request processed in 34us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225810:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:1.0:1782759566.225822:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1782759566.225828:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232959104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225852:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232959104:12345-0@lo:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759566.225858:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1782759566.225900:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232959104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225911:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232959616:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225922:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232960128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225931:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232958976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225941:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232959488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759566.225950:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232960000:0@lo:400:kworker.0 00000100:00080000:3.0:1782759566.228195:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759566.228208:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759566.228797:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232959360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.228825:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232959232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759566.732681:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759566.732701:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232960512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759566.732766:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759566.732824:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960512 00000100:00100000:3.0:1782759566.732837:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960512 00000100:00100000:3.0:1782759566.732875:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:3.0:1782759566.732882:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232960512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759566.732909:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759566.732948:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232960512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759566.732955:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00100000:3.0:1782759566.732990:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232960512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759566.744566:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232960640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759566.744658:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759566.745156:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960640 00000100:00100000:2.0:1782759566.745164:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960640 00000100:00100000:2.0:1782759566.745212:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1782759566.745221:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232960640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759566.745242:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759566.745290:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232960640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759566.745297:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:2.0:1782759566.745544:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232960640:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759567.116355:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759567.757779:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232960768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759567.757869:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759567.757962:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960768 00000100:00100000:0.0:1782759567.757970:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960768 00000100:00100000:0.0:1782759567.758023:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1782759567.758032:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232960768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759567.758069:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759567.758129:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232960768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759567.758136:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1782759567.758192:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232960768:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759567.758339:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232960896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759567.758376:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759567.759630:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232961024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759567.759679:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759567.759722:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961024 00000100:00100000:1.0:1782759567.759729:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961024 00000100:00100000:1.0:1782759567.759789:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:1.0:1782759567.759798:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232961024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759567.759833:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1782759567.759875:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232961024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759567.759882:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:1.0:1782759567.759921:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232961024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759567.760551:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232960896 00000100:00100000:2.0:1782759567.760558:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232960896 00000100:00100000:2.0:1782759567.760733:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:2.0:1782759567.760742:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232960896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759567.760776:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759567.760867:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232960896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759567.760873:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:0.0:1782759567.766665:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232960896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759568.095849:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759568.095898:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759568.095933:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759568.095960:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759568.096085:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548096 00000100:00100000:1.0:1782759568.096123:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548096 00000100:00100000:1.0:1782759568.096199:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547968 00000100:00100000:1.0:1782759568.096202:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547968 00000100:00100000:1.0:1782759568.096223:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5136 00000100:00100000:1.0:1782759568.096234:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218548096:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759568.096348:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218548096:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 115us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759568.096356:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5136 00000100:00100000:1.0:1782759568.096376:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5137 00000100:00100000:1.0:1782759568.096382:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218547968:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759568.096408:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218547968:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759568.096414:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5137 00000100:00100000:3.0:1782759568.096548:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548352 00000100:00100000:3.0:1782759568.096553:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548352 00000100:00100000:3.0:1782759568.096623:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2966 00000100:00100000:3.0:1782759568.096630:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218548352:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759568.096657:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218548352:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759568.096664:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2966 00000100:00080000:3.0:1782759568.096680:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759568.096685:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759568.096687:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759568.096904:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218547840 00000100:00100000:2.0:1782759568.096909:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218547840 00000100:00100000:2.0:1782759568.096960:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3253 00000100:00100000:2.0:1782759568.096968:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218547840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759568.097018:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218547840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 52us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759568.097024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3253 00000100:00100000:0.0:1782759568.097251:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759568.097353:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548224 00000100:00100000:2.0:1782759568.097357:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548224 00000100:00100000:2.0:1782759568.097399:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2967 00000100:00100000:2.0:1782759568.097408:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218548224:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759568.097491:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759568.097550:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218548224:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 143us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759568.097557:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2967 00010000:00010000:3.0:1782759568.139960:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759569.169980:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759569.262316:0:151780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff3b89b0d0 20000000:00000080:2.0:1782759569.262333:0:151780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf853c00 uarg=0000000000000000 10000000:01000000:2.0:1782759569.262498:0:151780:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759569.262518:0:151780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759569.262537:0:151780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759569.262555:0:151780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759569.262713:0:151780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759569.262727:0:151780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 23 pid: 6524 timeout: 3759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759569.262741:0:151780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151780:1869355232961152:0@lo:104: 00000100:00100000:2.0:1782759569.262807:0:151780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759569.262895:0:151780:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c780c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759569.262944:0:140593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759569.262957:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961152 00000100:00100000:3.0:1782759569.262963:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961152 00000100:00100000:3.0:1782759569.264520:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1782759569.264544:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc48a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:151780:x1869355232961152:12345-0@lo:104: 00010000:00010000:3.0:1782759569.264561:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759569.264671:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759569.264677:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc48a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:151780:x1869355232961152:12345-0@lo:104: Request processed in 136us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759569.264684:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1782759569.264787:0:151780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151780:1869355232961152:0@lo:104: 00010000:00010000:2.0:1782759569.264817:0:151780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.264921:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759569.264927:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.264935:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759569.264939:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.264947:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759569.264955:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759569.264960:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759569.264998:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265012:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759569.265030:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265043:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60cff2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60cff9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265060:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759569.265062:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759569.265063:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759569.265074:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232961280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759569.265118:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759569.265172:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961280 00000100:00100000:1.0:1782759569.265177:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961280 00010000:00010000:1.0:1782759569.265201:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 24 pid: 6524 timeout: 3759 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759569.265224:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1782759569.265230:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232961280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759569.265240:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759569.265245:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 24 pid: 6524 timeout: 3759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265255:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 24 pid: 6524 timeout: 3759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265268:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60cff9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60cff2 expref: 24 pid: 6524 timeout: 3759 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265280:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265297:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265310:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265316:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265323:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265330:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265335:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759569.265338:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265345:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265353:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759569.265360:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759569.265384:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232961280:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759569.265391:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:1.0:1782759569.265419:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232961280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759569.265487:0:151780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759569.265495:0:151780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759569.265502:0:151780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60d000 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759570.147720:0:151829:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0559e940 20000000:00000080:1.0:1782759570.147736:0:151829:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc48a4000 uarg=0000000000000000 10000000:01000000:1.0:1782759570.147909:0:151829:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759570.147931:0:151829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.147947:0:151829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.147959:0:151829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.147966:0:151829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.147974:0:151829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.147982:0:151829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.147989:0:151829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759570.147992:0:151829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.148001:0:151829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.148015:0:151829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.148023:0:151829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759570.148037:0:151829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d007 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759570.227276:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759570.314773:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232961408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759570.314832:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759570.314911:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961408 00000100:00100000:1.0:1782759570.314917:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961408 00000100:00100000:1.0:1782759570.314971:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313 00000100:00100000:1.0:1782759570.314977:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232961408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759570.315006:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759570.315040:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232961408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759570.315044:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313 00000100:00100000:0.0:1782759570.315127:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232961408:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1782759570.890876:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759570.890882:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759570.890886:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759570.890930:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759570.890942:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759570.890952:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759570.890975:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232961536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759570.891053:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759570.891112:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759570.891263:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961536 00000100:00100000:2.0:1782759570.891271:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961536 00000100:00100000:2.0:1782759570.891338:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3254 00000100:00100000:2.0:1782759570.891361:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232961536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759570.891376:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759570.891390:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d00e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759570.891413:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759570.891423:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759570.891432:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759570.891479:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232961536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759570.891485:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3254 00000100:00100000:0.0:1782759570.891639:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232961536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759570.891652:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759570.891668:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759570.891687:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759570.891691:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759570.891699:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782759571.145192:0:151877:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedb643c60 20000000:00000080:0.0:1782759571.145208:0:151877:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc457b400 uarg=0000000000000000 00010000:00010000:0.0:1782759571.145515:0:151877:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759571.145530:0:151877:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759571.145549:0:151877:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759571.145558:0:151877:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759571.145668:0:151877:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759571.145687:0:151877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.145702:0:151877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.145710:0:151877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.145747:0:151877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759571.145769:0:151877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 23 pid: 6524 timeout: 3761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759571.145784:0:151877:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151877:1869355232961664:0@lo:104: 00000100:00100000:0.0:1782759571.145847:0:151877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759571.145932:0:151877:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759571.145969:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961664 00000100:00100000:2.0:1782759571.145975:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961664 00000100:00100000:2.0:1782759571.146071:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1782759571.146082:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:151877:x1869355232961664:12345-0@lo:104: 00010000:00010000:2.0:1782759571.146094:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759571.146199:0:151877:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:151877:1869355232961664:0@lo:104: 00010000:00010000:0.0:1782759571.146215:0:151877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146261:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759571.146267:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:151877:x1869355232961664:12345-0@lo:104: Request processed in 188us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759571.146274:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00010000:00010000:3.0:1782759571.146367:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759571.146374:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.146381:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ce00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759571.146385:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.146393:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759571.146399:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759571.146408:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759571.146463:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.146469:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759571.146497:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.146514:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d00e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d015 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759571.146528:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759571.146529:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759571.146531:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759571.146538:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759571.146548:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232961792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759571.146599:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.146692:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961792 00000100:00100000:2.0:1782759571.146696:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961792 00010000:00010000:2.0:1782759571.146713:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 24 pid: 6524 timeout: 3761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759571.146746:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1782759571.146753:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5715450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232961792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759571.146763:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759571.146767:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 24 pid: 6524 timeout: 3761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146776:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 24 pid: 6524 timeout: 3761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146786:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60d015 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d00e expref: 24 pid: 6524 timeout: 3761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146797:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146804:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146814:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146820:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146826:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146832:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146845:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166da00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759571.146849:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146855:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146873:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759571.146882:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759571.146905:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5715450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232961792:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759571.146911:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:2.0:1782759571.146952:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232961792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759571.146998:0:151877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759571.147006:0:151877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759571.147013:0:151877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d01c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 151877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759571.275673:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759571.339789:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232962176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.339869:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.339917:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232962688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.339942:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.339959:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232963200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.339979:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.340001:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782759571.340008:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232962304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.340031:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.340046:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232962816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.340628:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962176 00000100:00100000:3.0:1782759571.340637:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962176 00000100:00100000:3.0:1782759571.340686:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5138 00000100:00100000:3.0:1782759571.340696:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232962176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.340749:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232962176:12345-0@lo:400:kworker.0 Request processed in 54us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759571.340756:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5138 00000100:00100000:3.0:1782759571.340779:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962688 00000100:00100000:3.0:1782759571.340782:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962688 00000100:00100000:3.0:1782759571.340815:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963200 00000100:00100000:3.0:1782759571.340818:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963200 00000100:00100000:3.0:1782759571.340837:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1782759571.340844:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232962688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.340875:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232962688:12345-0@lo:400:kworker.0 Request processed in 32us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759571.340882:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:3.0:1782759571.340893:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:3.0:1782759571.340899:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232963200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.340936:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232963200:12345-0@lo:400:kworker.0 Request processed in 38us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759571.340942:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:1.0:1782759571.341117:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232961920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341150:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759571.341191:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232962432:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341213:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759571.341230:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232962944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341263:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759571.341283:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759571.341290:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232962048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341451:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759571.341471:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232962560:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341495:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759571.341513:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232963072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341536:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759571.341567:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962304 00000100:00100000:1.0:1782759571.341572:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962304 00000100:00100000:1.0:1782759571.341626:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962048 00000100:00100000:1.0:1782759571.341629:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962048 00000100:00100000:1.0:1782759571.341641:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314 00000100:00100000:1.0:1782759571.341648:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232962304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341680:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232962304:12345-0@lo:400:kworker.0 Request processed in 31us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.341686:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314 00000100:00100000:1.0:1782759571.341697:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:1.0:1782759571.341702:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232962048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.341734:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232962048:12345-0@lo:400:kworker.0 Request processed in 31us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.341740:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00000100:00100000:1.0:1782759571.341972:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232961920 00000100:00100000:1.0:1782759571.341976:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232961920 00000100:00100000:1.0:1782759571.341992:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962432 00000100:00100000:1.0:1782759571.341994:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962432 00000100:00100000:1.0:1782759571.342006:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962944 00000100:00100000:1.0:1782759571.342016:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962944 00000100:00100000:1.0:1782759571.342030:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962560 00000100:00100000:1.0:1782759571.342032:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962560 00000100:00100000:1.0:1782759571.342042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963072 00000100:00100000:1.0:1782759571.342044:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963072 00000100:00100000:1.0:1782759571.342056:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5139 00000100:00100000:2.0:1782759571.342123:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.342144:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232963328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.342164:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.342269:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232962176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.342281:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232962688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.342290:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232963200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759571.342437:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232962816 00000100:00100000:0.0:1782759571.342441:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232962816 00000100:00100000:0.0:1782759571.342470:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963328 00000100:00100000:0.0:1782759571.342473:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963328 00000100:00100000:0.0:1782759571.342489:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:0.0:1782759571.342496:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232962816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759571.342529:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232962816:12345-0@lo:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759571.342534:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:0.0:1782759571.342546:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:0.0:1782759571.342552:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232963328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759571.342596:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc474ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232963328:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759571.342601:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:2.0:1782759571.342681:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232962304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.342694:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232962816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759571.342702:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232963328:0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.343158:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5140 00000100:00100000:3.0:1782759571.343168:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232962432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.343278:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232962432:12345-0@lo:400:kworker.0 Request processed in 113us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759571.343285:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5140 00000100:00100000:3.0:1782759571.343300:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5141 00000100:00100000:3.0:1782759571.343306:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232962944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.343405:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232961920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.343439:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232961920:12345-0@lo:400:kworker.0 Request processed in 1377us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.343446:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5139 00000100:00100000:1.0:1782759571.343469:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5142 00000100:00100000:1.0:1782759571.343476:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232962560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.343503:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232962560:12345-0@lo:400:kworker.0 Request processed in 27us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.343508:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5142 00000100:00100000:1.0:1782759571.343520:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5143 00000100:00100000:1.0:1782759571.343527:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232963072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.343567:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232963072:12345-0@lo:400:kworker.0 Request processed in 40us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.343573:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5143 00000100:00100000:3.0:1782759571.344404:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232962944:12345-0@lo:400:kworker.0 Request processed in 1096us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759571.345166:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232962048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759571.345204:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5141 00000100:00080000:3.0:1782759571.345225:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759571.345229:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759571.345232:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759571.345234:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759571.346134:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232962560:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.346146:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232963072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.346157:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232961920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.346168:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232962432:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.346271:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232962944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759571.851050:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232963456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759571.851163:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759571.851491:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232963584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759571.851891:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963456 00000100:00100000:0.0:1782759571.851913:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963456 00000100:00100000:0.0:1782759571.851969:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:0.0:1782759571.851978:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232963456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759571.852024:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759571.852361:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759571.852438:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963584 00000100:00100000:2.0:1782759571.852443:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963584 00000100:00100000:2.0:1782759571.852485:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:2.0:1782759571.852494:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232963584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759571.852507:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759571.852552:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232963584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759571.852560:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1782759571.852689:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232963584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759571.852868:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232963456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 890us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759571.852876:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1782759571.852978:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232963456:0@lo:13:osp-pre-1-1.0 10000000:01000000:3.0:1782759572.225176:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759572.225184:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759572.225190:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759572.225234:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759572.225246:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759572.225271:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759572.225297:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232963712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759572.225370:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759572.225423:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759572.225530:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963712 00000100:00100000:0.0:1782759572.225538:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963712 00000100:00100000:0.0:1782759572.225613:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:0.0:1782759572.225622:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232963712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759572.225636:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759572.225649:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d023 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759572.225672:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759572.225682:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759572.225691:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d000, rc 0) 00000100:00100000:0.0:1782759572.225727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232963712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759572.225733:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00000100:00100000:0.0:1782759572.225773:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232963712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759572.225786:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759572.225806:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759572.225825:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759572.225830:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759572.225836:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759572.299847:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759572.874793:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759572.874815:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232963840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759572.874884:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759572.874948:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963840 00000100:00100000:0.0:1782759572.874954:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963840 00000100:00100000:0.0:1782759572.874997:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:3.0:1782759572.875128:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232963968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759572.875157:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759572.875186:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232963968 00000100:00100000:3.0:1782759572.875190:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232963968 00000100:00100000:3.0:1782759572.875214:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1782759572.875221:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232963968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759572.875251:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759572.875296:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232963968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759572.875303:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:3.0:1782759572.875348:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232963968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759572.875672:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232963840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759572.875686:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759572.875728:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232963840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 723us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759572.875735:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00100000:2.0:1782759572.875881:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232963840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759572.876651:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759572.876664:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232964096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759572.876701:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759572.876770:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964096 00000100:00100000:0.0:1782759572.876776:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964096 00000100:00100000:0.0:1782759572.876821:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:0.0:1782759572.876829:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232964096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759572.876855:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759572.876912:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232964096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759572.876918:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00100000:3.0:1782759572.877043:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232964096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759573.213251:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759573.214396:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759573.214428:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759573.214446:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759573.214508:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759573.214535:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548736 00000100:00100000:1.0:1782759573.214545:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548736 00000100:00100000:1.0:1782759573.214606:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548608 00000100:00100000:1.0:1782759573.214609:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548608 00000100:00100000:1.0:1782759573.214632:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5144 00000100:00100000:1.0:1782759573.214641:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218548736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759573.214724:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218548736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759573.214732:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5144 00000100:00100000:1.0:1782759573.214750:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5145 00000100:00100000:1.0:1782759573.214756:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218548608:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759573.214782:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218548608:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759573.214789:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5145 00000100:00100000:1.0:1782759573.214810:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548864 00000100:00100000:1.0:1782759573.214822:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548864 00000100:00100000:1.0:1782759573.214863:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548992 00000100:00100000:1.0:1782759573.214866:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548992 00000100:00100000:1.0:1782759573.214894:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2972 00000100:00100000:1.0:1782759573.214901:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218548864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759573.214929:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218548864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759573.214934:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2972 00000100:00100000:1.0:1782759573.214945:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1091 00000100:00100000:1.0:1782759573.214951:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218548992:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782759573.214969:0:8447:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60cf2e 00000100:00080000:1.0:1782759573.214977:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cddc4922800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759573.215028:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967411 00010000:00010000:3.0:1782759573.215030:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759573.215134:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218548480 00000100:00100000:2.0:1782759573.215139:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218548480 00000100:00100000:2.0:1782759573.215301:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3256 00000100:00100000:2.0:1782759573.215310:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218548480:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759573.215339:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218548480:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759573.215352:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3256 00000100:00100000:1.0:1782759573.215567:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+2:2401:x1869355218548992:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 615us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759573.216081:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1091 00000100:00080000:1.0:1782759573.216107:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759573.216111:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759573.216114:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759573.216116:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759573.333559:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759574.353382:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759575.370755:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759575.441165:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232964224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759575.441312:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759575.441535:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964224 00000100:00100000:0.0:1782759575.441544:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964224 00000100:00100000:0.0:1782759575.441620:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3317 00000100:00100000:0.0:1782759575.441630:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232964224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759575.441662:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:0.0:1782759575.441708:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232964224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759575.441714:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3317 00000100:00100000:0.0:1782759575.441760:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232964224:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1782759576.141056:0:152072:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd91859130 20000000:00000080:3.0:1782759576.141083:0:152072:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4540400 uarg=0000000000000000 00010000:00010000:3.0:1782759576.142292:0:152072:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759576.142312:0:152072:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759576.142335:0:152072:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759576.142346:0:152072:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759576.142366:0:152072:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759576.142386:0:152072:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759576.142404:0:152072:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759576.142413:0:152072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759576.142453:0:152072:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759576.142467:0:152072:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 23 pid: 6526 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759576.142482:0:152072:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152072:1869355232964352:0@lo:104: 00000100:00100000:3.0:1782759576.142547:0:152072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759576.142826:0:152072:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759576.143252:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964352 00000100:00100000:1.0:1782759576.143260:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964352 00000100:00100000:1.0:1782759576.143345:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:1.0:1782759576.143355:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:152072:x1869355232964352:12345-0@lo:104: 00010000:00010000:1.0:1782759576.143369:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.143437:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759576.143456:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:152072:x1869355232964352:12345-0@lo:104: Request processed in 103us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759576.143462:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1782759576.143532:0:152072:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152072:1869355232964352:0@lo:104: 00010000:00010000:2.0:1782759576.143553:0:152072:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759576.143621:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759576.143629:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759576.143636:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759576.143640:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759576.143650:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759576.143657:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759576.143663:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759576.143723:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759576.143731:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759576.143756:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759576.143763:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d023 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d02a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759576.143781:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759576.143783:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759576.143785:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759576.143796:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232964480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759576.143832:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759576.144336:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964480 00000100:00100000:1.0:1782759576.144342:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964480 00010000:00010000:1.0:1782759576.144362:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 24 pid: 6526 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759576.144424:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1782759576.144432:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232964480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759576.144445:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759576.144450:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 24 pid: 6526 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144461:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 24 pid: 6526 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144474:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d02a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d023 expref: 24 pid: 6526 timeout: 3766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144487:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144495:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144507:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144515:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144533:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144539:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144544:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759576.144548:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.144555:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759576.145037:0:152072:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759576.145047:0:152072:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.146481:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.146496:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d031 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759576.146515:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759576.146619:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232964480:12345-0@lo:103:ldlm_bl.0 Request processed in 2185us (2783us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759576.146628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:2.0:1782759576.147665:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232964480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759576.395533:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759576.458838:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232964864:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.458896:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.458951:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232965376:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.458975:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.458993:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232965888:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.459014:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759576.459061:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232964992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.459094:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759576.459133:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232965504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.459180:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964992 00000100:00100000:3.0:1782759576.459187:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964992 00000100:00100000:3.0:1782759576.459243:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00000100:00100000:3.0:1782759576.459249:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232964992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.459292:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232964992:12345-0@lo:400:kworker.0 Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759576.459297:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00000100:00100000:3.0:1782759576.459327:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964864 00000100:00100000:3.0:1782759576.459329:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964864 00000100:00100000:3.0:1782759576.459347:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5146 00000100:00100000:3.0:1782759576.459350:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232964864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.459369:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232964864:12345-0@lo:400:kworker.0 Request processed in 19us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759576.459373:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5146 00000100:00100000:0.0:1782759576.459433:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232964608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459454:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759576.459468:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232965120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459480:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759576.459491:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232965632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459502:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759576.459521:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964608 00000100:00100000:0.0:1782759576.459523:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964608 00000100:00100000:0.0:1782759576.459537:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965120 00000100:00100000:0.0:1782759576.459538:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965120 00000100:00100000:0.0:1782759576.459552:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965632 00000100:00100000:0.0:1782759576.459553:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965632 00000100:00100000:0.0:1782759576.459564:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5147 00000100:00100000:0.0:1782759576.459567:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232964608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459624:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232964608:12345-0@lo:400:kworker.0 Request processed in 56us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759576.459629:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5147 00000100:00100000:0.0:1782759576.459639:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5148 00000100:00100000:0.0:1782759576.459642:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232965120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459656:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232965120:12345-0@lo:400:kworker.0 Request processed in 14us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759576.459660:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5148 00000100:00100000:0.0:1782759576.459665:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5149 00000100:00100000:0.0:1782759576.459669:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232965632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459681:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232965632:12345-0@lo:400:kworker.0 Request processed in 13us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759576.459685:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5149 00000100:00100000:0.0:1782759576.459731:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232964608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459736:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232965120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759576.459741:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232965632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460299:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232964864:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460310:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782759576.460317:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232964736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460344:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.460364:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232965248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460380:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.460396:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232965760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460408:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.460425:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965248 00000100:00100000:2.0:1782759576.460428:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965248 00000100:00100000:2.0:1782759576.460446:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965760 00000100:00100000:2.0:1782759576.460448:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965760 00000100:00100000:2.0:1782759576.460465:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5150 00000100:00100000:2.0:1782759576.460469:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232965248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460493:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232965248:12345-0@lo:400:kworker.0 Request processed in 24us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759576.460497:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5150 00000100:00100000:2.0:1782759576.460505:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5151 00000100:00100000:2.0:1782759576.460509:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232965760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.460522:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355232965760:12345-0@lo:400:kworker.0 Request processed in 14us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759576.460526:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5151 00000100:00100000:2.0:1782759576.460536:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759576.460619:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759576.460622:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759576.460628:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232964736 00000100:00100000:1.0:1782759576.460631:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232964736 00000100:00100000:1.0:1782759576.460657:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:1.0:1782759576.460661:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232964736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759576.460704:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232964736:12345-0@lo:400:kworker.0 Request processed in 43us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759576.460708:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00000100:00100000:3.0:1782759576.463489:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965376 00000100:00100000:3.0:1782759576.463501:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965376 00000100:00100000:3.0:1782759576.463562:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965888 00000100:00100000:3.0:1782759576.463565:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965888 00000100:00100000:3.0:1782759576.463608:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232965504 00000100:00100000:3.0:1782759576.463612:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232965504 00000100:00100000:3.0:1782759576.463637:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:3.0:1782759576.463645:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232965376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.463715:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232965376:12345-0@lo:400:kworker.0 Request processed in 70us (4737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759576.463721:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000100:00100000:3.0:1782759576.463737:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1782759576.463755:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232965888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.463800:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232965888:12345-0@lo:400:kworker.0 Request processed in 58us (4786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759576.463807:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:3.0:1782759576.463819:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:3.0:1782759576.463824:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232965504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.463850:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232965504:12345-0@lo:400:kworker.0 Request processed in 26us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759576.463855:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00080000:3.0:1782759576.463872:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759576.463876:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759576.464517:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232964736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.464531:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232965248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.464542:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355232965760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.464551:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232965376:0@lo:400:kworker.0 00000100:00100000:3.0:1782759576.464560:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232965888:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.464735:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232965504:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.464745:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232966016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.464784:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.464824:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232964992:0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.464859:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966016 00000100:00100000:2.0:1782759576.464863:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966016 00000100:00100000:2.0:1782759576.464901:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:2.0:1782759576.464995:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232966016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759576.465048:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232966016:12345-0@lo:400:kworker.0 Request processed in 56us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759576.465055:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:2.0:1782759576.465236:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232966016:0@lo:400:kworker.0 00000100:00080000:3.0:1782759576.465302:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759576.971289:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759576.971322:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232966144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759576.971417:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759576.971501:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966144 00000100:00100000:3.0:1782759576.971510:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966144 00000100:00100000:3.0:1782759576.971569:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:2.0:1782759576.971631:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759576.971644:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232966272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759576.971695:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759576.971739:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966272 00000100:00100000:2.0:1782759576.971743:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966272 00000100:00100000:2.0:1782759576.971789:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1782759576.971798:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232966272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759576.971837:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759576.971895:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232966272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759576.971903:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1782759576.971957:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232966272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759576.972236:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232966144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759576.972250:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759576.972317:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232966144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 739us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759576.972324:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:2.0:1782759576.972473:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232966144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759577.418948:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759577.738702:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759577.738710:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759577.738715:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759577.738771:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759577.738784:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759577.738814:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759577.738841:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232966400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759577.738911:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759577.739059:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966400 00000100:00100000:3.0:1782759577.739067:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966400 00000100:00100000:2.0:1782759577.739147:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759577.739314:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:3.0:1782759577.739324:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232966400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759577.739339:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759577.739353:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d038 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759577.739375:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759577.739386:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759577.739395:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5a00, rc 0) 00000100:00100000:3.0:1782759577.739482:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232966400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759577.739488:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:2.0:1782759577.739599:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232966400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759577.739613:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759577.739622:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759577.739640:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759577.739645:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759577.739652:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759577.994851:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232966528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759577.994923:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759577.995055:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232966656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759577.995089:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759577.995152:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759577.995158:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232966784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759577.995206:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966656 00000100:00100000:0.0:1782759577.995213:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966656 00000100:00100000:2.0:1782759577.995321:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966528 00000100:00100000:2.0:1782759577.995325:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966528 00000100:00100000:2.0:1782759577.995365:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1782759577.995375:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232966528:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759577.995500:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1782759577.995708:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759577.995748:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232966528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 376us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759577.995755:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1782759577.995768:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966784 00000100:00100000:2.0:1782759577.995771:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966784 00000100:00100000:2.0:1782759577.995791:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2667 00000100:00100000:2.0:1782759577.995796:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232966784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759577.995805:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759577.995827:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232966784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759577.995833:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2667 00000100:00100000:1.0:1782759577.995964:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232966528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759577.995998:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232966784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759577.996143:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:0.0:1782759577.996158:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232966656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759577.996182:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759577.996223:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232966656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759577.996229:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00100000:2.0:1782759577.996321:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232966656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759578.337627:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759578.337667:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759578.337700:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759578.337729:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759578.337755:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218549248 00000100:00100000:1.0:1782759578.337763:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218549248 00000100:00100000:1.0:1782759578.337810:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218549376 00000100:00100000:1.0:1782759578.337812:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218549376 00000100:00100000:1.0:1782759578.337830:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5152 00000100:00100000:1.0:1782759578.337837:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218549248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759578.337902:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218549248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759578.337910:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5152 00000100:00100000:1.0:1782759578.337940:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5153 00000100:00100000:1.0:1782759578.337948:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218549376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759578.337974:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218549376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759578.337981:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5153 00000100:00100000:3.0:1782759578.338047:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218549504 00000100:00100000:3.0:1782759578.338051:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218549504 00000100:00100000:3.0:1782759578.338083:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2977 00000100:00100000:3.0:1782759578.338091:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218549504:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759578.338119:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218549504:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759578.338126:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2977 00000100:00080000:3.0:1782759578.338158:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759578.338163:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759578.338164:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759578.338736:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218549120 00000100:00100000:0.0:1782759578.338741:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218549120 00000100:00100000:0.0:1782759578.338779:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3258 00000100:00100000:0.0:1782759578.338786:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218549120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759578.340451:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218549120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1658us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759578.340462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3258 00010000:00010000:1.0:1782759578.443109:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782759578.516066:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759578.516076:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc4925800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:1.0:1782759578.516209:0:62521:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc4925800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:1.0:1782759578.516260:0:62521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc4922800 for lustre-OST0001 00010000:00010000:3.0:1782759579.469795:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759580.497080:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759580.556357:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232966912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759580.556472:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759580.556701:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232966912 00000100:00100000:0.0:1782759580.556713:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232966912 00000100:00100000:0.0:1782759580.556795:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:0.0:1782759580.556806:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232966912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759580.556853:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:0.0:1782759580.556934:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232966912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759580.556942:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00000100:00100000:1.0:1782759580.557417:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3e3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232966912:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759581.514693:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759581.584779:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232967040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.584872:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.584930:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232967552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.584959:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.584989:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232968064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.585014:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.585029:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232968576:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.585511:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.585625:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782759581.585633:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232967424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.585672:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.585692:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232967936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.585718:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.585734:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232968448:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.585756:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.585937:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232967168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.585963:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.585997:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232967680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.586022:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.586058:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232968192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.586087:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.586103:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759581.586108:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232967296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.586134:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.586149:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232967808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.586167:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.586179:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232968320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.586198:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759581.586230:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967040 00000100:00100000:3.0:1782759581.586238:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967040 00000100:00100000:3.0:1782759581.586293:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3259 00000100:00100000:3.0:1782759581.586302:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232967040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.587205:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232967040:12345-0@lo:400:kworker.0 Request processed in 899us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759581.587216:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3259 00000100:00100000:3.0:1782759581.587261:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967552 00000100:00100000:3.0:1782759581.587266:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967552 00000100:00100000:3.0:1782759581.587311:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967296 00000100:00100000:3.0:1782759581.587313:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967296 00000100:00100000:3.0:1782759581.587442:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322 00000100:00100000:3.0:1782759581.587905:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232967552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.587958:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232967552:12345-0@lo:400:kworker.0 Request processed in 59us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759581.587965:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322 00000100:00100000:3.0:1782759581.587991:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:3.0:1782759581.587998:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232967296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.588113:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232967296:12345-0@lo:400:kworker.0 Request processed in 43us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759581.588121:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00000100:00100000:1.0:1782759581.588763:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967424 00000100:00100000:1.0:1782759581.588771:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967424 00000100:00100000:1.0:1782759581.588803:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967168 00000100:00100000:1.0:1782759581.588806:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967168 00000100:00100000:1.0:1782759581.588817:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967680 00000100:00100000:1.0:1782759581.588820:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967680 00000100:00100000:1.0:1782759581.588848:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968192 00000100:00100000:1.0:1782759581.588850:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968192 00000100:00100000:1.0:1782759581.588863:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967808 00000100:00100000:1.0:1782759581.588866:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967808 00000100:00100000:1.0:1782759581.588877:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968320 00000100:00100000:1.0:1782759581.588880:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968320 00000100:00100000:1.0:1782759581.588903:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5154 00000100:00100000:1.0:1782759581.588910:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232967424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759581.588962:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232967424:12345-0@lo:400:kworker.0 Request processed in 53us (3291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759581.588970:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5154 00000100:00100000:1.0:1782759581.589032:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5155 00000100:00100000:1.0:1782759581.589049:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232967168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759581.589094:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232967168:12345-0@lo:400:kworker.0 Request processed in 55us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759581.589100:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5155 00000100:00100000:1.0:1782759581.589119:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5156 00000100:00100000:1.0:1782759581.589125:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232967680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759581.589156:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232967680:12345-0@lo:400:kworker.0 Request processed in 30us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759581.589161:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5156 00000100:00100000:1.0:1782759581.589172:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5157 00000100:00100000:1.0:1782759581.589177:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232968192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759581.589203:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232968192:12345-0@lo:400:kworker.0 Request processed in 27us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759581.589207:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5157 00000100:00100000:1.0:1782759581.589216:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5158 00000100:00100000:1.0:1782759581.589220:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232967808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759581.589246:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232967808:12345-0@lo:400:kworker.0 Request processed in 25us (3078us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759581.589250:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5158 00000100:00100000:1.0:1782759581.589259:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5159 00000100:00100000:1.0:1782759581.589264:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232968320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759581.589288:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232968320:12345-0@lo:400:kworker.0 Request processed in 24us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759581.589294:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5159 00000100:00080000:1.0:1782759581.589344:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759581.589349:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759581.590163:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968064 00000100:00100000:0.0:1782759581.590171:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968064 00000100:00100000:0.0:1782759581.590227:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968576 00000100:00100000:0.0:1782759581.590230:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968576 00000100:00100000:0.0:1782759581.590242:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232967936 00000100:00100000:0.0:1782759581.590244:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232967936 00000100:00100000:0.0:1782759581.590272:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968448 00000100:00100000:0.0:1782759581.590275:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968448 00000100:00100000:0.0:1782759581.590293:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:0.0:1782759581.590300:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232968064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759581.590351:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232968064:12345-0@lo:400:kworker.0 Request processed in 52us (5336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759581.590357:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00100000:0.0:1782759581.590369:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00080000:1.0:1782759581.590397:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759581.590400:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759581.590611:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232968576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759581.590642:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232968576:12345-0@lo:400:kworker.0 Request processed in 267us (5132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759581.590647:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:0.0:1782759581.590657:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2980 00000100:00100000:0.0:1782759581.590662:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232967936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759581.590683:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232967936:12345-0@lo:400:kworker.0 Request processed in 21us (4964us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759581.590687:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2980 00000100:00100000:0.0:1782759581.590694:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2981 00000100:00100000:0.0:1782759581.590699:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232968448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759581.590718:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232968448:12345-0@lo:400:kworker.0 Request processed in 19us (4962us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759581.590722:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2981 00000100:00100000:3.0:1782759581.591913:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232967296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.591933:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232967808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.591945:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232968320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.591958:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232967168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.591969:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232967680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.591993:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232968192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592063:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232967424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592081:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232967936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592096:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232968448:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592107:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232967040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592124:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232967552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592137:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232968064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759581.592148:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232968576:0@lo:400:kworker.0 02000000:00000400:2.0:1782759581.598397:0:152268:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0001_int: flush entry ffff8cddc4bd1400: key 500, ref 0, fl 0, cur 1782759581, ex 3625/4795 00000100:00100000:1.0:1782759581.664432:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759581.664636:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218549760 00000100:00100000:2.0:1782759581.664646:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218549760 00000100:00100000:2.0:1782759581.664755:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2963 00000100:00100000:2.0:1782759581.664766:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:110163:x1869355218549760:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:2.0:1782759581.664788:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759581.664812:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d046 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274d4 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665003:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 3/0,1 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665018:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665043:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665055:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665063:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665070:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759581.665104:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00010000:00010000:2.0:1782759581.665119:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665127:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665133:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665139:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665145:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759581.665150:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665296:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665321:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34fd000) 00010000:00010000:2.0:1782759581.665325:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759581.665329:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 3/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665336:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d04d lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665350:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665356:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665362:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665367:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759581.665370:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665376:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665382:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xe065f617 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759581.665384:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759581.665386:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665392:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d054 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665432:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d046 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274d4 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665442:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34fd000) 00010000:00010000:2.0:1782759581.665445:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759581.665448:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d046 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274d4 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.665458:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759581.665513:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:110163:x1869355218549760:12345-192.168.202.31@tcp:101:touch.500 Request processed in 749us (1092us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759581.665523:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2963 00000100:00080000:1.0:1782759581.667837:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759581.670058:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759581.676515:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218550016 00000100:00100000:1.0:1782759581.676529:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218550016 00000100:00100000:1.0:1782759581.676615:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2964 00000100:00100000:1.0:1782759581.676624:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:110163:x1869355218550016:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:1.0:1782759581.676644:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759581.676664:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d05b lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274db expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.676815:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.676828:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.676839:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.676851:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.676857:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.676863:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678281:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d070 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678297:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d070 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678322:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d070 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759581.678337:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x20:0x0]: returning size 0 00010000:00010000:1.0:1782759581.678442:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678450:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678456:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678464:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678470:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759581.678474:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678481:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678493:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cdf02149e00) 00010000:00010000:1.0:1782759581.678496:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759581.678499:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678505:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d062 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678517:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678529:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678535:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678540:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759581.678543:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678549:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678556:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xe065f617 (ffff8cdf02149000) 00010000:00010000:1.0:1782759581.678558:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759581.678561:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.678567:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d069 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0xe065f617 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.681229:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d05b lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274db expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.681259:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d070 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274db expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759581.681268:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:1.0:1782759581.681271:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759581.681282:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428800, rc 0) 00000100:00100000:1.0:1782759581.681405:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3e3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:110163:x1869355218550016:12345-192.168.202.31@tcp:101:touch.500 Request processed in 4781us (11354us total) trans 4294967722 rc 0/0 00000100:00100000:1.0:1782759581.681415:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2964 00000100:00100000:2.0:1782759581.704386:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759581.704429:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218550272 00000100:00100000:2.0:1782759581.704438:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218550272 00000100:00100000:2.0:1782759581.704494:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2965 00000100:00100000:2.0:1782759581.704505:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:110163:x1869355218550272:12345-192.168.202.31@tcp:36:touch.500 00010000:00010000:2.0:1782759581.704568:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759581.704613:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d070 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274db expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.704630:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:2.0:1782759581.704642:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759581.704696:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,1 mode: --/PW res: [0x240000405:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.704720:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.704729:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759581.704842:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cde47d05 reply state 00000000b044c879 transno 4294967723 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.704855:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759581.704862:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc34fd000) 00010000:00010000:2.0:1782759581.704865:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759581.704867:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759581.706936:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:110163:x1869355218550272:12345-192.168.202.31@tcp:36:touch.500 Request processed in 2427us (2553us total) trans 4294967723 rc 0/0 00000100:00100000:2.0:1782759581.706947:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2965 00000100:00100000:2.0:1782759581.720692:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759581.720770:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218550400 00000100:00100000:3.0:1782759581.720780:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218550400 00000100:00100000:3.0:1782759581.720826:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1092 00000100:00100000:3.0:1782759581.720835:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1869355218550400:12345-192.168.202.31@tcp:8:touch.500 00010000:00080000:3.0:1782759581.720890:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp t0 exp 0000000000000000 cur 3621 last 0 00000020:00000080:3.0:1782759581.720925:0:8446:0:(genops.c:1406:class_connect()) connect: client e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0, cookie 0xd5b45c7f5c60d085 00002000:00100000:3.0:1782759581.720937:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0/ffff8cddc5421000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782759581.720956:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782759581.721044:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782759581.721075:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cddc5427800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759581.721151:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2401:x1869355218550400:12345-192.168.202.31@tcp:8:touch.500 Request processed in 314us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759581.721159:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1092 00000100:00100000:2.0:1782759581.724950:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759581.725174:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218550528 00000100:00100000:3.0:1782759581.725184:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218550528 00000100:00100000:3.0:1782759581.725256:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1093 00000100:00100000:3.0:1782759581.725267:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:0:x1869355218550528:12345-192.168.202.31@tcp:2:touch.500 00000100:00080000:2.0:1782759581.725660:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1782759581.732422:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967412 is committed 00000001:00100000:0.0:1782759581.732438:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000100:00100000:3.0:1782759581.746794:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:0:x1869355218550528:12345-192.168.202.31@tcp:2:touch.500 Request processed in 21517us (21841us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1782759581.746808:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1093 00000100:00100000:2.0:1782759581.749234:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759581.749300:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218550784 00000100:00100000:3.0:1782759581.749310:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218550784 00000100:00100000:3.0:1782759581.749362:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 345 00000100:00100000:3.0:1782759581.749370:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:110163:x1869355218550784:12345-192.168.202.31@tcp:35:touch.500 00000100:00100000:3.0:1782759581.749556:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:110163:x1869355218550784:12345-192.168.202.31@tcp:35:touch.500 Request processed in 187us (329us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1782759581.749564:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 345 00000100:00100000:2.0:1782759582.090783:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759582.090804:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232968704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759582.090872:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759582.090943:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968704 00000100:00100000:2.0:1782759582.090950:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968704 00000100:00100000:2.0:1782759582.091014:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1782759582.091024:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232968704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759582.091060:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759582.091105:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232968704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759582.091113:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2668 00000100:00100000:2.0:1782759582.091134:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232968832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759582.091221:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759582.091266:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232968704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759582.091299:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968832 00000100:00100000:3.0:1782759582.091310:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968832 00000100:00100000:3.0:1782759582.091347:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:3.0:1782759582.091354:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232968832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759582.091366:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759582.091403:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232968832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759582.091409:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:2.0:1782759582.092037:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232968832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759582.538807:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 02000000:00000400:3.0:1782759582.613308:0:152316:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0001_int: flush entry ffff8cddc449f800: key 500, ref 0, fl 0, cur 1782759582, ex 3651/4821 00000100:00100000:1.0:1782759582.645490:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759582.645558:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218551040 00000100:00100000:2.0:1782759582.645567:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218551040 00000100:00100000:2.0:1782759582.645721:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2966 00000100:00100000:2.0:1782759582.645772:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:110199:x1869355218551040:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:2.0:1782759582.645796:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759582.645824:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d08c lrc: 2/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274e2 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646013:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646028:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646055:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646069:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646088:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646095:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646154:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d0a1 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646163:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d0a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646170:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d0a1 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759582.646181:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x22:0x0]: returning size 0 00010000:00010000:2.0:1782759582.646257:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646265:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646271:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646278:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646284:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759582.646288:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646306:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646318:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759582.646321:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759582.646325:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646331:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d093 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646342:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646347:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646353:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646357:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759582.646360:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646365:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646370:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0xaeae4fd0 (ffff8cddc34fdd00) 00010000:00010000:2.0:1782759582.646373:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759582.646375:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646385:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d09a lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0xaeae4fd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646425:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d08c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x1d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274e2 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646438:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d0a1 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274e2 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759582.646445:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:2.0:1782759582.646447:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759582.646449:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759582.646502:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:110199:x1869355218551040:12345-192.168.202.31@tcp:101:touch.500 Request processed in 773us (1024us total) trans 4294967725 rc 0/0 00000100:00100000:2.0:1782759582.646509:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2966 00000100:00100000:2.0:1782759582.654037:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759582.654460:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218551296 00000100:00100000:1.0:1782759582.654470:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218551296 00000100:00100000:1.0:1782759582.654527:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2967 00000100:00100000:1.0:1782759582.654536:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:110199:x1869355218551296:12345-192.168.202.31@tcp:36:touch.500 00010000:00010000:1.0:1782759582.654612:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759582.654638:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d0a1 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274e2 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759582.654655:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:1.0:1782759582.654665:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759582.654712:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,1 mode: --/PW res: [0x240000405:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759582.654724:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759582.654734:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759582.654838:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1eb7ffd reply state 0000000033cfd5da transno 4294967726 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759582.654848:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759582.654866:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cdf02149000) 00010000:00010000:1.0:1782759582.654868:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759582.654870:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759582.655106:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:110199:x1869355218551296:12345-192.168.202.31@tcp:36:touch.500 Request processed in 568us (1076us total) trans 4294967726 rc 0/0 00000100:00100000:1.0:1782759582.655114:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2967 00000100:00100000:2.0:1782759582.664788:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759582.666235:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218551424 00000100:00100000:3.0:1782759582.666248:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218551424 00000100:00100000:3.0:1782759582.666314:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1094 00000100:00100000:3.0:1782759582.666325:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218551424:12345-192.168.202.31@tcp:2:touch.500 00000100:00100000:3.0:1782759582.666536:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218551424:12345-192.168.202.31@tcp:2:touch.500 Request processed in 212us (1757us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1782759582.666543:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1094 00000100:00080000:2.0:1782759582.666674:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759582.668720:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759582.668799:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218551680 00000100:00100000:3.0:1782759582.668807:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218551680 00000100:00100000:3.0:1782759582.668862:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 346 00000100:00100000:3.0:1782759582.668872:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:110199:x1869355218551680:12345-192.168.202.31@tcp:35:touch.500 00000100:00100000:3.0:1782759582.669254:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:110199:x1869355218551680:12345-192.168.202.31@tcp:35:touch.500 Request processed in 381us (540us total) trans 4294967727 rc 0/0 00000100:00100000:3.0:1782759582.669263:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 346 00000100:00100000:3.0:1782759583.114777:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232968960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759583.114842:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759583.114891:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759583.114903:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232969088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759583.114928:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759583.114958:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232968960 00000100:00100000:3.0:1782759583.114979:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232968960 00000100:00100000:3.0:1782759583.115023:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969088 00000100:00100000:3.0:1782759583.115025:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969088 00000100:00100000:3.0:1782759583.115045:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1782759583.115053:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232968960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759583.115083:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759583.115127:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232968960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759583.115134:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1782759583.115151:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:3.0:1782759583.115258:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232969088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759583.115269:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759583.115294:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232969088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759583.115299:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00080000:3.0:1782759583.115317:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759583.115408:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232969088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759583.115420:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232968960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759583.116058:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232969216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759583.116095:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759583.116131:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969216 00000100:00100000:2.0:1782759583.116136:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969216 00000100:00100000:2.0:1782759583.116197:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:2.0:1782759583.116206:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232969216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759583.116231:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1782759583.116274:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232969216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759583.116280:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00000100:00100000:2.0:1782759583.116311:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232969216:0@lo:41:osp-pre-1-0.0 02000000:00000400:2.0:1782759583.392492:0:152364:0:(upcall_cache.c:555:upcall_cache_flush_one()) lustre-MDT0001_int: flush entry ffff8cddc4f24600: key 500, ref 0, fl 0, cur 1782759583, ex 3652/4822 00000100:00100000:2.0:1782759583.459672:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759583.459708:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759583.459733:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759583.459755:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759583.459778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759583.459809:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218552064 00000100:00100000:2.0:1782759583.459818:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218552064 00000100:00100000:2.0:1782759583.459872:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218551936 00000100:00100000:2.0:1782759583.459876:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218551936 00000100:00100000:1.0:1782759583.460176:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218551808 00000100:00100000:1.0:1782759583.460182:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218551808 00000100:00100000:1.0:1782759583.460212:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3260 00000100:00100000:1.0:1782759583.460222:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218551808:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759583.460293:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218551808:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759583.460301:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3260 00000100:00100000:2.0:1782759583.460413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5160 00000100:00100000:2.0:1782759583.460431:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:2404:x1869355218552064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759583.460471:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:2404:x1869355218552064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 52us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759583.460478:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5160 00000100:00100000:2.0:1782759583.460492:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5161 00000100:00100000:2.0:1782759583.460500:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218551936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759583.460525:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218551936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759583.460531:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5161 00000100:00100000:2.0:1782759583.460549:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218552320 00000100:00100000:2.0:1782759583.460553:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218552320 00000100:00100000:2.0:1782759583.462699:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218552192 00000100:00100000:2.0:1782759583.462709:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218552192 00000100:00100000:2.0:1782759583.462746:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2982 00000100:00100000:2.0:1782759583.462756:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218552320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759583.462822:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218552320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 69us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759583.462829:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2982 00000100:00100000:2.0:1782759583.462842:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2983 00000100:00100000:2.0:1782759583.462849:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218552192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759583.462869:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218552192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 21us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759583.462875:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2983 00000100:00080000:2.0:1782759583.462969:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759583.462976:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759583.462979:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759583.575163:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759584.586661:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759584.849493:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759584.849997:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218552576 00000100:00100000:3.0:1782759584.850007:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218552576 00000100:00100000:3.0:1782759584.850067:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2968 00000100:00100000:3.0:1782759584.850079:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:110271:x1869355218552576:12345-192.168.202.31@tcp:101:cat.500 00010000:00010000:3.0:1782759584.850099:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759584.850128:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d0b6 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274e9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850260:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850274:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850288:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759584.850299:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00010000:00010000:3.0:1782759584.850326:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850333:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850340:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850346:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759584.850351:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850358:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850369:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759584.850372:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759584.850376:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850388:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d0bd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850423:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d0b6 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274e9 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850434:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc34f4200) 00010000:00010000:3.0:1782759584.850436:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759584.850439:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d0b6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274e9 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759584.850450:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:3.0:1782759584.851292:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:110271:x1869355218552576:12345-192.168.202.31@tcp:101:cat.500 Request processed in 1212us (1803us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759584.851301:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2968 00000100:00100000:2.0:1782759584.873570:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759584.874725:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218552832 00000100:00100000:0.0:1782759584.874738:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218552832 00000100:00100000:0.0:1782759584.874801:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2969 00000100:00100000:0.0:1782759584.874811:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:110271:x1869355218552832:12345-192.168.202.31@tcp:101:cat.500 00010000:00010000:0.0:1782759584.874832:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759584.874855:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d0c4 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274f0 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759584.875008:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d0cb lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759584.875022:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d0cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759584.875035:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d0cb lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759584.875046:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1e:0x0]: returning size 3 00010000:00010000:0.0:1782759584.875158:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d0c4 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x1d:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274f0 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759584.875179:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d0cb lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274f0 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759584.875189:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc3502400) 00010000:00010000:0.0:1782759584.875192:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759584.875195:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166c600, rc 0) 00000100:00100000:0.0:1782759584.875264:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:110271:x1869355218552832:12345-192.168.202.31@tcp:101:cat.500 Request processed in 454us (1705us total) trans 4294967728 rc 0/0 00000100:00100000:0.0:1782759584.875281:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2969 00000100:00100000:2.0:1782759584.885270:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759584.885312:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759584.885342:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553216 00000100:00100000:2.0:1782759584.885351:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553216 00000100:00100000:2.0:1782759584.885411:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 407 00000100:00100000:2.0:1782759584.885421:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2402:x1869355218553216:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759584.885436:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759584.885459:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d0cb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274f0 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759584.885488:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1e:0x0].0x0 (ffff8cddc3502400) 00010000:00010000:2.0:1782759584.885499:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759584.885548:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2402:x1869355218553216:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 128us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759584.885570:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 407 00000100:00100000:1.0:1782759584.885936:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553088 00000100:00100000:1.0:1782759584.885941:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553088 00000100:00100000:1.0:1782759584.885985:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 347 00000100:00100000:1.0:1782759584.885992:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:110271:x1869355218553088:12345-192.168.202.31@tcp:35:cat.500 00000100:00100000:1.0:1782759584.886256:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:110271:x1869355218553088:12345-192.168.202.31@tcp:35:cat.500 Request processed in 263us (994us total) trans 4294967729 rc 0/0 00000100:00100000:1.0:1782759584.886263:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 347 00010000:00010000:0.0:1782759585.617186:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759585.681219:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232969344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759585.681305:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759585.681810:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969344 00000100:00100000:2.0:1782759585.681819:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969344 00000100:00100000:2.0:1782759585.681897:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:2.0:1782759585.681906:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232969344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759585.681952:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:2.0:1782759585.682012:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232969344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759585.682019:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:1.0:1782759585.682102:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232969344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759586.636487:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759586.699300:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232969600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.699462:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759586.699662:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232969728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.699700:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759586.699755:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232970240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.699787:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969728 00000100:00100000:2.0:1782759586.699796:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969728 00000100:00100000:2.0:1782759586.699882:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:2.0:1782759586.699892:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232969728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.699978:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232969728:12345-0@lo:400:kworker.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759586.699986:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:2.0:1782759586.700029:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232969856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701213:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232969472:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701270:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759586.701308:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232969984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701335:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759586.701355:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232970496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701381:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759586.701399:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232971008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701434:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759586.701475:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969984 00000100:00100000:0.0:1782759586.701481:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969984 00000100:00100000:0.0:1782759586.701532:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:0.0:1782759586.701541:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232969984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701627:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232969984:12345-0@lo:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759586.701635:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000100:00100000:0.0:1782759586.701658:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970496 00000100:00100000:0.0:1782759586.701662:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970496 00000100:00100000:0.0:1782759586.701701:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971008 00000100:00100000:0.0:1782759586.701703:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971008 00000100:00100000:0.0:1782759586.701725:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2984 00000100:00100000:0.0:1782759586.701730:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232970496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701773:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232970496:12345-0@lo:400:kworker.0 Request processed in 43us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759586.701778:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2984 00000100:00100000:0.0:1782759586.701789:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2985 00000100:00100000:0.0:1782759586.701794:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232971008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701814:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232971008:12345-0@lo:400:kworker.0 Request processed in 20us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759586.701819:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2985 00000100:00100000:0.0:1782759586.701862:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232969984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701872:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232970496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.701879:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232971008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.702299:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969472 00000100:00100000:3.0:1782759586.702305:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969472 00000100:00100000:3.0:1782759586.702673:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:3.0:1782759586.702684:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232969472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.702740:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232969472:12345-0@lo:400:kworker.0 Request processed in 57us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759586.702746:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00100000:3.0:1782759586.702810:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232970112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.702857:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759586.702881:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232970624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.702904:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782759586.703748:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759586.703757:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759586.704494:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969600 00000100:00100000:2.0:1782759586.704508:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969600 00000100:00100000:2.0:1782759586.704625:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970112 00000100:00100000:2.0:1782759586.704629:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970112 00000100:00100000:2.0:1782759586.704661:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970624 00000100:00100000:2.0:1782759586.704664:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970624 00000100:00100000:2.0:1782759586.704696:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5162 00000100:00100000:2.0:1782759586.704708:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232969600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.704805:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232969600:12345-0@lo:400:kworker.0 Request processed in 100us (5343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759586.704813:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5162 00000100:00100000:2.0:1782759586.704831:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5163 00000100:00100000:2.0:1782759586.704839:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232970112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.704869:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232970112:12345-0@lo:400:kworker.0 Request processed in 32us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759586.704875:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5163 00000100:00100000:2.0:1782759586.704886:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5164 00000100:00100000:2.0:1782759586.704894:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232970624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.704923:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232970624:12345-0@lo:400:kworker.0 Request processed in 31us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759586.704929:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5164 00000100:00080000:2.0:1782759586.705142:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759586.705188:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232969600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.705203:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5645500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232970112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.705214:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232970624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.705275:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759586.705308:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc5645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232970368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.705346:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759586.705364:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232970880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.705385:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759586.705412:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232969856 00000100:00100000:2.0:1782759586.705416:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232969856 00000100:00100000:2.0:1782759586.705443:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5165 00000100:00100000:2.0:1782759586.705450:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232969856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.705723:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970368 00000100:00100000:3.0:1782759586.705729:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970368 00000100:00100000:3.0:1782759586.705769:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970880 00000100:00100000:3.0:1782759586.705772:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970880 00000100:00100000:3.0:1782759586.705796:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2986 00000100:00100000:3.0:1782759586.705804:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232970368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.705846:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232970368:12345-0@lo:400:kworker.0 Request processed in 43us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759586.705853:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2986 00000100:00100000:3.0:1782759586.705866:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2987 00000100:00100000:3.0:1782759586.705872:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232970880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.705898:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232970880:12345-0@lo:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759586.705903:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2987 00000100:00100000:3.0:1782759586.705925:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759586.706803:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232970752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.706856:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759586.706902:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232969728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.707005:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232969856:12345-0@lo:400:kworker.0 Request processed in 1555us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759586.707016:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5165 00000100:00100000:2.0:1782759586.707037:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970240 00000100:00100000:2.0:1782759586.707043:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970240 00000100:00100000:2.0:1782759586.707070:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232970752 00000100:00100000:2.0:1782759586.707072:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232970752 00000100:00100000:2.0:1782759586.707095:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5166 00000100:00100000:2.0:1782759586.707103:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232970240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759586.707528:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5167 00000100:00100000:0.0:1782759586.707540:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232970752:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782759586.708014:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759586.708021:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759586.708024:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759586.708072:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232969856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.708102:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5645180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232970368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759586.708117:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232970880:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.711068:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232970240:12345-0@lo:400:kworker.0 Request processed in 3950us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759586.711088:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5166 00000100:00100000:0.0:1782759586.713970:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232970752:12345-0@lo:400:kworker.0 Request processed in 6395us (7074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759586.713989:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5167 00000100:00100000:0.0:1782759586.714111:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232969472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.724106:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc5647800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232970240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759586.724405:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232970752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759587.212223:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759587.212249:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232971136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759587.212369:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232971264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759587.212416:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759587.212548:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971136 00000100:00100000:1.0:1782759587.212573:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971136 00000100:00100000:1.0:1782759587.212732:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1782759587.212744:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232971136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759587.212789:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759587.212875:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232971136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759587.212883:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1782759587.295297:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759587.295336:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232971136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759587.296305:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971264 00000100:00100000:3.0:1782759587.296316:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971264 00000100:00100000:3.0:1782759587.296379:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2673 00000100:00100000:3.0:1782759587.296389:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232971264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759587.296417:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759587.296514:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232971264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759587.296522:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2673 00000100:00100000:0.0:1782759587.296639:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232971264:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759587.658766:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759587.731649:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967729 is committed 00010000:00010000:0.0:1782759587.741293:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741319:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741354:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741361:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759587.741366:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741374:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741398:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x20:0x0].0x0 (ffff8cddc34fd000) 00010000:00010000:0.0:1782759587.741402:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759587.741407:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741413:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d07e lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x20:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741460:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741467:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741473:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741478:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759587.741481:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741501:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741511:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x22:0x0].0x0 (ffff8cdf02149000) 00010000:00010000:0.0:1782759587.741513:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759587.741517:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759587.741523:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d0af lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x22:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759588.236410:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759588.236443:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232971392:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759588.236546:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759588.236656:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971392 00000100:00100000:0.0:1782759588.236666:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971392 00000100:00100000:0.0:1782759588.236735:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2674 00000100:00100000:0.0:1782759588.236747:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232971392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759588.236793:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759588.236852:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232971392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759588.236861:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2674 00000100:00080000:3.0:1782759588.237003:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759588.237081:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759588.237095:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232971520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759588.237134:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759588.237427:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971520 00000100:00100000:3.0:1782759588.237433:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971520 00000100:00100000:3.0:1782759588.237483:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:3.0:1782759588.237492:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232971520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759588.237506:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759588.237546:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232971520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759588.237552:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00080000:1.0:1782759588.237631:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759588.237662:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232971520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759588.237740:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232971392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759588.238375:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232971648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759588.238423:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759588.246407:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971648 00000100:00100000:3.0:1782759588.246428:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971648 00000100:00100000:3.0:1782759588.246540:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:3.0:1782759588.246551:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232971648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759588.246621:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759588.246725:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232971648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (8301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759588.246743:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:1.0:1782759588.247413:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232971648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759588.578800:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759588.578857:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759588.578899:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759588.578941:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759588.578974:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759588.579010:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553344 00000100:00100000:2.0:1782759588.579022:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553344 00000100:00100000:2.0:1782759588.579111:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3262 00000100:00100000:2.0:1782759588.579124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218553344:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759588.579327:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218553344:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 205us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759588.579336:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3262 00000100:00100000:2.0:1782759588.579378:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553472 00000100:00100000:2.0:1782759588.579383:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553472 00000100:00100000:2.0:1782759588.579430:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553600 00000100:00100000:2.0:1782759588.579433:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553600 00000100:00100000:2.0:1782759588.579457:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5168 00000100:00100000:2.0:1782759588.579466:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218553472:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759588.579502:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218553472:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759588.579509:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5168 00000100:00100000:2.0:1782759588.579521:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5169 00000100:00100000:2.0:1782759588.579530:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218553600:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759588.579628:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218553600:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759588.579635:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5169 00000100:00100000:2.0:1782759588.579654:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553728 00000100:00100000:2.0:1782759588.579658:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553728 00000100:00100000:2.0:1782759588.579689:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553856 00000100:00100000:2.0:1782759588.579691:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553856 00000100:00100000:2.0:1782759588.579711:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2988 00000100:00100000:2.0:1782759588.579718:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218553728:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759588.579744:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218553728:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759588.579750:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2988 00000100:00100000:2.0:1782759588.579760:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2989 00000100:00100000:2.0:1782759588.579767:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218553856:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759588.579788:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218553856:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759588.579794:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2989 00000100:00080000:2.0:1782759588.582670:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759588.582680:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759588.582684:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759588.582688:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782759588.732317:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782759588.750937:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967423 is committed 00010000:00010000:3.0:1782759589.774814:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759590.802091:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232971776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759590.804793:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759590.804908:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759590.804928:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971776 00000100:00100000:1.0:1782759590.804940:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971776 00000100:00100000:1.0:1782759590.805022:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:1.0:1782759590.805032:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232971776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759590.805071:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759590.805145:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232971776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759590.805359:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:1.0:1782759590.805412:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232971776:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759591.826638:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759591.826961:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232972288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827025:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827090:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232972800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827115:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827131:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232973312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827148:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827181:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782759591.827188:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232971904:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827215:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827234:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232972416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827267:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827285:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232972928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827303:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827315:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232973440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827331:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827351:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232972032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827369:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827383:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232972544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827398:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827410:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232973056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827425:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827439:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759591.827443:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232972160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827462:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827476:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232972672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827492:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827513:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232973184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827531:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759591.827559:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972288 00000100:00100000:2.0:1782759591.827565:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972288 00000100:00100000:2.0:1782759591.827632:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972032 00000100:00100000:2.0:1782759591.827635:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972032 00000100:00100000:2.0:1782759591.827647:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972544 00000100:00100000:2.0:1782759591.827650:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972544 00000100:00100000:2.0:1782759591.827670:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973056 00000100:00100000:2.0:1782759591.827672:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973056 00000100:00100000:2.0:1782759591.827684:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972672 00000100:00100000:2.0:1782759591.827686:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972672 00000100:00100000:2.0:1782759591.827696:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973184 00000100:00100000:2.0:1782759591.827698:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973184 00000100:00100000:2.0:1782759591.827713:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5170 00000100:00100000:2.0:1782759591.827722:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232972288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827773:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232972288:12345-0@lo:400:kworker.0 Request processed in 52us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.827781:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5170 00000100:00100000:2.0:1782759591.827798:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5171 00000100:00100000:2.0:1782759591.827805:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232972032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827834:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232972032:12345-0@lo:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.827840:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5171 00000100:00100000:2.0:1782759591.827851:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5172 00000100:00100000:2.0:1782759591.827858:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232972544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827882:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232972544:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.827913:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5172 00000100:00100000:2.0:1782759591.827924:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5173 00000100:00100000:2.0:1782759591.827930:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232973056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827953:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232973056:12345-0@lo:400:kworker.0 Request processed in 24us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.827957:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5173 00000100:00100000:2.0:1782759591.827965:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5174 00000100:00100000:2.0:1782759591.827970:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232972672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.827990:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232972672:12345-0@lo:400:kworker.0 Request processed in 21us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.827994:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5174 00000100:00100000:2.0:1782759591.828002:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5175 00000100:00100000:2.0:1782759591.828008:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232973184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828031:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232973184:12345-0@lo:400:kworker.0 Request processed in 23us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828035:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5175 00000100:00100000:2.0:1782759591.828054:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972800 00000100:00100000:2.0:1782759591.828057:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972800 00000100:00100000:2.0:1782759591.828078:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973312 00000100:00100000:2.0:1782759591.828081:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973312 00000100:00100000:2.0:1782759591.828090:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972928 00000100:00100000:2.0:1782759591.828091:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972928 00000100:00100000:2.0:1782759591.828100:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973440 00000100:00100000:2.0:1782759591.828101:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973440 00000100:00100000:2.0:1782759591.828112:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2990 00000100:00100000:2.0:1782759591.828117:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232972800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828150:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232972800:12345-0@lo:400:kworker.0 Request processed in 33us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828155:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2990 00000100:00100000:2.0:1782759591.828165:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2991 00000100:00100000:2.0:1782759591.828171:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232973312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828189:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232973312:12345-0@lo:400:kworker.0 Request processed in 20us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828194:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2991 00000100:00100000:2.0:1782759591.828201:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2992 00000100:00100000:2.0:1782759591.828205:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232972928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828226:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232972928:12345-0@lo:400:kworker.0 Request processed in 21us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828230:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2992 00000100:00100000:2.0:1782759591.828237:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2993 00000100:00100000:2.0:1782759591.828242:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232973440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828260:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232973440:12345-0@lo:400:kworker.0 Request processed in 19us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828266:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2993 00000100:00100000:2.0:1782759591.828285:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232971904 00000100:00100000:2.0:1782759591.828288:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232971904 00000100:00100000:2.0:1782759591.828309:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:2.0:1782759591.828314:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232971904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828339:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232971904:12345-0@lo:400:kworker.0 Request processed in 25us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828344:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:2.0:1782759591.828377:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972416 00000100:00100000:2.0:1782759591.828380:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972416 00000100:00100000:2.0:1782759591.828417:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232972160 00000100:00100000:2.0:1782759591.828419:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232972160 00000100:00100000:2.0:1782759591.828429:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:2.0:1782759591.828434:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232972416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828460:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232972416:12345-0@lo:400:kworker.0 Request processed in 26us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828466:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00100000:2.0:1782759591.828474:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:2.0:1782759591.828480:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232972160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828499:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232972160:12345-0@lo:400:kworker.0 Request processed in 20us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759591.828505:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00000100:00080000:2.0:1782759591.828542:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759591.828546:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759591.828549:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759591.828551:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759591.828608:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232972160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828619:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232972672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828628:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232973184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828638:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232972032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828647:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232972544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828656:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232973056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828703:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232971904:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828722:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232972416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828732:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232972928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828742:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232973440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828751:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232972288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828760:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232972800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759591.828768:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232973312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759592.334148:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759592.334183:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232973568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759592.334254:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759592.334400:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973568 00000100:00100000:1.0:1782759592.334409:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973568 00000100:00100000:1.0:1782759592.334473:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:1.0:1782759592.334484:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232973568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759592.334514:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759592.334562:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232973568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759592.334569:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:2.0:1782759592.334634:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232973568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759592.335215:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759592.335227:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232973696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759592.335281:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759592.336805:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973696 00000100:00100000:2.0:1782759592.336817:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973696 00000100:00100000:2.0:1782759592.336881:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:2.0:1782759592.337054:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232973696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759592.337076:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759592.337148:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232973696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759592.337206:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232973696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759592.337598:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00010000:00010000:0.0:1782759592.855794:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759593.354720:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759593.354744:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232973824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759593.354912:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759593.355080:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973824 00000100:00100000:1.0:1782759593.355090:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973824 00000100:00100000:1.0:1782759593.355150:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:1.0:1782759593.355159:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232973824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759593.355193:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759593.355242:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232973824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759593.355249:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:1.0:1782759593.355312:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232973824:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759593.355507:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759593.355785:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232974080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759593.355823:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759593.355897:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974080 00000100:00100000:0.0:1782759593.355908:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974080 00000100:00100000:0.0:1782759593.355953:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:0.0:1782759593.355961:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232974080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759593.355995:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759593.356033:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232974080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759593.356040:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00080000:0.0:1782759593.356090:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759593.356114:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232974080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759593.359723:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759593.359765:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232973952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759593.359884:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759593.364614:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232973952 00000100:00100000:3.0:1782759593.364629:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232973952 00000100:00100000:3.0:1782759593.364707:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3332 00000100:00100000:3.0:1782759593.364718:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232973952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759593.364763:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759593.364872:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232973952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 156us (4998us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759593.364889:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3332 00000100:00100000:2.0:1782759593.365216:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232973952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759593.698818:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759593.698854:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759593.698893:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759593.698918:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759593.698955:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759593.698984:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554496 00000100:00100000:2.0:1782759593.698993:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554496 00000100:00100000:2.0:1782759593.699075:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554368 00000100:00100000:2.0:1782759593.699078:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554368 00000100:00100000:2.0:1782759593.699106:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2994 00000100:00100000:2.0:1782759593.699116:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218554496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759593.699192:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218554496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759593.699200:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2994 00000100:00100000:2.0:1782759593.699217:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2995 00000100:00100000:2.0:1782759593.699225:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218554368:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759593.699250:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218554368:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759593.699256:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2995 00000100:00100000:2.0:1782759593.699273:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554240 00000100:00100000:2.0:1782759593.699277:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554240 00000100:00100000:2.0:1782759593.699305:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554112 00000100:00100000:2.0:1782759593.699307:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554112 00000100:00100000:2.0:1782759593.699329:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5176 00000100:00100000:2.0:1782759593.699337:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218554240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759593.699364:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218554240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759593.699380:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5176 00000100:00100000:2.0:1782759593.699392:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5177 00000100:00100000:2.0:1782759593.699399:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218554112:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759593.699426:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218554112:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759593.699433:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5177 00000100:00080000:2.0:1782759593.699452:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759593.699457:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759593.699459:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759593.699461:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759593.699945:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218553984 00000100:00100000:3.0:1782759593.699950:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218553984 00000100:00100000:3.0:1782759593.699990:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3264 00000100:00100000:3.0:1782759593.699997:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218553984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759593.700032:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218553984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759593.700039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3264 00010000:00010000:1.0:1782759593.873973:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759593.902472:0:152608:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7b552bb0 20000000:00000080:1.0:1782759593.902488:0:152608:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecf3e5000 uarg=0000000000000000 00010000:00010000:0.0:1782759593.906965:0:152608:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759593.906989:0:152608:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759593.907010:0:152608:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759593.907021:0:152608:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759593.907044:0:152608:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759593.907063:0:152608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.907080:0:152608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.907088:0:152608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.907125:0:152608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.907140:0:152608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 23 pid: 6524 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759593.907171:0:152608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152608:1869355232974208:0@lo:104: 00000100:00100000:0.0:1782759593.907232:0:152608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759593.907280:0:152608:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759593.907333:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974208 00000100:00100000:2.0:1782759593.907339:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974208 00000100:00100000:2.0:1782759593.907393:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1782759593.907402:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:152608:x1869355232974208:12345-0@lo:104: 00010000:00010000:2.0:1782759593.907414:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759593.907473:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759593.907479:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:152608:x1869355232974208:12345-0@lo:104: Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759593.907485:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00010000:00010000:1.0:1782759593.907531:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759593.907537:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907545:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759593.907548:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907557:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759593.907564:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759593.907570:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759593.907627:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907634:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759593.907651:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907658:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60d038 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d03f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907674:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759593.907681:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759593.907683:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759593.907694:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232974336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759593.907721:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759593.907756:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974336 00000100:00100000:1.0:1782759593.907760:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974336 00010000:00010000:1.0:1782759593.907778:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 24 pid: 6524 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759593.907799:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1782759593.907805:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232974336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759593.907815:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759593.907819:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 24 pid: 6524 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907829:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 24 pid: 6524 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907846:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907853:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907863:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907880:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907886:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907900:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907906:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ce00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759593.907910:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907918:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907926:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759593.907935:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759593.907964:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232974336:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759593.907971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1782759593.908008:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232974336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759593.908612:0:152608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5a00/0xd5b45c7f5c60d03f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d038 expref: 23 pid: 6524 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759593.908623:0:152608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152608:1869355232974208:0@lo:104: 00010000:00010000:0.0:1782759593.908635:0:152608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.908645:0:152608:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.908651:0:152608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759593.908657:0:152608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166ce00/0xd5b45c7f5c60d0d9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759594.891769:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759595.339667:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759595.339677:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759595.339683:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759595.339735:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759595.339747:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759595.339767:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759595.339795:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232974464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759595.339875:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759595.339930:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759595.348649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974464 00000100:00100000:3.0:1782759595.348666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974464 00000100:00100000:3.0:1782759595.348813:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1782759595.348824:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232974464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759595.348846:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759595.348880:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d0e0 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759595.348932:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759595.348946:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759595.348955:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:3.0:1782759595.349057:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232974464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (9181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759595.349064:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3265 00000100:00100000:3.0:1782759595.349132:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232974464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759595.349153:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759595.349164:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759595.349191:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759595.349197:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759595.349205:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759595.915002:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759595.915186:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232974592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759595.915269:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759595.915650:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974592 00000100:00100000:1.0:1782759595.915658:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974592 00000100:00100000:1.0:1782759595.915721:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333 00000100:00100000:1.0:1782759595.915732:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232974592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759595.915785:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:1.0:1782759595.915839:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232974592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759595.915846:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333 00000100:00100000:2.0:1782759595.916107:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232974592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759596.943158:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232974720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943254:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943311:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232975232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943336:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943364:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232975744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943395:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943414:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232976256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943434:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943457:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782759596.943463:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232975104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943487:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943532:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232975616:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943558:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943593:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232976128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759596.943632:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975232 00000100:00100000:3.0:1782759596.943641:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975232 00000100:00100000:1.0:1782759596.943648:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943681:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232974848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943707:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759596.943711:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334 00000100:00100000:3.0:1782759596.943720:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232975232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943724:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232975360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943743:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943758:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232975872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943778:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943795:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759596.943797:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232975232:12345-0@lo:400:kworker.0 Request processed in 78us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759596.943800:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232974976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759596.943804:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334 00000100:00100000:1.0:1782759596.943818:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943852:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232975488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943876:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759596.943902:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232976000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.943923:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759596.943931:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975104 00000100:00100000:3.0:1782759596.943934:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975104 00010000:00010000:1.0:1782759596.943950:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759596.943954:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974848 00000100:00100000:3.0:1782759596.943957:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974848 00000100:00100000:1.0:1782759596.943960:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975744 00000100:00100000:1.0:1782759596.943963:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975744 00000100:00100000:3.0:1782759596.943967:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975360 00000100:00100000:3.0:1782759596.943969:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975360 00000100:00100000:1.0:1782759596.943996:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976256 00000100:00100000:1.0:1782759596.943999:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976256 00000100:00100000:2.0:1782759596.944033:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974720 00000100:00100000:2.0:1782759596.944041:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974720 00000100:00100000:2.0:1782759596.944084:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3266 00000100:00100000:2.0:1782759596.944092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232974720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.944128:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232974720:12345-0@lo:400:kworker.0 Request processed in 38us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.944134:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3266 00000100:00100000:2.0:1782759596.944964:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975872 00000100:00100000:2.0:1782759596.944971:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975872 00000100:00100000:2.0:1782759596.944992:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975488 00000100:00100000:2.0:1782759596.944995:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975488 00000100:00100000:2.0:1782759596.945020:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976000 00000100:00100000:2.0:1782759596.945023:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976000 00000100:00100000:2.0:1782759596.945043:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5178 00000100:00100000:2.0:1782759596.945053:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232975104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.945109:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232975104:12345-0@lo:400:kworker.0 Request processed in 58us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.945130:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5178 00000100:00100000:2.0:1782759596.945146:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5179 00000100:00100000:2.0:1782759596.945153:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232974848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.945199:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232974848:12345-0@lo:400:kworker.0 Request processed in 46us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.945205:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5179 00000100:00100000:2.0:1782759596.945217:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5180 00000100:00100000:2.0:1782759596.945224:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232975360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.945251:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232975360:12345-0@lo:400:kworker.0 Request processed in 28us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.945255:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5180 00000100:00100000:2.0:1782759596.945267:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5181 00000100:00100000:2.0:1782759596.945273:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232975872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.945297:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232975872:12345-0@lo:400:kworker.0 Request processed in 25us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.945301:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5181 00000100:00100000:2.0:1782759596.945310:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5182 00000100:00100000:2.0:1782759596.945316:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232975488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.945341:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232975488:12345-0@lo:400:kworker.0 Request processed in 26us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.945346:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5182 00000100:00100000:2.0:1782759596.945356:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5183 00000100:00100000:2.0:1782759596.945363:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232976000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759596.945401:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232976000:12345-0@lo:400:kworker.0 Request processed in 40us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759596.945413:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5183 00000100:00100000:3.0:1782759596.947158:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232975488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759596.947179:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232976000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759596.947192:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232974848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759596.947203:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232975360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759596.947214:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232975872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.956252:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232975616 00000100:00100000:1.0:1782759596.956268:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232975616 00000100:00100000:1.0:1782759596.956291:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976128 00000100:00100000:1.0:1782759596.956294:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976128 00000100:00100000:1.0:1782759596.956321:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1782759596.956331:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232975744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759596.956425:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232975744:12345-0@lo:400:kworker.0 Request processed in 96us (13028us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759596.956433:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2996 00000100:00100000:1.0:1782759596.956796:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:1.0:1782759596.956805:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232976256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.960754:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1782759596.960775:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232975616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.960890:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232975616:12345-0@lo:400:kworker.0 Request processed in 123us (17329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759596.960897:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2998 00000100:00100000:0.0:1782759596.960920:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2999 00000100:00100000:0.0:1782759596.960928:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232976128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.961185:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232976128:12345-0@lo:400:kworker.0 Request processed in 257us (17535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759596.961196:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2999 00000100:00100000:0.0:1782759596.963527:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232974976 00000100:00100000:0.0:1782759596.963542:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232974976 00000100:00100000:0.0:1782759596.963662:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335 00000100:00100000:0.0:1782759596.963673:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232974976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.963781:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232974976:12345-0@lo:400:kworker.0 Request processed in 109us (19960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759596.963789:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335 00000100:00100000:0.0:1782759596.964042:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232975104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.964063:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232975616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.964076:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232976128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.964088:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232974720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.964103:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232975232:0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.964189:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232975744:0@lo:400:kworker.0 00000100:00080000:0.0:1782759596.965727:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759596.965738:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759596.965741:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759596.965804:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759596.967356:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232976256:12345-0@lo:400:kworker.0 Request processed in 10539us (23906us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759596.967373:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2997 00000100:00100000:0.0:1782759596.967448:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232976256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759596.967664:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232974976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759597.454169:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759597.454194:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232976384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759597.454269:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759597.454338:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976384 00000100:00100000:2.0:1782759597.454345:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976384 00000100:00100000:2.0:1782759597.454419:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1782759597.454429:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232976384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759597.454458:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759597.454502:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232976384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759597.454510:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2680 00000100:00100000:2.0:1782759597.454558:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232976384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759597.458784:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759597.458809:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232976512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759597.458902:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759597.459082:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976512 00000100:00100000:2.0:1782759597.459089:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976512 00000100:00100000:2.0:1782759597.459146:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:2.0:1782759597.459157:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232976512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759597.459181:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759597.459227:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232976512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759597.459234:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:2.0:1782759597.459282:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232976512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759597.962795:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759598.474988:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232976640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759598.475068:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759598.475480:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759598.475490:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232976768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759598.475531:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759598.475534:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232976896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759598.475560:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976640 00000100:00100000:3.0:1782759598.475564:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759598.475568:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976640 00000100:00100000:3.0:1782759598.475622:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976896 00000100:00100000:3.0:1782759598.475626:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976896 00000100:00100000:1.0:1782759598.475633:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232976768 00000100:00100000:1.0:1782759598.475636:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232976768 00000100:00100000:1.0:1782759598.475657:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1782759598.475665:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232976640:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759598.475666:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:3.0:1782759598.475672:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232976896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759598.475698:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00002000:00000024:1.0:1782759598.475698:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759598.475743:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232976896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759598.475743:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232976640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759598.475751:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:1.0:1782759598.475751:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:1.0:1782759598.475768:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:1.0:1782759598.475774:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232976768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759598.475784:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759598.475807:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232976768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759598.475812:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1782759598.475819:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232976896:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1782759598.475830:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759598.475873:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232976768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759598.475888:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232976640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759598.815243:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759598.815288:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759598.815316:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759598.815347:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759598.815370:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759598.815438:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554624 00000100:00100000:3.0:1782759598.815448:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554624 00000100:00100000:3.0:1782759598.815503:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3267 00000100:00100000:3.0:1782759598.815512:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218554624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759598.815620:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218554624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 107us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759598.815630:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3267 00000100:00100000:0.0:1782759598.817302:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554880 00000100:00100000:0.0:1782759598.817315:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554880 00000100:00100000:0.0:1782759598.817404:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218554752 00000100:00100000:0.0:1782759598.817424:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218554752 00000100:00100000:0.0:1782759598.817458:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5184 00000100:00100000:0.0:1782759598.817467:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218554880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759598.817538:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218554880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759598.817546:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5184 00000100:00100000:0.0:1782759598.817562:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5185 00000100:00100000:0.0:1782759598.817568:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218554752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759598.817612:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218554752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759598.817618:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5185 00000100:00100000:0.0:1782759598.817637:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555136 00000100:00100000:0.0:1782759598.817640:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555136 00000100:00100000:0.0:1782759598.817669:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555008 00000100:00100000:0.0:1782759598.817672:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555008 00000100:00100000:0.0:1782759598.817696:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3000 00000100:00100000:0.0:1782759598.817702:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218555136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759598.817730:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218555136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759598.817736:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3000 00000100:00080000:2.0:1782759598.817884:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759598.817889:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759598.817892:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759598.817894:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759598.818013:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3001 00000100:00100000:0.0:1782759598.818022:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218555008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759598.818050:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218555008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759598.818057:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3001 00010000:00010000:2.0:1782759598.989847:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759600.011136:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759601.042346:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759601.042372:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232977024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759601.042444:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759601.042506:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977024 00000100:00100000:0.0:1782759601.042513:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977024 00000100:00100000:0.0:1782759601.042571:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1782759601.042601:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232977024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759601.042634:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:0.0:1782759601.042677:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232977024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759601.042685:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1782759601.042726:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232977024:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759601.050944:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759602.062522:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232977152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.062621:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.062694:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977152 00000100:00100000:0.0:1782759602.062701:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977152 00000100:00100000:0.0:1782759602.062767:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:0.0:1782759602.062777:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232977152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.062840:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232977152:12345-0@lo:400:kworker.0 Request processed in 65us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.062848:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00100000:0.0:1782759602.062896:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232977152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.062945:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232977280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.062975:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.063005:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977280 00000100:00100000:0.0:1782759602.063019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977280 00000100:00100000:0.0:1782759602.063046:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5186 00000100:00100000:0.0:1782759602.063052:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232977280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063088:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355232977280:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.063094:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5186 00000100:00100000:0.0:1782759602.063124:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355232977280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063158:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232977408:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063198:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.063229:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977408 00000100:00100000:0.0:1782759602.063233:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977408 00000100:00100000:0.0:1782759602.063270:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1782759602.063277:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232977408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063312:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232977408:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.063318:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1782759602.063341:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232977408:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063366:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232977536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063401:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.063428:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977536 00000100:00100000:0.0:1782759602.063431:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977536 00000100:00100000:0.0:1782759602.063452:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5187 00000100:00100000:0.0:1782759602.063457:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232977536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063487:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232977536:12345-0@lo:400:kworker.0 Request processed in 29us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.063501:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5187 00000100:00100000:0.0:1782759602.063527:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232977536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063569:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232977664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063614:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.063638:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977664 00000100:00100000:0.0:1782759602.063641:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977664 00000100:00100000:0.0:1782759602.063663:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1782759602.063668:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232977664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063698:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232977664:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.063704:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1782759602.063727:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232977664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063754:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232977792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063777:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.063800:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977792 00000100:00100000:0.0:1782759602.063814:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977792 00000100:00100000:0.0:1782759602.063849:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5188 00000100:00100000:0.0:1782759602.063854:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232977792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063888:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355232977792:12345-0@lo:400:kworker.0 Request processed in 33us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.063894:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5188 00000100:00080000:0.0:1782759602.063910:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759602.063932:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355232977792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063963:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232977920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.063994:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.064017:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232977920 00000100:00100000:0.0:1782759602.064020:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232977920 00000100:00100000:0.0:1782759602.064046:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5189 00000100:00100000:0.0:1782759602.064051:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232977920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064082:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232977920:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.064088:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5189 00000100:00080000:0.0:1782759602.064100:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759602.064120:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232977920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064149:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232978048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064172:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.064201:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978048 00000100:00100000:0.0:1782759602.064205:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978048 00000100:00100000:0.0:1782759602.064236:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3002 00000100:00100000:0.0:1782759602.064243:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232978048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064276:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232978048:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.064282:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3002 00000100:00080000:0.0:1782759602.064295:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759602.064315:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232978048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064344:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232978176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064365:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.064390:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978176 00000100:00100000:0.0:1782759602.064393:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978176 00000100:00100000:0.0:1782759602.064418:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3003 00000100:00100000:0.0:1782759602.064431:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232978176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064471:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232978176:12345-0@lo:400:kworker.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.064476:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3003 00000100:00080000:0.0:1782759602.064488:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759602.064509:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232978176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064537:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232978304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064560:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.064606:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978304 00000100:00100000:0.0:1782759602.064610:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978304 00000100:00100000:0.0:1782759602.064637:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5190 00000100:00100000:0.0:1782759602.064642:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232978304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064675:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355232978304:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.064680:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5190 00000100:00080000:0.0:1782759602.064693:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759602.064711:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355232978304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064740:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232978432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064764:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.064793:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978432 00000100:00100000:0.0:1782759602.064796:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978432 00000100:00100000:0.0:1782759602.064852:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5191 00000100:00100000:0.0:1782759602.064858:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232978432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064890:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232978432:12345-0@lo:400:kworker.0 Request processed in 33us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.064904:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5191 00000100:00080000:0.0:1782759602.064916:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759602.064937:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232978432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064965:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232978560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.064988:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.065011:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978560 00000100:00100000:0.0:1782759602.065015:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978560 00000100:00100000:0.0:1782759602.065041:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3004 00000100:00100000:0.0:1782759602.065046:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232978560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.065079:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232978560:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.065085:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3004 00000100:00080000:0.0:1782759602.065098:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759602.065115:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232978560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.065146:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232978688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.065169:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759602.065191:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978688 00000100:00100000:0.0:1782759602.065194:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978688 00000100:00100000:0.0:1782759602.065218:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3005 00000100:00100000:0.0:1782759602.065223:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232978688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759602.065252:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232978688:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759602.065257:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3005 00000100:00080000:0.0:1782759602.065268:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759602.065286:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232978688:0@lo:400:kworker.0 00010000:00010000:2.0:1782759602.065836:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759602.335442:0:152852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffedb340d50 20000000:00000080:1.0:1782759602.335462:0:152852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc54cdc00 uarg=0000000000000000 00010000:00010000:1.0:1782759602.337168:0:152852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759602.338058:0:152852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759602.338089:0:152852:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759602.338117:0:152852:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759602.338142:0:152852:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759602.338160:0:152852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759602.338289:0:152852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759602.338299:0:152852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759602.338341:0:152852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759602.338355:0:152852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 23 pid: 6524 timeout: 3792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759602.338369:0:152852:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152852:1869355232978816:0@lo:104: 00000100:00100000:1.0:1782759602.338436:0:152852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759602.338501:0:152852:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759602.338881:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978816 00000100:00100000:2.0:1782759602.338890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978816 00000100:00100000:2.0:1782759602.338963:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1782759602.338975:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:152852:x1869355232978816:12345-0@lo:104: 00010000:00010000:2.0:1782759602.338989:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.339060:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759602.339066:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:152852:x1869355232978816:12345-0@lo:104: Request processed in 95us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759602.339073:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00010000:00010000:2.0:1782759602.339095:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759602.339101:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.339108:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759602.339113:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.339137:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759602.339144:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759602.339149:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759602.339194:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.339201:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759602.339218:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.339225:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649800/0xd5b45c7f5c60d0e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d0e7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.339244:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759602.339246:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759602.339248:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759602.339467:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232978944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759602.339505:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759602.339627:0:152852:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152852:1869355232978816:0@lo:104: 00010000:00010000:3.0:1782759602.339647:0:152852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759602.342074:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232978944 00000100:00100000:2.0:1782759602.342087:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232978944 00010000:00010000:2.0:1782759602.342138:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 24 pid: 6524 timeout: 3792 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759602.342188:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1782759602.342198:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232978944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759602.342213:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759602.342218:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 24 pid: 6524 timeout: 3792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342242:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 24 pid: 6524 timeout: 3792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342260:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60d0e7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0e0 expref: 24 pid: 6524 timeout: 3792 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342277:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342285:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342300:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342307:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342313:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342319:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342325:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759602.342329:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342336:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342357:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759602.342369:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759602.342449:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232978944:12345-0@lo:103:ldlm_bl.0 Request processed in 253us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759602.342457:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00010000:00010000:3.0:1782759602.342666:0:152852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759602.342676:0:152852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759602.342683:0:152852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d0ee lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759602.343724:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232978944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759602.572688:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759602.572721:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232979072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759602.572807:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759602.573081:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759602.573092:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232979200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759602.573121:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759602.573154:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979072 00000100:00100000:1.0:1782759602.573162:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979072 00000100:00100000:1.0:1782759602.573204:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979200 00000100:00100000:1.0:1782759602.573208:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979200 00000100:00100000:1.0:1782759602.573232:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1782759602.573240:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232979072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759602.573280:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759602.573321:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232979072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759602.573329:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:1.0:1782759602.573344:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1782759602.573350:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232979200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759602.573359:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759602.573383:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232979200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759602.573388:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2685 00000100:00100000:1.0:1782759602.573433:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232979200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759602.574076:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232979072:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759603.083847:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759603.594935:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759603.594966:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232979328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759603.595057:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759603.595128:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979328 00000100:00100000:1.0:1782759603.595136:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979328 00000100:00100000:1.0:1782759603.595189:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1782759603.595198:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232979328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759603.595232:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759603.595278:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232979328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759603.595285:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00100000:1.0:1782759603.595342:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232979328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759603.597991:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759603.598014:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232979456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759603.598098:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759603.599873:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979456 00000100:00100000:0.0:1782759603.599890:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979456 00000100:00100000:0.0:1782759603.599976:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1782759603.599986:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232979456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759603.600022:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759603.600119:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232979456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759603.600127:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:2.0:1782759603.600879:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232979456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759603.601080:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759603.601094:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232979584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759603.601146:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759603.601228:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979584 00000100:00100000:1.0:1782759603.601234:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979584 00000100:00100000:1.0:1782759603.601317:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00000100:00100000:1.0:1782759603.601326:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232979584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759603.601358:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1782759603.601405:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232979584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759603.601413:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00000100:00100000:1.0:1782759603.601446:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232979584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759603.937108:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759603.937154:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759603.937182:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759603.937206:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759603.937243:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759603.937272:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555520 00000100:00100000:2.0:1782759603.937281:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555520 00000100:00100000:2.0:1782759603.937335:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555392 00000100:00100000:2.0:1782759603.937342:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555392 00000100:00100000:2.0:1782759603.937366:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5192 00000100:00100000:2.0:1782759603.937385:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218555520:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759603.937461:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218555520:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759603.937467:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5192 00000100:00100000:2.0:1782759603.937484:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5193 00000100:00100000:2.0:1782759603.937491:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218555392:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759603.937513:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218555392:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759603.937519:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5193 00000100:00100000:2.0:1782759603.937536:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555648 00000100:00100000:2.0:1782759603.937539:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555648 00000100:00100000:2.0:1782759603.937561:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555776 00000100:00100000:2.0:1782759603.937563:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555776 00000100:00100000:2.0:1782759603.937603:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3006 00000100:00100000:2.0:1782759603.937611:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218555648:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759603.937636:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218555648:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759603.937641:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3006 00000100:00100000:2.0:1782759603.937651:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1095 00000100:00100000:2.0:1782759603.937658:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218555776:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:2.0:1782759603.937675:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60d085 00000100:00080000:2.0:1782759603.937684:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cddc5427800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759603.937733:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967412 00000100:00100000:2.0:1782759603.937881:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+2:2401:x1869355218555776:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 223us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759603.937887:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1095 00000100:00080000:2.0:1782759603.937907:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759603.937911:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759603.937914:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759603.937916:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782759603.938048:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759603.938116:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555264 00000100:00100000:0.0:1782759603.938122:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555264 00000100:00100000:0.0:1782759603.938164:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3269 00000100:00100000:0.0:1782759603.938171:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218555264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759603.938214:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218555264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759603.938220:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3269 00000020:00000080:3.0:1782759603.990501:0:152900:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb5fe2f60 20000000:00000080:3.0:1782759603.990526:0:152900:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4a12c00 uarg=0000000000000000 00010000:00010000:1.0:1782759603.992285:0:152900:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759603.992308:0:152900:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759603.992346:0:152900:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759603.992358:0:152900:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759603.992385:0:152900:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759603.992407:0:152900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992424:0:152900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992436:0:152900:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992443:0:152900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992450:0:152900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992457:0:152900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992484:0:152900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759603.992488:0:152900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992496:0:152900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992509:0:152900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992517:0:152900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759603.992523:0:152900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d0f5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759604.107922:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759604.409851:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759604.409858:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759604.409864:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759604.409914:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.409936:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.409948:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759604.409975:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232979712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759604.410047:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759604.410091:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc26296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759604.410205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979712 00000100:00100000:3.0:1782759604.410212:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979712 00000100:00100000:3.0:1782759604.410268:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1782759604.410277:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232979712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759604.410292:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759604.410306:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d0fc expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.410334:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.410346:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.410357:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759604.410395:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232979712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759604.410403:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1782759604.410460:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232979712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759604.410475:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.410485:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759604.410510:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759604.410515:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759604.410523:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.131819:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759605.200321:0:152948:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffbaa68630 20000000:00000080:0.0:1782759605.200342:0:152948:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3c59000 uarg=0000000000000000 00010000:00010000:0.0:1782759605.200512:0:152948:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759605.200529:0:152948:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759605.204225:0:152948:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759605.204246:0:152948:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759605.204268:0:152948:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759605.204302:0:152948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.204321:0:152948:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.204329:0:152948:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.204371:0:152948:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.204386:0:152948:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 23 pid: 6525 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759605.204401:0:152948:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152948:1869355232979840:0@lo:104: 00000100:00100000:0.0:1782759605.204465:0:152948:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759605.204525:0:152948:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759605.204907:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979840 00000100:00100000:3.0:1782759605.204916:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979840 00000100:00100000:3.0:1782759605.204977:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:3.0:1782759605.204987:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:152948:x1869355232979840:12345-0@lo:104: 00010000:00010000:3.0:1782759605.205001:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759605.205064:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759605.205071:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:152948:x1869355232979840:12345-0@lo:104: Request processed in 86us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759605.205078:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00010000:00010000:2.0:1782759605.205206:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759605.205214:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759605.205221:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759605.205225:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759605.205233:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759605.205241:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759605.205248:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759605.205283:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759605.205290:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759605.205312:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759605.205320:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d0fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d103 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759605.205346:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759605.205348:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759605.205349:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759605.205357:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759605.205370:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232979968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759605.205404:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759605.205501:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232979968 00000100:00100000:1.0:1782759605.205507:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232979968 00010000:00010000:1.0:1782759605.205531:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 24 pid: 6525 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759605.205573:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1782759605.205605:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232979968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759605.205616:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759605.205622:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 24 pid: 6525 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205632:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 24 pid: 6525 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205655:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205663:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205689:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205696:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205712:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205720:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205725:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759605.205729:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205736:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205744:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759605.205753:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759605.205797:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232979968:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759605.205809:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1782759605.205844:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232979968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759605.206232:0:152948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d103 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d0fc expref: 23 pid: 6525 timeout: 3795 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759605.206243:0:152948:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:152948:1869355232979840:0@lo:104: 00010000:00010000:0.0:1782759605.206258:0:152948:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.206267:0:152948:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.206274:0:152948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759605.206292:0:152948:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d10a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 152948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759606.158312:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759606.158336:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232980096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759606.158409:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759606.158491:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980096 00000100:00100000:3.0:1782759606.158499:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980096 00000100:00100000:3.0:1782759606.158565:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:3.0:1782759606.158590:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232980096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759606.158627:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:3.0:1782759606.158673:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232980096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759606.158680:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:3.0:1782759606.158741:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232980096:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759606.164230:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759606.603495:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759606.603508:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759606.603514:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759606.603609:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759606.603622:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759606.603633:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759606.603659:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232980224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759606.603747:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759606.603808:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2629780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759606.604150:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980224 00000100:00100000:2.0:1782759606.604158:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980224 00000100:00100000:2.0:1782759606.604223:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3271 00000100:00100000:2.0:1782759606.604232:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232980224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759606.604247:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759606.604261:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d111 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759606.604285:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759606.604296:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759606.604304:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759606.604354:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232980224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759606.604361:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3271 00000100:00100000:2.0:1782759606.604413:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232980224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759606.604428:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759606.604452:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759606.604472:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759606.604477:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759606.604483:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759607.179985:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759607.192141:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232980352:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192236:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192277:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232980864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192331:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192352:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232981376:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192376:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192392:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232981888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192415:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192439:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782759607.192445:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232980736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192472:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192489:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232981248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192510:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192526:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232981760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192547:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192573:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232980480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192626:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192643:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232980992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192665:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192682:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232981504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192702:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192719:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759607.192725:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232980608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192747:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192776:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232981120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192797:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192812:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232981632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.192842:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759607.192895:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980352 00000100:00100000:3.0:1782759607.192903:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980352 00000100:00100000:3.0:1782759607.192950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3272 00000100:00100000:3.0:1782759607.192960:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232980352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193009:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232980352:12345-0@lo:400:kworker.0 Request processed in 50us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193017:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3272 00000100:00100000:3.0:1782759607.193047:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980864 00000100:00100000:3.0:1782759607.193051:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980864 00000100:00100000:3.0:1782759607.193087:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980608 00000100:00100000:3.0:1782759607.193090:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980608 00000100:00100000:3.0:1782759607.193105:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3342 00000100:00100000:3.0:1782759607.193110:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232980864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193143:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232980864:12345-0@lo:400:kworker.0 Request processed in 32us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193150:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3342 00000100:00100000:3.0:1782759607.193162:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343 00000100:00100000:3.0:1782759607.193168:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232980608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193198:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232980608:12345-0@lo:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193205:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343 00000100:00100000:3.0:1782759607.193225:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981376 00000100:00100000:3.0:1782759607.193229:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981376 00000100:00100000:3.0:1782759607.193262:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981888 00000100:00100000:3.0:1782759607.193266:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981888 00000100:00100000:3.0:1782759607.193278:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981248 00000100:00100000:3.0:1782759607.193280:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981248 00000100:00100000:3.0:1782759607.193303:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981760 00000100:00100000:3.0:1782759607.193306:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981760 00000100:00100000:3.0:1782759607.193322:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3007 00000100:00100000:3.0:1782759607.193328:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232981376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193359:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232981376:12345-0@lo:400:kworker.0 Request processed in 32us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193366:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3007 00000100:00100000:3.0:1782759607.193377:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1782759607.193383:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232981888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193409:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232981888:12345-0@lo:400:kworker.0 Request processed in 26us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193415:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:3.0:1782759607.193425:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3009 00000100:00100000:3.0:1782759607.193431:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232981248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193456:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5647800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232981248:12345-0@lo:400:kworker.0 Request processed in 25us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193461:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3009 00000100:00100000:3.0:1782759607.193471:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1782759607.193478:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232981760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193502:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5645180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232981760:12345-0@lo:400:kworker.0 Request processed in 25us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193508:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3010 00000100:00100000:3.0:1782759607.193533:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980736 00000100:00100000:3.0:1782759607.193537:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980736 00000100:00100000:3.0:1782759607.193555:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980480 00000100:00100000:3.0:1782759607.193558:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980480 00000100:00100000:3.0:1782759607.193568:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232980992 00000100:00100000:3.0:1782759607.193602:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232980992 00000100:00100000:3.0:1782759607.193619:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981504 00000100:00100000:3.0:1782759607.193622:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981504 00000100:00100000:3.0:1782759607.193633:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981120 00000100:00100000:3.0:1782759607.193635:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981120 00000100:00100000:3.0:1782759607.193647:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232981632 00000100:00100000:3.0:1782759607.193650:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232981632 00000100:00100000:3.0:1782759607.193663:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5194 00000100:00100000:3.0:1782759607.193668:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232980736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193699:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232980736:12345-0@lo:400:kworker.0 Request processed in 30us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193704:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5194 00000100:00100000:3.0:1782759607.193716:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5195 00000100:00100000:3.0:1782759607.193721:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232980480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193746:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232980480:12345-0@lo:400:kworker.0 Request processed in 25us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193751:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5195 00000100:00100000:3.0:1782759607.193772:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5196 00000100:00100000:3.0:1782759607.193778:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232980992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193804:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232980992:12345-0@lo:400:kworker.0 Request processed in 25us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193809:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5196 00000100:00100000:3.0:1782759607.193820:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5197 00000100:00100000:3.0:1782759607.193825:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232981504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193849:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232981504:12345-0@lo:400:kworker.0 Request processed in 25us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193855:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5197 00000100:00100000:3.0:1782759607.193873:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5198 00000100:00100000:3.0:1782759607.193879:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232981120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193907:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232981120:12345-0@lo:400:kworker.0 Request processed in 28us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193913:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5198 00000100:00100000:3.0:1782759607.193923:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5199 00000100:00100000:3.0:1782759607.193928:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232981632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.193953:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232981632:12345-0@lo:400:kworker.0 Request processed in 25us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759607.193959:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5199 00000100:00080000:3.0:1782759607.193995:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759607.194000:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759607.194002:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759607.194004:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759607.194039:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232980608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194052:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232981120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194060:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232981632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194069:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232980480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194077:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232980992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194084:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232981504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194125:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232980736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194134:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232981248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194143:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232981760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194160:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232980352:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194170:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232980864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194179:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232981376:0@lo:400:kworker.0 00000100:00100000:3.0:1782759607.194189:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232981888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759607.691838:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759607.691871:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232982016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759607.691940:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759607.692021:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982016 00000100:00100000:1.0:1782759607.692028:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982016 00000100:00100000:1.0:1782759607.692072:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1782759607.692082:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232982016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759607.692114:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759607.692157:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232982016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759607.692163:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:1.0:1782759607.692206:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232982016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759607.695368:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232982144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759607.695443:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759607.706560:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982144 00000100:00100000:0.0:1782759607.706586:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982144 00000100:00100000:0.0:1782759607.706905:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:0.0:1782759607.706917:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232982144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759607.706945:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759607.707041:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232982144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (11599us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759607.707047:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:3.0:1782759607.707207:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232982144:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759608.203655:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759608.716343:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759608.716363:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232982272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759608.716427:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759608.716479:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982272 00000100:00100000:1.0:1782759608.716488:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982272 00000100:00100000:1.0:1782759608.716533:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1782759608.716542:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232982272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759608.716970:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759608.717023:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232982272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 481us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759608.717040:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1782759608.718669:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232982528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759608.719220:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759608.719236:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232982400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759608.719357:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759608.719439:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982400 00000100:00100000:0.0:1782759608.719447:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982400 00000100:00100000:1.0:1782759608.719666:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759608.719776:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232982272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759608.720781:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344 00000100:00100000:0.0:1782759608.720795:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232982400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759608.720834:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759608.720892:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232982400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759608.720900:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344 00000100:00100000:2.0:1782759608.733351:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232982400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759608.734044:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982528 00000100:00100000:0.0:1782759608.734052:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982528 00000100:00100000:0.0:1782759608.734105:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1782759608.734114:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232982528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759608.734149:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759608.734232:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232982528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (14565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759608.734251:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00100000:0.0:1782759608.734401:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232982528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759609.054972:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759609.055028:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759609.055063:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759609.055095:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759609.055124:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556160 00000100:00100000:2.0:1782759609.055134:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556160 00000100:00100000:2.0:1782759609.055203:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556032 00000100:00100000:2.0:1782759609.055207:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556032 00000100:00100000:2.0:1782759609.055234:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5200 00000100:00100000:2.0:1782759609.055245:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759609.055323:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759609.055336:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5200 00000100:00100000:2.0:1782759609.055375:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5201 00000100:00100000:0.0:1782759609.055493:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218555904 00000100:00100000:0.0:1782759609.055498:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218555904 00000100:00100000:0.0:1782759609.055528:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3273 00000100:00100000:0.0:1782759609.055535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218555904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759609.055594:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218555904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759609.055602:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3273 00000100:00100000:2.0:1782759609.055770:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759609.055800:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 419us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759609.055806:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5201 00000100:00100000:2.0:1782759609.055826:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556288 00000100:00100000:2.0:1782759609.055829:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556288 00000100:00100000:2.0:1782759609.055970:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3011 00000100:00100000:2.0:1782759609.055981:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218556288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759609.056010:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218556288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759609.056016:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3011 00000100:00080000:3.0:1782759609.056643:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759609.056649:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759609.056651:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782759609.228039:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782759609.749941:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:2.0:1782759609.749951:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc5421000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:0.0:1782759609.750168:0:62521:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc5421000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:0.0:1782759609.750253:0:62521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc5427800 for lustre-OST0001 00010000:00010000:3.0:1782759610.251437:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759611.276132:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759611.277987:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759611.278009:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232982656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759611.278083:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759611.278309:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982656 00000100:00100000:3.0:1782759611.278318:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982656 00000100:00100000:3.0:1782759611.278388:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00000100:00100000:3.0:1782759611.278398:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232982656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759611.278431:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445875712 avail 1299636224 00000100:00100000:3.0:1782759611.278487:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232982656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759611.278495:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00000100:00100000:0.0:1782759611.278603:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232982656:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759612.301070:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232982784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301133:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301179:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232983296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301202:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301218:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232983808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301254:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301272:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232984320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301292:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301316:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782759612.301322:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232982912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301345:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301361:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232983424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301381:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301395:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232983936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301415:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301439:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232983040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301460:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301475:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232983552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301493:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301507:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232984064:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301526:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301542:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759612.301547:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232983168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301568:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.301602:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232983680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.301623:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759612.303255:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759612.303375:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232984192:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.303422:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759612.303462:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982784 00000100:00100000:2.0:1782759612.303478:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982784 00000100:00100000:2.0:1782759612.303535:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:2.0:1782759612.303545:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232982784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.303616:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232982784:12345-0@lo:400:kworker.0 Request processed in 72us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.303624:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:1.0:1782759612.304303:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983808 00000100:00100000:1.0:1782759612.304309:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983808 00000100:00100000:1.0:1782759612.304353:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984320 00000100:00100000:1.0:1782759612.304356:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984320 00000100:00100000:1.0:1782759612.304365:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983680 00000100:00100000:1.0:1782759612.304367:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983680 00000100:00100000:1.0:1782759612.304378:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984192 00000100:00100000:1.0:1782759612.304380:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984192 00000100:00100000:1.0:1782759612.304390:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1782759612.304395:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232983808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759612.304434:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232983808:12345-0@lo:400:kworker.0 Request processed in 39us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759612.304440:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3012 00000100:00100000:1.0:1782759612.304451:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3013 00000100:00100000:1.0:1782759612.304455:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232984320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759612.304476:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232984320:12345-0@lo:400:kworker.0 Request processed in 20us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759612.304480:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3013 00000100:00100000:1.0:1782759612.304488:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3014 00000100:00100000:1.0:1782759612.304492:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232983680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759612.304513:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232983680:12345-0@lo:400:kworker.0 Request processed in 21us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759612.304526:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3014 00000100:00100000:1.0:1782759612.304535:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3015 00000100:00100000:1.0:1782759612.304539:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232984192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759612.304563:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232984192:12345-0@lo:400:kworker.0 Request processed in 24us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759612.304568:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3015 00000100:00100000:2.0:1782759612.305934:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983296 00000100:00100000:2.0:1782759612.305946:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983296 00000100:00100000:2.0:1782759612.306005:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983040 00000100:00100000:2.0:1782759612.306008:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983040 00000100:00100000:2.0:1782759612.306028:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1782759612.306036:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232983296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.306099:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232983296:12345-0@lo:400:kworker.0 Request processed in 64us (4895us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.306105:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1782759612.306119:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1782759612.306126:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232983040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.306153:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232983040:12345-0@lo:400:kworker.0 Request processed in 28us (4692us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.306492:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1782759612.306522:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232982912 00000100:00100000:2.0:1782759612.306527:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232982912 00000100:00100000:2.0:1782759612.306547:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983424 00000100:00100000:2.0:1782759612.306550:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983424 00000100:00100000:2.0:1782759612.306563:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983936 00000100:00100000:2.0:1782759612.306565:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983936 00000100:00100000:2.0:1782759612.306597:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983552 00000100:00100000:2.0:1782759612.306600:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983552 00000100:00100000:2.0:1782759612.306612:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984064 00000100:00100000:2.0:1782759612.306623:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984064 00000100:00100000:2.0:1782759612.306660:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232983168 00000100:00100000:2.0:1782759612.306664:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232983168 00000100:00100000:2.0:1782759612.306681:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5202 00000100:00100000:2.0:1782759612.306688:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232982912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.306734:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232982912:12345-0@lo:400:kworker.0 Request processed in 48us (5388us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.306741:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5202 00000100:00100000:2.0:1782759612.306753:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5203 00000100:00100000:2.0:1782759612.306761:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232983424:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759612.308125:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759612.308132:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759612.308135:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759612.308138:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759612.311190:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232983424:12345-0@lo:400:kworker.0 Request processed in 31us (5407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.311219:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5203 00000100:00100000:2.0:1782759612.311264:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5204 00000100:00100000:2.0:1782759612.311288:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232983936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311381:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232983936:12345-0@lo:400:kworker.0 Request processed in 109us (9964us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.311387:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5204 00000100:00100000:2.0:1782759612.311400:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5205 00000100:00100000:2.0:1782759612.311409:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232983552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311439:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232983552:12345-0@lo:400:kworker.0 Request processed in 33us (9944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.311444:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5205 00000100:00100000:2.0:1782759612.311456:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5206 00000100:00100000:2.0:1782759612.311463:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232984064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311492:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232984064:12345-0@lo:400:kworker.0 Request processed in 30us (9965us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.311508:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5206 00000100:00100000:2.0:1782759612.311521:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5207 00000100:00100000:2.0:1782759612.311529:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232983168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311560:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355232983168:12345-0@lo:400:kworker.0 Request processed in 34us (9991us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759612.311564:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5207 00000100:00100000:2.0:1782759612.311696:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355232983168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311713:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232983680:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311736:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232984192:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311748:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232983040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311759:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232983552:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.311769:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232984064:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.316990:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232982912:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.317012:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232983424:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.317024:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232983936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.317036:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232982784:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.317048:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232983296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.317059:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232983808:0@lo:400:kworker.0 00000100:00100000:2.0:1782759612.317070:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232984320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759612.816403:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232984448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759612.816489:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759612.816592:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984448 00000100:00100000:1.0:1782759612.816600:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984448 00000100:00100000:1.0:1782759612.816663:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1782759612.816672:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232984448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759612.816707:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759612.816771:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232984448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759612.816778:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00100000:1.0:1782759612.816997:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232984448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759612.818785:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232984576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759612.818982:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759612.819094:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984576 00000100:00100000:3.0:1782759612.819101:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984576 00000100:00100000:3.0:1782759612.819149:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1782759612.819159:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232984576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759612.819192:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759612.819239:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232984576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759612.819255:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1782759612.819297:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232984576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759613.324039:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759613.375486:0:153146:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64h: Nodemap enforces local_admin RBAC roles ========================================================== 15:00:11 (1782759611) 00000100:00100000:2.0:1782759613.835616:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232984704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759613.835877:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759613.835894:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232984832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759613.835973:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759613.836342:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759613.837033:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984832 00000100:00100000:3.0:1782759613.837044:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984832 00000100:00100000:3.0:1782759613.837367:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1782759613.837380:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232984832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759613.837424:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759613.837498:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232984832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 121us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759613.837505:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1782759613.837559:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232984832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759613.838035:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759613.838048:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232984960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759613.838470:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759613.838517:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984704 00000100:00100000:2.0:1782759613.838523:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984704 00000100:00100000:2.0:1782759613.838568:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232984960 00000100:00100000:2.0:1782759613.838571:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232984960 00000100:00100000:2.0:1782759613.838627:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:0.0:1782759613.839544:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:0.0:1782759613.839564:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232984960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759613.839629:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759613.839909:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232984960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 353us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759613.839918:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1782759613.840614:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232984960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759613.840877:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232984704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759613.840902:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759613.840954:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232984704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2319us (4611us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759613.840961:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:2.0:1782759613.841447:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232984704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759614.174186:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759614.174243:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759614.174271:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759614.174382:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556416 00000100:00100000:0.0:1782759614.174393:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556416 00000100:00100000:0.0:1782759614.174507:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3275 00000100:00100000:0.0:1782759614.174651:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218556416:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759614.174803:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218556416:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 274us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759614.174811:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3275 00000100:00100000:3.0:1782759614.177377:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759614.178064:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556800 00000100:00100000:0.0:1782759614.178075:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556800 00000100:00100000:0.0:1782759614.178156:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3016 00000100:00100000:0.0:1782759614.178167:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218556800:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759614.178273:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218556800:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 107us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759614.178281:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3016 00000100:00080000:0.0:1782759614.178304:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759614.185421:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556672 00000100:00100000:1.0:1782759614.185437:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556672 00000100:00100000:1.0:1782759614.185595:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556544 00000100:00100000:1.0:1782759614.185613:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556544 00000100:00100000:1.0:1782759614.185680:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5208 00000100:00100000:1.0:1782759614.185692:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556672:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759614.185821:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556672:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 133us (11577us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759614.185830:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5208 00000100:00100000:1.0:1782759614.185862:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5209 00000100:00100000:1.0:1782759614.185871:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556544:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759614.185913:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218556544:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (11640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759614.185919:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5209 00000100:00080000:0.0:1782759614.186141:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759614.186146:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1782759614.348675:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759615.381904:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1782759615.966370:0:153194:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1782759615.966380:0:153194:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000004:00000400:2.0:1782759615.966699:0:153194:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0001: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1782759615.966702:0:153194:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to NONE 00000100:00100000:1.0:1782759616.156003:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759616.156827:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218557184 00000100:00100000:2.0:1782759616.156837:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218557184 00000100:00100000:2.0:1782759616.156937:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2970 00000100:00100000:2.0:1782759616.156957:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111097:x1869355218557184:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759616.157013:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759616.157017:0:6532:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60c812) 00010000:00010000:2.0:1782759616.157026:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759616.157120:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157138:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157151:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157190:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157197:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157203:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157791:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157801:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157809:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759616.157824:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035351fef reply state 0000000023ea44d1 transno 4294968016 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157835:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157855:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759616.157857:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759616.157861:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759616.157866:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00010000:00010000:2.0:1782759616.157875:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157882:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157888:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157895:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157900:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759616.157905:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157912:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157923:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759616.157926:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759616.157929:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157936:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d11f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759616.157947:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035351fef reply state 0000000023ea44d1 transno 4294968016 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157962:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.157969:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cddc34fd600) 00010000:00010000:2.0:1782759616.157971:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759616.157973:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782759616.158089:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111097:x1869355218557184:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 1140us (2096us total) trans 4294968016 rc 0/0 00000100:00100000:2.0:1782759616.158098:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2970 00000100:00080000:0.0:1782759616.159376:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759616.163638:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.167317:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218556928 00000100:00100000:1.0:1782759616.167337:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218556928 00000100:00100000:1.0:1782759616.167414:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2971 00000100:00100000:1.0:1782759616.167425:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218556928:12345-192.168.202.31@tcp:41:mkdir.0 00000004:00000024:1.0:1782759616.167475:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1782759616.167568:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218556928:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 144us (3939us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.167605:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2971 00000100:00100000:0.0:1782759616.214847:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.214990:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218557312 00000100:00100000:1.0:1782759616.215001:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218557312 00000100:00100000:1.0:1782759616.215064:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2972 00000100:00100000:1.0:1782759616.215074:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec7796c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111098:x1869355218557312:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759616.215116:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759616.215136:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d134 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274f7 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.215213:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d13b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.215230:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.215242:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759616.215299:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759616.215302:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759616.215322:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d13b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.215346:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d134 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274f7 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.215366:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d13b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274f7 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.215374:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759616.215377:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759616.215380:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759616.215442:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec7796c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111098:x1869355218557312:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 370us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.215450:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2972 00000100:00100000:1.0:1782759616.234565:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.234816:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218557440 00000100:00100000:3.0:1782759616.234828:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218557440 00000100:00100000:3.0:1782759616.234891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2973 00000100:00100000:3.0:1782759616.234901:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111098:x1869355218557440:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:3.0:1782759616.234923:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759616.234955:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d142 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb274fe expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235016:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235030:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235041:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235051:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235058:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235064:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235144:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d157 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235152:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d157 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235158:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d157 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759616.235199:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1782759616.235202:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759616.235223:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d157 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235244:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235266:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235273:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235279:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235285:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.235289:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235296:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235310:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759616.235313:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.235318:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235324:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235339:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235345:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235358:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235363:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.235365:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235372:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235379:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cddc34fd600) 00010000:00010000:3.0:1782759616.235382:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.235385:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235391:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235418:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d142 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274fe expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235431:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d157 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274fe expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.235437:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:3.0:1782759616.235440:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759616.235442:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759616.235502:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111098:x1869355218557440:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 603us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.235518:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2973 00000100:00100000:0.0:1782759616.238865:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.238972:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218557696 00000100:00100000:1.0:1782759616.238984:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218557696 00000100:00100000:1.0:1782759616.239055:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2974 00000100:00100000:1.0:1782759616.239066:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111098:x1869355218557696:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:1.0:1782759616.239122:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759616.239150:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d157 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274fe expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.239172:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:1.0:1782759616.239177:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759616.239200:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.239213:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.239222:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759616.239388:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000419cea5e reply state 0000000042ecaba7 transno 4294968017 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.239400:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.239406:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:1.0:1782759616.239409:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1782759616.239411:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759616.239419:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000100:00100000:1.0:1782759616.239490:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:111098:x1869355218557696:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 425us (635us total) trans 4294968017 rc 0/0 00000100:00100000:1.0:1782759616.239510:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2974 00000100:00100000:3.0:1782759616.325308:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.325350:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218557824 00000100:00100000:3.0:1782759616.325360:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218557824 00000100:00100000:3.0:1782759616.325417:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2975 00000100:00100000:3.0:1782759616.325429:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:111099:x1869355218557824:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759616.325455:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759616.325475:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d165 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27505 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325534:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325549:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325560:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325570:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325604:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325622:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325708:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60d17a lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325733:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60d17a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325741:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60d17a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759616.325783:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1782759616.325787:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759616.325821:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60d17a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325835:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325842:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325849:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325856:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325863:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.325867:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325874:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325888:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759616.325899:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.325905:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325912:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5000/0xd5b45c7f5c60d16c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325924:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325929:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325933:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325938:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.325940:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325945:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325953:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cddc34fd600) 00010000:00010000:3.0:1782759616.325955:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.325957:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325962:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d173 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.325984:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d165 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27505 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.326005:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60d17a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27505 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.326012:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:3.0:1782759616.326015:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759616.326017:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759616.326076:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111099:x1869355218557824:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 650us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.326084:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2975 00000100:00100000:0.0:1782759616.368624:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.368798:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218558080 00000100:00100000:3.0:1782759616.368809:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218558080 00000100:00100000:3.0:1782759616.368883:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2976 00000100:00100000:3.0:1782759616.368894:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111099:x1869355218558080:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759616.368917:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759616.368937:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2750c expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759616.369229:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00010000:00010000:3.0:1782759616.369339:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d181 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2750c expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.369354:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759616.369357:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759616.369362:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2750c expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.369393:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759616.369445:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111099:x1869355218558080:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 553us (840us total) trans 4294968018 rc 301/301 00000100:00100000:3.0:1782759616.369453:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2976 00000100:00100000:0.0:1782759616.383550:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759616.383978:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218558336 00000100:00100000:2.0:1782759616.383988:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218558336 00000100:00100000:2.0:1782759616.384070:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2977 00000100:00100000:2.0:1782759616.384083:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111099:x1869355218558336:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759616.384139:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759616.384181:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60d17a lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27505 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.384201:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759616.384207:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759616.384233:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.384431:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.384444:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759616.384833:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012aeeafc reply state 00000000c9806f7c transno 4294968019 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.384847:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.384854:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759616.384867:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1782759616.384870:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759616.384878:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000100:00100000:2.0:1782759616.384999:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111099:x1869355218558336:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 918us (1469us total) trans 4294968019 rc 0/0 00000100:00100000:2.0:1782759616.385008:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2977 00000100:00100000:1.0:1782759616.403651:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.403753:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218558592 00000100:00100000:1.0:1782759616.403764:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218558592 00000100:00100000:1.0:1782759616.403830:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 348 00000100:00100000:1.0:1782759616.403841:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111099:x1869355218558592:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759616.404098:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:111099:x1869355218558592:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 258us (456us total) trans 4294968020 rc 0/0 00000100:00100000:1.0:1782759616.404105:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 348 00010000:00010000:1.0:1782759616.404128:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759616.408452:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232985088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759616.408522:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759616.408640:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985088 00000100:00100000:1.0:1782759616.408648:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985088 00000100:00100000:1.0:1782759616.408731:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:1.0:1782759616.408740:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232985088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759616.408768:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1782759616.409006:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232985088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 266us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.409014:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:0.0:1782759616.409106:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232985088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759616.419449:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759616.419540:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218558848 00000100:00100000:2.0:1782759616.419550:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218558848 00000100:00100000:2.0:1782759616.419653:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2978 00000100:00100000:2.0:1782759616.419664:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:111099:x1869355218558848:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759616.419697:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759616.419717:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60d196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27513 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.419788:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.419814:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.419826:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.419854:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.419862:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.419869:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759616.419975:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00010000:00010000:2.0:1782759616.420045:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420053:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420059:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420066:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420072:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759616.420076:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420083:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420095:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759616.420098:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759616.420109:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420116:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60d19d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420130:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420136:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420142:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420147:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759616.420150:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420156:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420164:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cddc34fd600) 00010000:00010000:2.0:1782759616.420166:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759616.420170:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420176:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60d1a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420208:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60d196 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27513 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420230:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759616.420232:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759616.420236:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60d196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27513 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.420246:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759616.420305:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:111099:x1869355218558848:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 644us (866us total) trans 4294968021 rc 301/301 00000100:00100000:2.0:1782759616.420313:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2978 00000100:00100000:1.0:1782759616.439961:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.440009:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218558976 00000100:00100000:1.0:1782759616.440024:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218558976 00000100:00100000:1.0:1782759616.440082:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2979 00000100:00100000:1.0:1782759616.440092:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:111099:x1869355218558976:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759616.440131:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759616.440154:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d1b2 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2751a expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.440265:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d1b9 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.440282:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.440295:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759616.440323:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:1.0:1782759616.440326:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759616.440345:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.440371:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d1b2 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2751a expref: 17 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.440390:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2751a expref: 16 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.440399:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:1.0:1782759616.440402:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759616.440406:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759616.440460:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:111099:x1869355218558976:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 369us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.440468:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2979 00000100:00100000:1.0:1782759616.457727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759616.469844:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218559104 00000100:00100000:2.0:1782759616.469859:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218559104 00000100:00100000:2.0:1782759616.469952:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 349 00000100:00100000:2.0:1782759616.469965:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec7788450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:111099:x1869355218559104:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:2.0:1782759616.479988:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec7788450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:111099:x1869355218559104:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 10013us (22256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759616.480003:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 349 00000100:00100000:1.0:1782759616.488566:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.488749:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218559360 00000100:00100000:3.0:1782759616.488760:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218559360 00000100:00100000:3.0:1782759616.488829:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 350 00000100:00100000:3.0:1782759616.488839:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:111099:x1869355218559360:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759616.489214:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:111099:x1869355218559360:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 374us (656us total) trans 4294968022 rc 0/0 00000100:00100000:3.0:1782759616.489221:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 350 00000100:00100000:2.0:1782759616.558457:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.558537:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218559488 00000100:00100000:1.0:1782759616.558549:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218559488 00000100:00100000:1.0:1782759616.558645:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2980 00000100:00100000:1.0:1782759616.558655:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:111100:x1869355218559488:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759616.558690:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759616.558711:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d1c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27521 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.558774:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.559030:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.559045:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559139:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559149:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559157:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559241:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d1d5 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559250:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559257:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759616.559315:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1782759616.559319:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759616.559447:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559464:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559470:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559475:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559482:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559488:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.559493:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559501:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559515:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759616.559518:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.559523:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559530:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d1c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559554:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559559:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559564:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559568:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.559571:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559769:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559780:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cddc34fd600) 00010000:00010000:3.0:1782759616.559783:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.559786:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559861:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d1ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559902:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d1c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27521 expref: 19 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559915:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27521 expref: 18 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.559935:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:3.0:1782759616.559937:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759616.559940:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759616.560055:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:111100:x1869355218559488:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1399us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.560064:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2980 00000100:00100000:0.0:1782759616.564045:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.567996:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218559616 00000100:00100000:1.0:1782759616.568013:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218559616 00000100:00100000:1.0:1782759616.568120:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 408 00000100:00100000:1.0:1782759616.568131:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2405:x1869355218559616:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759616.568149:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759616.568179:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d1d5 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27521 expref: 18 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759616.568202:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:1.0:1782759616.568207:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759616.568313:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:2405:x1869355218559616:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 183us (4279us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.568321:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 408 00000100:00100000:1.0:1782759616.576874:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759616.578049:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218559872 00000100:00100000:2.0:1782759616.578061:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218559872 00000100:00100000:2.0:1782759616.578136:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2981 00000100:00100000:2.0:1782759616.578148:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:111100:x1869355218559872:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759616.578180:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759616.578201:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d1dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27528 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.578380:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d1e3 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.578397:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.578409:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759616.578421:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00010000:00010000:2.0:1782759616.578552:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d1dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27528 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.578572:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27528 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759616.581739:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:2.0:1782759616.581744:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782759616.581748:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766a00, rc 0) 00000100:00100000:2.0:1782759616.584264:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:111100:x1869355218559872:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 6106us (7386us total) trans 4294968023 rc 0/0 00000100:00100000:2.0:1782759616.584279:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2981 00000100:00100000:3.0:1782759616.591863:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.592024:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560000 00000100:00100000:1.0:1782759616.592034:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560000 00000100:00100000:1.0:1782759616.592102:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2982 00000100:00100000:1.0:1782759616.592113:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:111100:x1869355218560000:12345-192.168.202.31@tcp:48:lfs.0 00000001:00080000:2.0:1782759616.600525:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968023 is committed 00010000:00010000:3.0:1782759616.600651:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600664:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600673:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600689:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.600696:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600704:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600724:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cddc34fd600) 00010000:00010000:3.0:1782759616.600727:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.600732:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600738:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60d126 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600778:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600784:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600800:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600805:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.600808:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600813:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600821:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:3.0:1782759616.600823:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759616.600825:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600830:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60d12d lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600848:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600853:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600859:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600869:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.600872:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600878:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600885:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:3.0:1782759616.600887:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759616.600890:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600895:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d15e lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600905:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600911:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600917:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600921:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759616.600924:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600929:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600947:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:3.0:1782759616.600949:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759616.600952:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759616.600959:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60d18f lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759616.613468:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111100:x1869355218560000:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 21340us (21606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.613484:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2982 00000100:00100000:2.0:1782759616.715641:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.716551:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560128 00000100:00100000:3.0:1782759616.716565:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560128 00000100:00100000:3.0:1782759616.716670:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2983 00000100:00100000:3.0:1782759616.716692:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111102:x1869355218560128:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:3.0:1782759616.716875:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111102:x1869355218560128:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 195us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.716884:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2983 00000100:00100000:2.0:1782759616.720509:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759616.720881:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560256 00000100:00100000:1.0:1782759616.720893:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560256 00000100:00100000:1.0:1782759616.720970:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2984 00000100:00100000:1.0:1782759616.720981:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111102:x1869355218560256:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759616.721179:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111102:x1869355218560256:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 199us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759616.721187:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2984 00000100:00100000:3.0:1782759616.733039:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759616.733767:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560384 00000100:00100000:0.0:1782759616.733779:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560384 00000100:00100000:0.0:1782759616.734661:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2985 00000100:00100000:0.0:1782759616.734672:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111102:x1869355218560384:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759616.734896:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111102:x1869355218560384:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 225us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759616.734905:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2985 00000100:00100000:0.0:1782759616.743618:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.744289:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560512 00000100:00100000:3.0:1782759616.744302:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560512 00000100:00080000:2.0:1782759616.744522:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759616.744528:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759616.747753:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1096 00000100:00100000:3.0:1782759616.747775:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111102:x1869355218560512:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759616.748040:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111102:x1869355218560512:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 274us (4475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.748048:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1096 00000100:00100000:3.0:1782759616.751264:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759616.751414:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560640 00000100:00100000:0.0:1782759616.751425:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560640 00000100:00100000:0.0:1782759616.751479:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1097 00000100:00100000:0.0:1782759616.751489:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2401:x1869355218560640:12345-192.168.202.31@tcp:8:lfs.0 00010000:00080000:0.0:1782759616.751530:0:8446:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp t0 exp 0000000000000000 cur 3657 last 0 00000020:00000080:0.0:1782759616.751566:0:8446:0:(genops.c:1406:class_connect()) connect: client e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0, cookie 0xd5b45c7f5c60d1f1 00002000:00100000:0.0:1782759616.751621:0:8446:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0/ffff8cddc3780000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759616.751642:0:8446:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782759616.751728:0:8446:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782759616.751758:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cddc3785000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759616.751839:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2401:x1869355218560640:12345-192.168.202.31@tcp:8:lfs.0 Request processed in 351us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759616.751848:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1097 00000100:00100000:1.0:1782759616.754976:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759616.755123:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560768 00000100:00100000:3.0:1782759616.755134:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560768 00000100:00100000:3.0:1782759616.755213:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1098 00000100:00100000:3.0:1782759616.755223:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111102:x1869355218560768:12345-192.168.202.31@tcp:19:lfs.0 00000100:00100000:3.0:1782759616.755404:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111102:x1869355218560768:12345-192.168.202.31@tcp:19:lfs.0 Request processed in 182us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759616.755413:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1098 00000100:00080000:1.0:1782759616.757702:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759617.418883:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759617.426021:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232985344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.426126:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759617.426231:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985344 00000100:00100000:1.0:1782759617.426239:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985344 00000100:00100000:1.0:1782759617.426286:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5210 00000100:00100000:1.0:1782759617.426295:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232985344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.426370:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355232985344:12345-0@lo:400:kworker.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759617.426378:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5210 00000100:00100000:1.0:1782759617.426423:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355232985344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.426463:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232985472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.426517:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759617.426574:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232985856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.427115:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759617.428706:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985856 00000100:00100000:1.0:1782759617.428720:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985856 00000100:00100000:1.0:1782759617.429069:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5211 00000100:00100000:1.0:1782759617.429082:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232985856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.429168:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355232985856:12345-0@lo:400:kworker.0 Request processed in 89us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759617.429177:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5211 00000100:00080000:1.0:1782759617.429200:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759617.429235:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355232985856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.429289:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355232985984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.429321:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759617.429387:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232986368:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.429408:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759617.429429:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985984 00000100:00100000:1.0:1782759617.429433:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985984 00000100:00100000:1.0:1782759617.429460:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986368 00000100:00100000:1.0:1782759617.429463:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986368 00000100:00100000:1.0:1782759617.429506:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5212 00000100:00100000:1.0:1782759617.429511:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355232985984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.429540:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355232985984:12345-0@lo:400:kworker.0 Request processed in 29us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759617.429546:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5212 00000100:00100000:1.0:1782759617.429556:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5213 00000100:00100000:1.0:1782759617.429561:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232986368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.434314:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355232986368:12345-0@lo:400:kworker.0 Request processed in 4746us (4898us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759617.434327:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5213 00000100:00080000:1.0:1782759617.434369:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759617.434374:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759617.434414:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355232985984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.434454:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355232986368:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.434501:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355232986496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.434533:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759617.434561:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986496 00000100:00100000:1.0:1782759617.434593:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986496 00000100:00100000:0.0:1782759617.434869:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232985216:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.434908:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759617.434950:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232985728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.434978:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759617.434999:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232986240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435022:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759617.435043:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759617.435066:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232985600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435094:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759617.435112:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232986112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435132:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759617.435175:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985600 00000100:00100000:0.0:1782759617.435180:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985600 00000100:00100000:0.0:1782759617.435220:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214 00000100:00100000:0.0:1782759617.435228:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232985600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435263:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355232985600:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759617.435269:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214 00000100:00100000:0.0:1782759617.435289:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985472 00000100:00100000:0.0:1782759617.435293:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985472 00000100:00100000:0.0:1782759617.435360:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985728 00000100:00100000:0.0:1782759617.435364:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985728 00000100:00100000:0.0:1782759617.435377:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:0.0:1782759617.435382:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232985472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435416:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232985472:12345-0@lo:400:kworker.0 Request processed in 34us (8899us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759617.435423:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00000100:00100000:0.0:1782759617.435433:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:0.0:1782759617.435438:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232985728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435463:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232985728:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759617.435469:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00100000:0.0:1782759617.435492:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986240 00000100:00100000:0.0:1782759617.435495:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986240 00000100:00100000:0.0:1782759617.435536:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986112 00000100:00100000:0.0:1782759617.435540:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986112 00000100:00100000:0.0:1782759617.435561:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1782759617.435567:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232986240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759617.435705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232985216 00000100:00100000:3.0:1782759617.435710:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232985216 00000100:00100000:3.0:1782759617.435740:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1782759617.435746:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232985216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759617.435778:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232985216:12345-0@lo:400:kworker.0 Request processed in 33us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759617.435784:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:0.0:1782759617.435860:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232986240:12345-0@lo:400:kworker.0 Request processed in 293us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759617.435867:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3017 00000100:00100000:0.0:1782759617.435879:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3018 00000100:00100000:0.0:1782759617.435885:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232986112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435911:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232986112:12345-0@lo:400:kworker.0 Request processed in 26us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759617.435917:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3018 00000100:00100000:0.0:1782759617.435954:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355232985600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435965:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232986112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435973:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232985216:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435983:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232985728:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.435993:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232986240:0@lo:400:kworker.0 00000100:00080000:0.0:1782759617.436035:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759617.436056:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232985472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.436270:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00000100:00100000:1.0:1782759617.436278:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355232986496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759617.436318:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355232986496:12345-0@lo:400:kworker.0 Request processed in 41us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759617.436323:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00000100:00100000:0.0:1782759617.438164:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232986624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.438247:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759617.438314:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759617.438322:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232986752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.438346:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759617.438413:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759617.438451:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355232986496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759617.438548:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986624 00000100:00100000:3.0:1782759617.438556:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986624 00000100:00100000:3.0:1782759617.438661:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986752 00000100:00100000:3.0:1782759617.438664:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986752 00000100:00100000:3.0:1782759617.438698:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3019 00000100:00100000:3.0:1782759617.438707:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232986624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759617.438759:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232986624:12345-0@lo:400:kworker.0 Request processed in 53us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759617.438766:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3019 00000100:00100000:3.0:1782759617.438793:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3020 00000100:00100000:3.0:1782759617.438800:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232986752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759617.438828:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232986752:12345-0@lo:400:kworker.0 Request processed in 29us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759617.438833:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3020 00000100:00100000:0.0:1782759617.439089:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232986752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759617.439100:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232986624:0@lo:400:kworker.0 00000100:00080000:0.0:1782759617.439122:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759617.931167:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759617.931211:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232986880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759617.931298:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759617.931604:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232986880 00000100:00100000:3.0:1782759617.931614:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232986880 00000100:00100000:3.0:1782759617.931676:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1782759617.931687:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232986880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759617.931718:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759617.931783:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232986880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759617.931791:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:2.0:1782759617.931925:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232986880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759617.940361:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232987008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759617.940435:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759617.940542:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987008 00000100:00100000:3.0:1782759617.940553:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987008 00000100:00100000:3.0:1782759617.940639:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2697 00000100:00100000:3.0:1782759617.940652:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232987008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759617.940687:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759617.940741:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232987008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759617.940749:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2697 00000100:00100000:2.0:1782759617.940843:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232987008:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759618.444706:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759618.957057:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232987136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759618.957135:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759618.959079:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232987392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759618.959146:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759618.959429:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987136 00000100:00100000:3.0:1782759618.959441:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987136 00000100:00100000:3.0:1782759618.959510:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:3.0:1782759618.959519:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232987136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759618.959553:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759618.959709:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987392 00000100:00100000:0.0:1782759618.959714:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987392 00000100:00100000:0.0:1782759618.959759:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352 00000100:00100000:0.0:1782759618.959766:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232987392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759618.959803:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759618.959857:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232987392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759618.959864:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352 00000100:00100000:0.0:1782759618.960025:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232987264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759618.960057:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759618.960234:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987264 00000100:00100000:2.0:1782759618.960238:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987264 00000100:00100000:2.0:1782759618.960281:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:2.0:1782759618.960289:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232987264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759618.960301:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759618.960337:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232987264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759618.960343:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:2.0:1782759618.960388:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232987264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759618.960419:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232987392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759618.961019:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232987136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1499us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759618.961027:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00100000:2.0:1782759618.961963:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232987136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759619.296537:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759619.296601:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759619.296645:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759619.296679:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759619.296703:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759619.296727:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218560896 00000100:00100000:1.0:1782759619.296737:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218560896 00000100:00100000:1.0:1782759619.297096:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3277 00000100:00100000:1.0:1782759619.297108:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218560896:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759619.297187:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218560896:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 82us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759619.297195:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3277 00000100:00100000:1.0:1782759619.297230:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561024 00000100:00100000:1.0:1782759619.297234:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561024 00000100:00100000:1.0:1782759619.297282:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561152 00000100:00100000:1.0:1782759619.297286:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561152 00000100:00100000:1.0:1782759619.297310:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5216 00000100:00100000:1.0:1782759619.297317:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218561024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759619.297348:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218561024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759619.297355:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5216 00000100:00100000:1.0:1782759619.297367:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5217 00000100:00100000:1.0:1782759619.297374:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218561152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759619.297398:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218561152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759619.297404:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5217 00000100:00100000:3.0:1782759619.299027:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561280 00000100:00100000:3.0:1782759619.299040:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561280 00000100:00100000:3.0:1782759619.299092:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561408 00000100:00100000:3.0:1782759619.299096:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561408 00000100:00100000:3.0:1782759619.299138:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3021 00000100:00100000:3.0:1782759619.299148:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218561280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759619.299211:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218561280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 65us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759619.299218:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3021 00000100:00100000:3.0:1782759619.299232:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3022 00000100:00100000:3.0:1782759619.299239:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218561408:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759619.299262:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218561408:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759619.299268:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3022 00000100:00080000:1.0:1782759619.300758:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759619.301094:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759619.301111:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759619.301114:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759619.485664:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759620.491273:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759621.527439:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759621.527465:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232987520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759621.527560:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759621.527635:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759621.527660:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987520 00000100:00100000:1.0:1782759621.527668:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987520 00000100:00100000:1.0:1782759621.527744:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:1.0:1782759621.527752:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232987520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759621.527784:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1782759621.527829:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232987520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759621.527836:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:1.0:1782759621.527882:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232987520:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1782759622.040881:0:153390:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffcc665da0 20000000:00000080:3.0:1782759622.040896:0:153390:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc48fe400 uarg=0000000000000000 10000000:01000000:3.0:1782759622.041062:0:153390:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759622.041081:0:153390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.041098:0:153390:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.041106:0:153390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.041144:0:153390:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.041157:0:153390:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 23 pid: 6524 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759622.041183:0:153390:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153390:1869355232987648:0@lo:104: 00000100:00100000:3.0:1782759622.041241:0:153390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759622.041499:0:153390:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759622.044964:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987648 00000100:00100000:0.0:1782759622.044979:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987648 00000100:00100000:2.0:1782759622.045120:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1782759622.045133:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:153390:x1869355232987648:12345-0@lo:104: 00010000:00010000:2.0:1782759622.045152:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759622.045282:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759622.045288:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:153390:x1869355232987648:12345-0@lo:104: Request processed in 160us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.045295:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1782759622.045405:0:153390:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153390:1869355232987648:0@lo:104: 00010000:00010000:0.0:1782759622.045430:0:153390:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.045506:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759622.045515:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.045523:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759622.045527:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.045536:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759622.045543:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759622.045833:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759622.045922:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.045930:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759622.045960:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.045967:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d111 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d118 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.045982:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759622.045983:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759622.045985:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759622.046015:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759622.046030:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232987776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759622.046078:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.048738:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987776 00000100:00100000:1.0:1782759622.048753:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987776 00010000:00010000:1.0:1782759622.048804:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 24 pid: 6524 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759622.048856:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1782759622.048866:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5716050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355232987776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759622.048882:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759622.048888:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 24 pid: 6524 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048899:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 24 pid: 6524 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048917:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60d118 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d111 expref: 24 pid: 6524 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048945:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048953:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048969:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048976:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048982:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048989:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.048994:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759622.048999:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.049006:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.049028:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759622.049038:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759622.049106:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5716050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355232987776:12345-0@lo:103:ldlm_bl.0 Request processed in 242us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759622.049119:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1782759622.049191:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355232987776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759622.049262:0:153390:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.049270:0:153390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759622.049276:0:153390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d1f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759622.540507:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232988032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.540593:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759622.540655:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232988544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.540682:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759622.540706:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232989056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.540728:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759622.540767:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782759622.540773:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232988160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.540794:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759622.540812:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232988672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.540836:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759622.540854:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232989184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.540877:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759622.540910:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988544 00000100:00100000:2.0:1782759622.540918:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988544 00000100:00100000:2.0:1782759622.540970:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989056 00000100:00100000:2.0:1782759622.540973:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989056 00000100:00100000:2.0:1782759622.541006:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988160 00000100:00100000:2.0:1782759622.541009:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988160 00000100:00100000:2.0:1782759622.541032:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5218 00000100:00100000:2.0:1782759622.541041:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232988544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541108:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232988544:12345-0@lo:400:kworker.0 Request processed in 69us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.541116:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5218 00000100:00100000:2.0:1782759622.541132:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5219 00000100:00100000:2.0:1782759622.541139:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232989056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541164:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232989056:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.541170:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5219 00000100:00100000:2.0:1782759622.541180:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5220 00000100:00100000:2.0:1782759622.541186:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541211:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232988160:12345-0@lo:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.541217:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5220 00000100:00100000:2.0:1782759622.541236:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988672 00000100:00100000:2.0:1782759622.541240:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988672 00000100:00100000:2.0:1782759622.541264:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989184 00000100:00100000:2.0:1782759622.541266:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989184 00000100:00100000:2.0:1782759622.541283:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3023 00000100:00100000:2.0:1782759622.541290:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232988672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541320:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232988672:12345-0@lo:400:kworker.0 Request processed in 32us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.541326:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3023 00000100:00100000:2.0:1782759622.541337:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3024 00000100:00100000:2.0:1782759622.541344:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232989184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541369:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232989184:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.541385:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3024 00000100:00080000:2.0:1782759622.541400:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759622.541405:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759622.541407:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759622.541444:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232988160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541455:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232988672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541463:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232989184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541471:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232988544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.541479:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232989056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541656:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232987904:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541690:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.541722:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232988416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541756:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.541772:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232988928:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541791:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.541805:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759622.541810:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232988288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541829:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.541845:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232988800:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541866:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.541887:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232989312:0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.541906:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759622.541928:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988032 00000100:00100000:1.0:1782759622.541932:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988032 00000100:00100000:1.0:1782759622.541972:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988288 00000100:00100000:1.0:1782759622.541975:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988288 00000100:00100000:1.0:1782759622.541988:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:1.0:1782759622.541994:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232988032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.542030:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232988032:12345-0@lo:400:kworker.0 Request processed in 35us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759622.542036:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:1.0:1782759622.542057:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:1.0:1782759622.542063:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232988288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759622.542096:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232988288:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759622.542101:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000100:00100000:1.0:1782759622.542126:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232988288:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.544743:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232987904 00000100:00100000:2.0:1782759622.544761:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232987904 00000100:00100000:2.0:1782759622.544842:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988416 00000100:00100000:2.0:1782759622.544846:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988416 00000100:00100000:2.0:1782759622.544876:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988928 00000100:00100000:2.0:1782759622.544879:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988928 00000100:00100000:2.0:1782759622.544900:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5221 00000100:00100000:2.0:1782759622.544911:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232987904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545007:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355232987904:12345-0@lo:400:kworker.0 Request processed in 97us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.545014:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5221 00000100:00100000:2.0:1782759622.545030:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5222 00000100:00100000:2.0:1782759622.545037:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232988416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545061:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232988416:12345-0@lo:400:kworker.0 Request processed in 27us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.545067:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5222 00000100:00100000:2.0:1782759622.545090:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5223 00000100:00100000:2.0:1782759622.545096:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232988928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545126:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232988928:12345-0@lo:400:kworker.0 Request processed in 30us (3333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.545131:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5223 00000100:00080000:2.0:1782759622.545152:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759622.545162:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232988800 00000100:00100000:2.0:1782759622.545165:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232988800 00000100:00100000:2.0:1782759622.545194:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989312 00000100:00100000:2.0:1782759622.545198:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989312 00000100:00100000:2.0:1782759622.545217:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3025 00000100:00100000:2.0:1782759622.545223:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545251:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232988800:12345-0@lo:400:kworker.0 Request processed in 29us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.545258:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3025 00000100:00100000:2.0:1782759622.545269:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3026 00000100:00100000:2.0:1782759622.545277:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232989312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545303:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232989312:12345-0@lo:400:kworker.0 Request processed in 28us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759622.545308:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3026 00000100:00080000:2.0:1782759622.545319:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759622.545322:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759622.545354:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232988800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545366:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232989312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545378:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355232987904:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545387:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232988416:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545406:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232988928:0@lo:400:kworker.0 00000100:00100000:2.0:1782759622.545456:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232988032:0@lo:400:kworker.0 00010000:00010000:3.0:1782759622.547040:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782759622.551462:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000100:00100000:3.0:1782759623.058172:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759623.058196:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759623.058264:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759623.058329:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989440 00000100:00100000:3.0:1782759623.058336:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989440 00000100:00100000:3.0:1782759623.058385:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:3.0:1782759623.058407:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232989440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759623.058440:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759623.058482:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232989440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759623.058489:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:3.0:1782759623.058540:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759623.058987:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759623.058998:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232989568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759623.059031:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759623.062964:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989568 00000100:00100000:3.0:1782759623.062981:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989568 00000100:00100000:3.0:1782759623.063049:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:3.0:1782759623.063059:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232989568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759623.063088:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759623.063172:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232989568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (4139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759623.063179:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:3.0:1782759623.063228:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232989568:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1782759623.521883:0:153438:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb60e6080 20000000:00000080:1.0:1782759623.521900:0:153438:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf8a1c00 uarg=0000000000000000 10000000:01000000:1.0:1782759623.522074:0:153438:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759623.522098:0:153438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522114:0:153438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522126:0:153438:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522133:0:153438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522141:0:153438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522148:0:153438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522155:0:153438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759623.522159:0:153438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522177:0:153438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522190:0:153438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522197:0:153438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759623.522202:0:153438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d1ff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.574247:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759623.883697:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759623.883708:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759623.883713:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759623.883766:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.883780:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.883791:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759623.883815:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232989696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759623.883889:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759623.883950:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759623.883978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989696 00000100:00100000:3.0:1782759623.883985:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989696 00000100:00100000:3.0:1782759623.884059:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:3.0:1782759623.884069:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232989696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759623.884254:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759623.884275:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d206 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.884304:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.884315:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.884323:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5000, rc 0) 00000100:00100000:3.0:1782759623.884363:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232989696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 296us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759623.884370:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:3.0:1782759623.884417:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232989696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759623.884430:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.884439:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759623.884459:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759623.884464:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759623.884472:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759624.075017:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759624.075040:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232989952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759624.075112:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759624.075405:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759624.075416:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232990080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759624.075447:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759624.075643:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989952 00000100:00100000:0.0:1782759624.075650:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989952 00000100:00100000:0.0:1782759624.075704:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990080 00000100:00100000:0.0:1782759624.075707:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990080 00000100:00100000:0.0:1782759624.075740:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:0.0:1782759624.075749:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232989952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759624.075778:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759624.075820:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232989952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759624.075827:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:0.0:1782759624.075843:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2703 00000100:00100000:0.0:1782759624.075848:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232990080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759624.075857:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759624.075885:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232990080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759624.075890:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2703 00000100:00100000:0.0:1782759624.075932:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232990080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759624.076180:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232989824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759624.076216:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759624.076389:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232989824 00000100:00100000:3.0:1782759624.076393:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232989824 00000100:00100000:3.0:1782759624.076438:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:3.0:1782759624.076445:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232989824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759624.076868:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759624.076919:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232989824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 473us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759624.076926:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:1.0:1782759624.077055:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232989952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759624.077273:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232989824:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1782759624.077610:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759624.412754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759624.412799:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759624.412831:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759624.412855:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759624.412880:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759624.412907:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561536 00000100:00100000:3.0:1782759624.412916:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561536 00000100:00100000:3.0:1782759624.412968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3279 00000100:00100000:3.0:1782759624.412978:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218561536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759624.413089:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561664 00000100:00100000:0.0:1782759624.413094:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561664 00000100:00100000:0.0:1782759624.413136:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561792 00000100:00100000:0.0:1782759624.413139:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561792 00000100:00100000:0.0:1782759624.413161:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5224 00000100:00100000:0.0:1782759624.413169:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218561664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759624.413247:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218561664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759624.413271:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5224 00000100:00100000:0.0:1782759624.413289:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5225 00000100:00100000:0.0:1782759624.413295:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218561792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759624.413322:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218561792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759624.413328:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5225 00000100:00080000:0.0:1782759624.413344:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759624.413348:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759624.413607:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218561920 00000100:00100000:1.0:1782759624.413621:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218561920 00000100:00100000:1.0:1782759624.413665:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562048 00000100:00100000:1.0:1782759624.413668:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562048 00000100:00100000:1.0:1782759624.413689:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3027 00000100:00100000:1.0:1782759624.413696:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218561920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759624.413730:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218561920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759624.413737:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3027 00000100:00100000:1.0:1782759624.413750:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3028 00000100:00100000:1.0:1782759624.413755:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759624.413787:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759624.413795:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3028 00000100:00100000:3.0:1782759624.413928:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218561536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 951us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759624.413935:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3279 00000100:00080000:0.0:1782759624.414150:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759624.414154:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759624.589894:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759625.610760:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759626.637620:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759626.645278:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232990208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759626.645448:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759626.645765:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990208 00000100:00100000:0.0:1782759626.645774:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990208 00000100:00100000:0.0:1782759626.645846:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:0.0:1782759626.645857:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232990208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759626.645893:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:0.0:1782759626.645945:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232990208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759626.645954:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357 00000100:00100000:0.0:1782759626.646001:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232990208:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1782759627.388447:0:153586:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed83e92d0 20000000:00000080:3.0:1782759627.388465:0:153586:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc48fe800 uarg=0000000000000000 10000000:01000000:3.0:1782759627.389309:0:153586:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759627.389328:0:153586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.389350:0:153586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.389360:0:153586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.389397:0:153586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.389411:0:153586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 23 pid: 6526 timeout: 3817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759627.389426:0:153586:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153586:1869355232990336:0@lo:104: 00000100:00100000:3.0:1782759627.389487:0:153586:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759627.390215:0:153586:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759627.394857:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759627.394884:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990336 00000100:00100000:1.0:1782759627.394893:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990336 00000100:00100000:1.0:1782759627.394947:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1782759627.394956:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:153586:x1869355232990336:12345-0@lo:104: 00010000:00010000:1.0:1782759627.394973:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759627.395102:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759627.395108:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf6a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:153586:x1869355232990336:12345-0@lo:104: Request processed in 154us (5621us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.395115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00010000:00010000:0.0:1782759627.395231:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759627.395238:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759627.395245:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759627.395249:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759627.395273:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759627.395280:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759627.395285:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759627.395326:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759627.395332:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759627.395357:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759627.395365:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4200/0xd5b45c7f5c60d206 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d20d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759627.395382:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759627.395384:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759627.395386:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759627.395392:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759627.395405:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232990464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759627.395440:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759627.395517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990464 00000100:00100000:2.0:1782759627.395521:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990464 00010000:00010000:2.0:1782759627.395550:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 24 pid: 6526 timeout: 3817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759627.395608:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1782759627.395617:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232990464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759627.395628:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759627.395633:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 24 pid: 6526 timeout: 3817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395643:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 24 pid: 6526 timeout: 3817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395660:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395668:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395681:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395694:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395712:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395718:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395730:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759627.395734:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395743:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395751:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759627.395763:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759627.395794:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232990464:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759627.395801:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:2.0:1782759627.395834:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232990464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759627.402798:0:153586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d20d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d206 expref: 23 pid: 6526 timeout: 3817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759627.402820:0:153586:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153586:1869355232990336:0@lo:104: 00010000:00010000:3.0:1782759627.402844:0:153586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.402855:0:153586:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.402880:0:153586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759627.402886:0:153586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d214 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759627.659982:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232990592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660054:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660098:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232991104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660117:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660129:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232991616:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660146:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660166:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759627.660171:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232990720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660192:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660203:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232991232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660230:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660244:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232991744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660262:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660285:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232990848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660306:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660317:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232991360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660335:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660347:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232991872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660361:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660374:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759627.660378:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232990976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660394:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660407:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232991488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660423:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660433:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232992000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660450:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759627.660474:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990592 00000100:00100000:1.0:1782759627.660481:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990592 00000100:00100000:1.0:1782759627.660516:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991104 00000100:00100000:1.0:1782759627.660518:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991104 00000100:00100000:1.0:1782759627.660753:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991616 00000100:00100000:1.0:1782759627.660757:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991616 00000100:00100000:1.0:1782759627.660779:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991232 00000100:00100000:1.0:1782759627.660782:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991232 00000100:00100000:1.0:1782759627.660792:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991744 00000100:00100000:1.0:1782759627.660795:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991744 00000100:00100000:1.0:1782759627.660805:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990848 00000100:00100000:1.0:1782759627.660814:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990848 00000100:00100000:1.0:1782759627.660835:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5226 00000100:00100000:1.0:1782759627.660843:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232990592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660900:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232990592:12345-0@lo:400:kworker.0 Request processed in 57us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.660907:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5226 00000100:00100000:1.0:1782759627.660923:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5227 00000100:00100000:1.0:1782759627.660928:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232991104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660953:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232991104:12345-0@lo:400:kworker.0 Request processed in 25us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.660958:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5227 00000100:00100000:1.0:1782759627.660969:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5228 00000100:00100000:1.0:1782759627.660974:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232991616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.660997:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232991616:12345-0@lo:400:kworker.0 Request processed in 24us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.661002:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5228 00000100:00100000:1.0:1782759627.661011:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229 00000100:00100000:1.0:1782759627.661016:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232991232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661038:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355232991232:12345-0@lo:400:kworker.0 Request processed in 22us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.661043:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229 00000100:00100000:1.0:1782759627.661052:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5230 00000100:00100000:1.0:1782759627.661057:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232991744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661078:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355232991744:12345-0@lo:400:kworker.0 Request processed in 21us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.661092:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5230 00000100:00100000:1.0:1782759627.661104:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5231 00000100:00100000:1.0:1782759627.661109:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661141:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232990848:12345-0@lo:400:kworker.0 Request processed in 32us (834us total) trans 0 rc 0/0 00010000:00010000:3.0:1782759627.661146:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759627.661147:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5231 00000100:00100000:3.0:1782759627.661161:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990720 00000100:00100000:3.0:1782759627.661165:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990720 00000100:00100000:1.0:1782759627.661171:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991360 00000100:00100000:1.0:1782759627.661174:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991360 00000100:00100000:1.0:1782759627.661196:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991872 00000100:00100000:1.0:1782759627.661198:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991872 00000100:00100000:3.0:1782759627.661205:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232990976 00000100:00100000:3.0:1782759627.661208:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232990976 00000100:00100000:1.0:1782759627.661210:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232991488 00000100:00100000:1.0:1782759627.661211:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232991488 00000100:00100000:3.0:1782759627.661220:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:1.0:1782759627.661220:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992000 00000100:00100000:1.0:1782759627.661222:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992000 00000100:00100000:3.0:1782759627.661225:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232990720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661234:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3029 00000100:00100000:1.0:1782759627.661239:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232991360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759627.661261:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355232990720:12345-0@lo:400:kworker.0 Request processed in 36us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.661262:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232991360:12345-0@lo:400:kworker.0 Request processed in 24us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759627.661268:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:1.0:1782759627.661268:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3029 00000100:00100000:3.0:1782759627.661279:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:1.0:1782759627.661279:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3030 00000100:00100000:3.0:1782759627.661285:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232990976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661285:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232991872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759627.661309:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232990976:12345-0@lo:400:kworker.0 Request processed in 25us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.661309:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232991872:12345-0@lo:400:kworker.0 Request processed in 25us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759627.661315:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000100:00100000:1.0:1782759627.661315:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3030 00000100:00100000:1.0:1782759627.661325:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3031 00000100:00100000:1.0:1782759627.661330:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232991488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759627.661334:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3032 00000100:00100000:3.0:1782759627.661339:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232992000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759627.661364:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232992000:12345-0@lo:400:kworker.0 Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759627.661364:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232991488:12345-0@lo:400:kworker.0 Request processed in 34us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759627.661370:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3032 00000100:00100000:1.0:1782759627.661384:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3031 00000100:00080000:1.0:1782759627.661400:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759627.661404:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759627.661406:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759627.661408:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759627.661434:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232990720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661445:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355232991232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661453:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355232991744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661461:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232990592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661469:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232991104:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661477:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232991616:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661511:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232990976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661617:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232991488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661629:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232992000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661638:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232990848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661646:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232991360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759627.661654:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232991872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759628.170784:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232992128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759628.170854:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759628.170936:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992128 00000100:00100000:3.0:1782759628.170944:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992128 00000100:00100000:3.0:1782759628.170991:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2704 00000100:00100000:3.0:1782759628.171001:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232992128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759628.171033:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759628.171076:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355232992128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759628.171083:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2704 00000100:00100000:3.0:1782759628.171129:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355232992128:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759628.177735:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232992256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759628.177809:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759628.178087:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992256 00000100:00100000:0.0:1782759628.178095:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992256 00000100:00100000:0.0:1782759628.178146:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:0.0:1782759628.178155:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232992256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759628.178179:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759628.178226:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232992256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759628.178232:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:3.0:1782759628.178501:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232992256:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1782759628.291425:0:153634:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe41c7d750 20000000:00000080:3.0:1782759628.291443:0:153634:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf965400 uarg=0000000000000000 10000000:01000000:3.0:1782759628.292117:0:153634:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759628.292141:0:153634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292159:0:153634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292171:0:153634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292177:0:153634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292193:0:153634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292201:0:153634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292207:0:153634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759628.292212:0:153634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292220:0:153634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292234:0:153634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292242:0:153634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.292248:0:153634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d21b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759628.684213:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759629.069669:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759629.069680:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759629.069686:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759629.069743:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759629.069756:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759629.069778:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759629.069804:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232992384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759629.069872:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759629.069922:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759629.069965:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992384 00000100:00100000:2.0:1782759629.069975:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992384 00000100:00100000:2.0:1782759629.070036:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:2.0:1782759629.070047:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232992384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759629.070071:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759629.070085:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d222 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.070111:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.070122:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.070131:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766200, rc 0) 00000100:00100000:2.0:1782759629.070180:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232992384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759629.070187:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:3.0:1782759629.070776:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232992384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759629.070791:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759629.070800:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759629.070817:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759629.070823:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759629.070830:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759629.197870:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759629.197893:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232992512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759629.197962:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759629.198021:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992512 00000100:00100000:0.0:1782759629.198028:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992512 00000100:00100000:0.0:1782759629.198085:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1782759629.198094:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232992512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759629.198129:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759629.198170:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355232992512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759629.198178:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:0.0:1782759629.198238:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355232992512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759629.198738:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759629.198750:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232992640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759629.198789:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759629.198831:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759629.198840:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232992768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759629.198865:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759629.198902:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992640 00000100:00100000:3.0:1782759629.198907:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992640 00000100:00100000:3.0:1782759629.198951:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992768 00000100:00100000:3.0:1782759629.198954:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992768 00000100:00100000:3.0:1782759629.198977:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:3.0:1782759629.198984:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232992640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759629.199007:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759629.199041:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232992640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759629.199047:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:3.0:1782759629.199060:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:3.0:1782759629.199066:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232992768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759629.199075:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759629.199100:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232992768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759629.199105:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00080000:3.0:1782759629.199120:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759629.199147:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232992768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759629.199169:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232992640:0@lo:13:osp-pre-0-1.0 00000020:00000080:2.0:1782759629.201356:0:153682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe19e23340 20000000:00000080:2.0:1782759629.201371:0:153682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6f800 uarg=0000000000000000 10000000:01000000:2.0:1782759629.201518:0:153682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759629.201536:0:153682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.201554:0:153682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.201564:0:153682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.201639:0:153682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.201653:0:153682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 23 pid: 6524 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759629.201675:0:153682:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153682:1869355232992896:0@lo:104: 00000100:00100000:2.0:1782759629.201726:0:153682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759629.201765:0:153682:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759629.201964:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232992896 00000100:00100000:0.0:1782759629.201971:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232992896 00000100:00100000:0.0:1782759629.202019:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1782759629.202028:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:153682:x1869355232992896:12345-0@lo:104: 00010000:00010000:0.0:1782759629.202040:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759629.202099:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759629.202105:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:153682:x1869355232992896:12345-0@lo:104: Request processed in 78us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759629.202113:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00010000:00010000:1.0:1782759629.202158:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759629.202165:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202179:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759629.202183:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202192:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759629.202209:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759629.202216:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759629.202250:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202256:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759629.202272:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202279:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5400/0xd5b45c7f5c60d222 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d229 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202294:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759629.202296:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759629.202298:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759629.202306:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759629.202315:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232993024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759629.202346:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759629.202376:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993024 00000100:00100000:1.0:1782759629.202379:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993024 00010000:00010000:1.0:1782759629.202401:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 24 pid: 6524 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759629.202422:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1782759629.202428:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232993024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759629.202438:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759629.202443:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 24 pid: 6524 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202453:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 24 pid: 6524 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202468:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202476:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202488:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202496:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202503:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202510:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202516:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759629.202526:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202535:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202543:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759629.202553:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759629.202607:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355232993024:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759629.202614:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1782759629.202650:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232993024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759629.203233:0:153682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d229 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d222 expref: 23 pid: 6524 timeout: 3819 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759629.203246:0:153682:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153682:1869355232992896:0@lo:104: 00010000:00010000:2.0:1782759629.203270:0:153682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.203279:0:153682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.203286:0:153682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759629.203292:0:153682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d230 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759629.534288:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759629.534345:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759629.534372:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759629.534389:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759629.534418:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759629.534446:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562432 00000100:00100000:0.0:1782759629.534456:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562432 00000100:00100000:0.0:1782759629.534505:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562304 00000100:00100000:0.0:1782759629.534508:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562304 00000100:00100000:0.0:1782759629.534532:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5232 00000100:00100000:0.0:1782759629.534541:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759629.534640:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759629.534648:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5232 00000100:00100000:0.0:1782759629.534663:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5233 00000100:00100000:0.0:1782759629.534670:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218562304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759629.534694:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218562304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759629.534700:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5233 00000100:00100000:0.0:1782759629.534717:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562688 00000100:00100000:0.0:1782759629.534720:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562688 00000100:00100000:0.0:1782759629.534742:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562560 00000100:00100000:0.0:1782759629.534744:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562560 00000100:00100000:0.0:1782759629.534760:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3033 00000100:00100000:0.0:1782759629.534765:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759629.534788:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759629.534804:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3033 00000100:00100000:0.0:1782759629.534814:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3034 00000100:00100000:0.0:1782759629.534819:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218562560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759629.534841:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218562560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759629.534847:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3034 00000100:00100000:3.0:1782759629.535061:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562176 00000100:00100000:3.0:1782759629.535066:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562176 00000100:00100000:3.0:1782759629.535101:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3281 00000100:00100000:3.0:1782759629.535108:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218562176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759629.535146:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218562176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759629.535151:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3281 00000100:00080000:3.0:1782759629.535192:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759629.535197:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759629.535200:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759629.535202:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759629.708703:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759630.660897:0:153730:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0b9d65c0 20000000:00000080:2.0:1782759630.660916:0:153730:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6fc00 uarg=0000000000000000 10000000:01000000:2.0:1782759630.661406:0:153730:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759630.661428:0:153730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.661444:0:153730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.661456:0:153730:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.661472:0:153730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.661479:0:153730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.662335:0:153730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.662349:0:153730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759630.662354:0:153730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.662362:0:153730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.662374:0:153730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.662383:0:153730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.662390:0:153730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb766000/0xd5b45c7f5c60d237 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759630.668631:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759630.668638:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759630.668643:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759630.668706:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759630.668717:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759630.668730:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759630.668755:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232993152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759630.668824:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759630.668871:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759630.668951:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993152 00000100:00100000:2.0:1782759630.668960:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993152 00000100:00100000:2.0:1782759630.669020:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282 00000100:00100000:2.0:1782759630.669030:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232993152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759630.669054:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759630.669069:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d23e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.669091:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.669100:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759630.669108:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767a00, rc 0) 00000100:00100000:2.0:1782759630.669149:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232993152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759630.669155:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282 00000100:00100000:1.0:1782759630.669432:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232993152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759630.669446:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759630.669455:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759630.669474:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759630.669480:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759630.669499:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759630.733104:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759631.755944:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232993280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759631.756022:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759631.756084:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759631.756097:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993280 00000100:00100000:1.0:1782759631.756103:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993280 00000100:00100000:1.0:1782759631.756173:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:1.0:1782759631.756181:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232993280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759631.756216:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1782759631.756259:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232993280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759631.756266:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:1.0:1782759631.756308:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232993280:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1782759631.805418:0:153778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff33a4eb50 20000000:00000080:0.0:1782759631.805437:0:153778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf944000 uarg=0000000000000000 00010000:00010000:0.0:1782759631.806209:0:153778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1782759631.806249:0:153778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:0.0:1782759631.806254:0:153778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759631.806266:0:153778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d1b9 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2751a expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.806286:0:153778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd300) 00010000:00010000:0.0:1782759631.806289:0:153778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782759631.806293:0:153778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d1e3 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27528 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.806311:0:153778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759631.806313:0:153778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759631.806317:0:153778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d13b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb274f7 expref: 5 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.806339:0:153778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 3 locks, left on hash table 0. 00010000:00010000:0.0:1782759631.806366:0:153778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759631.806378:0:153778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759631.806393:0:153778:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759631.806407:0:153778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.806419:0:153778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.806427:0:153778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.806461:0:153778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.807994:0:153778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 23 pid: 6524 timeout: 3822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759631.808018:0:153778:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153778:1869355232993408:0@lo:104: 00000100:00100000:0.0:1782759631.808089:0:153778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759631.808186:0:153778:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759631.813381:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993408 00000100:00100000:1.0:1782759631.813398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993408 00000100:00100000:0.0:1782759631.813561:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1782759631.813572:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:153778:x1869355232993408:12345-0@lo:104: 00010000:00010000:0.0:1782759631.813624:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759631.813984:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759631.814005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:153778:x1869355232993408:12345-0@lo:104: Request processed in 435us (5916us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759631.814012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1782759631.814146:0:153778:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:153778:1869355232993408:0@lo:104: 00010000:00010000:3.0:1782759631.814178:0:153778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814291:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759631.814298:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814306:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759631.814311:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814319:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759631.814325:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759631.814330:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759631.814371:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814384:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759631.814414:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814421:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4e00/0xd5b45c7f5c60d23e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d245 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814438:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759631.814440:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759631.814441:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759631.814489:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232993536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759631.814530:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759631.814849:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993536 00000100:00100000:1.0:1782759631.814855:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993536 00010000:00010000:1.0:1782759631.814877:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 24 pid: 6524 timeout: 3822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759631.814909:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1782759631.814915:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232993536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759631.814936:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759631.814942:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 24 pid: 6524 timeout: 3822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814953:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 24 pid: 6524 timeout: 3822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814967:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d245 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d23e expref: 24 pid: 6524 timeout: 3822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.814981:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815001:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815016:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815023:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815029:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815035:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815041:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759631.815045:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815052:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815061:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759631.815070:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759631.815104:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232993536:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759631.815111:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:1.0:1782759631.815137:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232993536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759631.815305:0:153778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759631.815313:0:153778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759631.815319:0:153778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d24c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 153778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759632.779497:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232993920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.779615:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759632.779794:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232993664:0@lo:400:kworker.0 00000100:00100000:2.0:1782759632.779831:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759632.779884:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759632.779890:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232993792:0@lo:400:kworker.0 00000100:00100000:2.0:1782759632.779914:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759632.779944:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993664 00000100:00100000:2.0:1782759632.779951:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993664 00000100:00100000:2.0:1782759632.780003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:2.0:1782759632.780012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232993664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759632.780063:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232993664:12345-0@lo:400:kworker.0 Request processed in 51us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759632.780087:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:2.0:1782759632.780122:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993792 00000100:00100000:2.0:1782759632.780126:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993792 00000100:00100000:2.0:1782759632.780156:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:2.0:1782759632.780164:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232993792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759632.780196:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232993792:12345-0@lo:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759632.780202:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00000100:00100000:2.0:1782759632.780239:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232993792:0@lo:400:kworker.0 00000100:00100000:2.0:1782759632.780248:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232993664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.780451:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232993920 00000100:00100000:0.0:1782759632.780455:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232993920 00000100:00100000:0.0:1782759632.780515:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:0.0:1782759632.780522:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232993920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.780593:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232993920:12345-0@lo:400:kworker.0 Request processed in 55us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.780600:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00000100:00100000:1.0:1782759632.780852:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232994048:0@lo:400:kworker.0 00000100:00100000:1.0:1782759632.780885:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759632.780955:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232993920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.781765:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994048 00000100:00100000:0.0:1782759632.781772:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994048 00000100:00100000:0.0:1782759632.781809:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:0.0:1782759632.781817:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232994048:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1782759632.782450:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759632.797970:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3665:x1869355232994048:12345-0@lo:400:kworker.0 Request processed in 16142us (17073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.797986:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000100:00100000:0.0:1782759632.798065:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759632.798077:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232994176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798134:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.798181:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232994304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798204:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.798229:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994304 00000100:00100000:0.0:1782759632.798235:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994304 00000100:00100000:0.0:1782759632.798280:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:0.0:1782759632.798303:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232994304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798351:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232994304:12345-0@lo:400:kworker.0 Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.798357:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00000100:00080000:0.0:1782759632.798373:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759632.798403:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232994304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798438:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232994432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798461:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.798500:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994432 00000100:00100000:0.0:1782759632.798504:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994432 00000100:00100000:0.0:1782759632.798530:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:0.0:1782759632.798537:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232994432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798601:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232994432:12345-0@lo:400:kworker.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.798618:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000100:00080000:0.0:1782759632.798644:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759632.798818:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232994432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798846:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759632.798852:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232994560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798877:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.798900:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994560 00000100:00100000:0.0:1782759632.798903:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994560 00000100:00100000:0.0:1782759632.798934:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3035 00000100:00100000:0.0:1782759632.798940:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232994560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.798976:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232994560:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.798992:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3035 00000100:00080000:0.0:1782759632.799006:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759632.799026:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232994560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799054:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759632.799060:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232994688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799082:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.799106:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994688 00000100:00100000:0.0:1782759632.799109:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994688 00000100:00100000:0.0:1782759632.799135:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3036 00000100:00100000:0.0:1782759632.799141:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232994688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799174:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232994688:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.799181:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3036 00000100:00080000:0.0:1782759632.799192:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759632.799209:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232994688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799236:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232994816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799256:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.799289:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232994944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799310:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.799329:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994816 00000100:00100000:0.0:1782759632.799332:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994816 00000100:00100000:0.0:1782759632.799354:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994944 00000100:00100000:0.0:1782759632.799356:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994944 00000100:00100000:0.0:1782759632.799372:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:0.0:1782759632.799378:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232994816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.799419:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355232994816:12345-0@lo:400:kworker.0 Request processed in 40us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.799425:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000100:00100000:0.0:1782759632.799437:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239 00000100:00100000:0.0:1782759632.799443:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232994944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.802913:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232994944:12345-0@lo:400:kworker.0 Request processed in 26us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.802930:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239 00000100:00080000:0.0:1782759632.802979:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759632.802984:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759632.803038:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232994944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.803076:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355232994816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.803134:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759632.803143:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232995072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.803199:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.803237:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995072 00000100:00100000:0.0:1782759632.803242:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995072 00000100:00100000:0.0:1782759632.803285:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3037 00000100:00100000:0.0:1782759632.803293:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232995072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.803337:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232995072:12345-0@lo:400:kworker.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.803344:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3037 00000100:00080000:0.0:1782759632.803357:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759632.803373:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232995072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.803400:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759632.803421:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232995200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.803448:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759632.805840:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995200 00000100:00100000:0.0:1782759632.805856:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995200 00000100:00100000:0.0:1782759632.805935:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3038 00000100:00100000:0.0:1782759632.805945:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232995200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759632.806036:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232995200:12345-0@lo:400:kworker.0 Request processed in 92us (2586us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759632.806044:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3038 00000100:00100000:0.0:1782759632.806098:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232995200:0@lo:400:kworker.0 00000100:00080000:3.0:1782759632.807642:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759632.809808:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232994176 00000100:00100000:3.0:1782759632.809822:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232994176 00000100:00100000:3.0:1782759632.809891:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:3.0:1782759632.809902:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759632.809993:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232994176:12345-0@lo:400:kworker.0 Request processed in 94us (11859us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759632.810001:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00000100:00100000:0.0:1782759632.810140:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232994176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759632.810617:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355232994048:0@lo:400:kworker.0 10000000:01000000:3.0:1782759633.101666:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759633.101673:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759633.101689:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759633.101739:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759633.101751:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759633.101762:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759633.101789:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232995328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759633.101862:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759633.101926:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759633.105692:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995328 00000100:00100000:1.0:1782759633.105707:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995328 00000100:00100000:1.0:1782759633.105790:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:1.0:1782759633.105801:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232995328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759633.105819:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759633.105839:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d253 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.105866:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.105878:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759633.105887:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759633.105963:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232995328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759633.105970:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00100000:0.0:1782759633.110017:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232995328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759633.110054:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.110066:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759633.110090:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759633.110096:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759633.110103:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759633.290761:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759633.290792:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232995456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759633.290860:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759633.290922:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995456 00000100:00100000:3.0:1782759633.290944:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995456 00000100:00100000:3.0:1782759633.290989:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:3.0:1782759633.290997:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232995456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759633.291028:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759633.291069:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232995456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759633.291076:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:3.0:1782759633.291139:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232995456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759633.292140:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232995584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759633.292208:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759633.292325:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995584 00000100:00100000:2.0:1782759633.292331:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995584 00000100:00100000:2.0:1782759633.292389:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2709 00000100:00100000:2.0:1782759633.292398:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232995584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759633.292416:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759633.292454:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232995584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759633.292461:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2709 00000100:00100000:0.0:1782759633.292554:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232995584:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759633.803112:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759634.314785:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232995712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759634.314859:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759634.314940:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995712 00000100:00100000:3.0:1782759634.314949:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995712 00000100:00100000:3.0:1782759634.315001:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2710 00000100:00100000:3.0:1782759634.315011:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232995712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759634.315042:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759634.315084:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232995712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759634.315091:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2710 00000100:00080000:3.0:1782759634.315111:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759634.315145:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232995712:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759634.315394:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759634.315403:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232995840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759634.315431:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759634.315470:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995840 00000100:00100000:0.0:1782759634.315474:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995840 00000100:00100000:0.0:1782759634.315502:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1782759634.315508:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232995840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759634.315523:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759634.315566:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355232995840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759634.315572:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:0.0:1782759634.315626:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355232995840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759634.317670:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759634.317686:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232995968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759634.317742:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759634.317795:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232995968 00000100:00100000:3.0:1782759634.317801:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232995968 00000100:00100000:3.0:1782759634.317871:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1782759634.317879:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232995968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759634.317909:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:3.0:1782759634.317951:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232995968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759634.317959:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00080000:3.0:1782759634.317981:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759634.318009:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232995968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759634.665687:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759634.665737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759634.665771:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759634.665794:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759634.665820:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759634.665849:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563200 00000100:00100000:0.0:1782759634.665858:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563200 00000100:00100000:0.0:1782759634.665915:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563328 00000100:00100000:0.0:1782759634.665919:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563328 00000100:00100000:0.0:1782759634.665944:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3039 00000100:00100000:0.0:1782759634.665954:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218563200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759634.666027:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218563200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759634.666045:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3039 00000100:00100000:0.0:1782759634.666061:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3040 00000100:00100000:0.0:1782759634.666068:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759634.666092:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759634.666098:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3040 00000100:00100000:0.0:1782759634.666115:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562816 00000100:00100000:0.0:1782759634.666118:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562816 00000100:00100000:0.0:1782759634.666147:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3285 00000100:00100000:0.0:1782759634.666155:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218562816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759634.666179:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218562816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759634.666185:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3285 00000100:00100000:0.0:1782759634.666212:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218562944 00000100:00100000:0.0:1782759634.666215:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218562944 00000100:00100000:0.0:1782759634.666241:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563072 00000100:00100000:0.0:1782759634.666244:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563072 00000100:00100000:0.0:1782759634.666263:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5240 00000100:00100000:0.0:1782759634.666269:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759634.666295:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218562944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759634.666301:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5240 00000100:00100000:0.0:1782759634.666312:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5241 00000100:00100000:0.0:1782759634.666317:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759634.666347:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759634.666352:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5241 00000100:00080000:3.0:1782759634.666628:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759634.666633:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759634.666635:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759634.666637:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759634.833638:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759635.852687:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759636.876814:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232996096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759636.876885:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759636.876943:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759636.876959:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996096 00000100:00100000:1.0:1782759636.876965:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996096 00000100:00100000:1.0:1782759636.877035:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:1.0:1782759636.877045:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232996096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759636.877093:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1782759636.877149:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232996096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759636.877156:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00000100:00100000:1.0:1782759636.877211:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232996096:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759636.955085:0:154022:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdef2c2560 20000000:00000080:1.0:1782759636.955103:0:154022:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12e8000 uarg=0000000000000000 00010000:00010000:1.0:1782759636.955292:0:154022:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759636.955309:0:154022:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759636.955331:0:154022:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759636.955342:0:154022:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759636.955358:0:154022:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759636.955378:0:154022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759636.955395:0:154022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759636.955404:0:154022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759636.955436:0:154022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759636.955449:0:154022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 23 pid: 6526 timeout: 3827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759636.955474:0:154022:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154022:1869355232996224:0@lo:104: 00000100:00100000:1.0:1782759636.955538:0:154022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759636.955755:0:154022:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759636.955790:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996224 00000100:00100000:0.0:1782759636.955796:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996224 00000100:00100000:0.0:1782759636.955870:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:0.0:1782759636.955880:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:154022:x1869355232996224:12345-0@lo:104: 00010000:00010000:0.0:1782759636.955892:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759636.955974:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759636.955981:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:154022:x1869355232996224:12345-0@lo:104: Request processed in 103us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759636.955988:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1782759636.956035:0:154022:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154022:1869355232996224:0@lo:104: 00010000:00010000:1.0:1782759636.956051:0:154022:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956081:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759636.956088:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956096:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759636.956100:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956114:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759636.956122:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759636.956128:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759636.956157:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956163:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759636.956182:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956189:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5000/0xd5b45c7f5c60d253 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d25a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956203:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759636.956204:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759636.956206:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759636.956216:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232996352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759636.956243:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759636.956275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996352 00000100:00100000:2.0:1782759636.956278:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996352 00010000:00010000:2.0:1782759636.956303:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 24 pid: 6526 timeout: 3827 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759636.956325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1782759636.956333:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355232996352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759636.956350:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759636.956355:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 24 pid: 6526 timeout: 3827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956365:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 24 pid: 6526 timeout: 3827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956376:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d25a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d253 expref: 24 pid: 6526 timeout: 3827 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956387:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956395:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956406:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956413:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956420:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956426:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956431:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759636.956435:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956451:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956461:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759636.956470:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759636.956493:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355232996352:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759636.956499:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1782759636.956536:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355232996352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759636.956617:0:154022:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759636.956625:0:154022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759636.956631:0:154022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d261 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759637.706791:0:154070:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebfb8e840 20000000:00000080:1.0:1782759637.706809:0:154070:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12ebc00 uarg=0000000000000000 00010000:00010000:1.0:1782759637.707022:0:154070:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759637.707039:0:154070:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759637.707062:0:154070:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759637.707074:0:154070:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759637.707088:0:154070:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759637.707108:0:154070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707122:0:154070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707144:0:154070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707153:0:154070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707160:0:154070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707168:0:154070:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707174:0:154070:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759637.707179:0:154070:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707187:0:154070:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707200:0:154070:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707208:0:154070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.707214:0:154070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d268 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759637.898678:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759637.903233:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232996736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903297:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759637.903337:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232997248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903360:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759637.903378:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232997760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903395:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759637.903412:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759637.903417:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232996864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903433:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759637.903443:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232997376:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903461:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759637.903483:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232997888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903508:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759637.903533:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996736 00000100:00100000:3.0:1782759637.903546:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996736 00000100:00100000:3.0:1782759637.903622:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:3.0:1782759637.903630:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232996736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903675:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355232996736:12345-0@lo:400:kworker.0 Request processed in 46us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759637.903681:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:3.0:1782759637.903699:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997248 00000100:00100000:3.0:1782759637.903702:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997248 00000100:00100000:3.0:1782759637.903726:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997760 00000100:00100000:3.0:1782759637.903728:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997760 00000100:00100000:3.0:1782759637.903740:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996864 00000100:00100000:3.0:1782759637.903741:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996864 00000100:00100000:3.0:1782759637.903753:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5242 00000100:00100000:3.0:1782759637.903758:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232997248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903781:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355232997248:12345-0@lo:400:kworker.0 Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759637.903787:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5242 00000100:00100000:3.0:1782759637.903795:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5243 00000100:00100000:3.0:1782759637.903800:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232997760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903818:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355232997760:12345-0@lo:400:kworker.0 Request processed in 18us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759637.903823:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5243 00000100:00100000:3.0:1782759637.903831:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5244 00000100:00100000:3.0:1782759637.903836:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232996864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903854:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232996864:12345-0@lo:400:kworker.0 Request processed in 19us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759637.903859:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5244 00000100:00080000:3.0:1782759637.903877:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759637.903900:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232996864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903910:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232996736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903916:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355232997248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.903924:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355232997760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904537:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232996480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904569:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904620:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232996992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904639:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904654:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232997504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904670:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904682:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232998016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904698:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904711:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759637.904716:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232996608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904741:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904753:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232997120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904768:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904779:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232997632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904794:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759637.904811:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996608 00000100:00100000:0.0:1782759637.904814:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996608 00000100:00100000:0.0:1782759637.904831:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997120 00000100:00100000:0.0:1782759637.904833:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997120 00000100:00100000:0.0:1782759637.904848:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997632 00000100:00100000:0.0:1782759637.904850:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997632 00000100:00100000:0.0:1782759637.904861:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5245 00000100:00100000:0.0:1782759637.904866:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232996608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904894:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232996608:12345-0@lo:400:kworker.0 Request processed in 28us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.904900:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5245 00000100:00100000:0.0:1782759637.904911:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5246 00000100:00100000:0.0:1782759637.904916:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232997120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904935:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355232997120:12345-0@lo:400:kworker.0 Request processed in 19us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.904940:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5246 00000100:00100000:0.0:1782759637.904948:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5247 00000100:00100000:0.0:1782759637.904953:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232997632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.904971:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355232997632:12345-0@lo:400:kworker.0 Request processed in 18us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.904976:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5247 00000100:00100000:0.0:1782759637.904998:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997376 00000100:00100000:0.0:1782759637.905001:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997376 00000100:00100000:0.0:1782759637.905022:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997888 00000100:00100000:0.0:1782759637.905024:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997888 00000100:00100000:0.0:1782759637.905036:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232997504 00000100:00100000:0.0:1782759637.905038:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232997504 00000100:00100000:0.0:1782759637.905048:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998016 00000100:00100000:0.0:1782759637.905050:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998016 00000100:00100000:0.0:1782759637.905062:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3041 00000100:00100000:0.0:1782759637.905068:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232997376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905102:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232997376:12345-0@lo:400:kworker.0 Request processed in 34us (1639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.905108:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3041 00000100:00100000:0.0:1782759637.905119:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1782759637.905124:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232997888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905148:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355232997888:12345-0@lo:400:kworker.0 Request processed in 23us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.905153:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3042 00000100:00100000:0.0:1782759637.905174:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1782759637.905180:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232997504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905205:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232997504:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.905211:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3043 00000100:00100000:0.0:1782759637.905221:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1782759637.905226:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232998016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905252:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232998016:12345-0@lo:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759637.905265:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3044 00000100:00100000:0.0:1782759637.905315:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232996608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905324:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355232997120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905332:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355232997632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905340:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232997504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905348:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232998016:0@lo:400:kworker.0 00000100:00080000:0.0:1782759637.905376:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759637.905379:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759637.905381:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759637.905396:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232997376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759637.905405:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355232997888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759637.908799:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996992 00000100:00100000:1.0:1782759637.908824:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996992 00000100:00100000:1.0:1782759637.908891:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:1.0:1782759637.908899:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232996992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759637.908982:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232996992:12345-0@lo:400:kworker.0 Request processed in 84us (4341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759637.908989:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:1.0:1782759637.909032:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232996992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.914305:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232996480 00000100:00100000:3.0:1782759637.914321:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232996480 00000100:00100000:3.0:1782759637.914386:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3286 00000100:00100000:3.0:1782759637.914398:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232996480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759637.914486:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355232996480:12345-0@lo:400:kworker.0 Request processed in 91us (9915us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759637.914493:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3286 00000100:00100000:1.0:1782759637.915747:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355232996480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759638.413619:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759638.413643:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232998144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759638.413726:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759638.413798:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998144 00000100:00100000:1.0:1782759638.413804:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998144 00000100:00100000:1.0:1782759638.413850:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:1.0:1782759638.413859:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232998144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759638.413886:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759638.413925:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232998144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759638.413931:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:1.0:1782759638.413971:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232998144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759638.414313:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759638.414322:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232998272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759638.414349:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759638.414374:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998272 00000100:00100000:2.0:1782759638.414378:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998272 00000100:00100000:2.0:1782759638.414411:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2713 00000100:00100000:2.0:1782759638.414418:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232998272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759638.414427:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759638.414456:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355232998272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759638.414463:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2713 00000100:00100000:2.0:1782759638.414491:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232998272:0@lo:13:osp-pre-1-1.0 10000000:01000000:1.0:1782759638.858755:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759638.858763:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759638.858768:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759638.858817:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.858830:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.858857:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759638.858881:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232998400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759638.858950:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759638.859008:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759638.859079:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998400 00000100:00100000:3.0:1782759638.859086:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998400 00000100:00100000:3.0:1782759638.859143:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:3.0:1782759638.859152:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355232998400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759638.859172:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759638.859185:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d26f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.859208:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.859220:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759638.859229:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:3.0:1782759638.859272:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355232998400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759638.859279:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:1.0:1782759638.859471:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355232998400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759638.859485:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.859503:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759638.859522:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759638.859527:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.859534:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759638.924340:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759639.434872:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759639.434896:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232998528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759639.434966:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759639.435041:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759639.435049:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232998656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759639.435072:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759639.435417:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998528 00000100:00100000:1.0:1782759639.435425:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998528 00000100:00100000:1.0:1782759639.435500:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998656 00000100:00100000:1.0:1782759639.435503:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998656 00000100:00100000:1.0:1782759639.435529:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1782759639.435538:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232998528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759639.435628:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759639.435677:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232998528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759639.435684:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00100000:1.0:1782759639.435701:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00100000:1.0:1782759639.435707:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232998656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759639.435716:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759639.435744:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355232998656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759639.435749:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00100000:1.0:1782759639.435806:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232998656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759639.435835:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232998528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759639.436140:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759639.436190:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759639.436199:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232998784:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759639.436227:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759639.436291:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998784 00000100:00100000:0.0:1782759639.436295:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998784 00000100:00100000:0.0:1782759639.436341:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1782759639.436348:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232998784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759639.436368:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759639.436412:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355232998784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759639.436418:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:3.0:1782759639.436485:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355232998784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759639.778606:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759639.778680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759639.778697:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759639.778725:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759639.778746:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759639.779458:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563456 00000100:00100000:2.0:1782759639.779468:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563456 00000100:00100000:2.0:1782759639.779544:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3288 00000100:00100000:2.0:1782759639.779565:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218563456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759639.779653:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218563456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 89us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759639.779660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3288 00000100:00100000:0.0:1782759639.790926:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563712 00000100:00100000:0.0:1782759639.790941:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563712 00000100:00100000:0.0:1782759639.791021:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563584 00000100:00100000:0.0:1782759639.791025:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563584 00000100:00100000:0.0:1782759639.791055:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5248 00000100:00100000:0.0:1782759639.791079:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759639.791389:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5249 00000100:00100000:2.0:1782759639.791407:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759639.791466:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 389us (12784us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759639.791501:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5248 00000100:00100000:0.0:1782759639.791530:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563840 00000100:00100000:0.0:1782759639.791533:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563840 00000100:00100000:0.0:1782759639.791573:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218563968 00000100:00100000:0.0:1782759639.791595:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218563968 00000100:00100000:0.0:1782759639.791619:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3045 00000100:00100000:0.0:1782759639.791625:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218563840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759639.791698:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759639.791703:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759639.791713:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759639.791716:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759639.796139:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1099 00000100:00100000:1.0:1782759639.796165:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218563968:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782759639.796199:0:8600:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60d1f1 00000100:00080000:1.0:1782759639.796210:0:8600:0:(import.c:65:import_set_state_nolock()) ffff8cddc3785000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759639.796259:0:8600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967412 00010000:00010000:2.0:1782759639.805731:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759639.807356:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218563840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 15720us (28619us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759639.807370:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3045 00000100:00100000:2.0:1782759639.808676:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218563584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 17272us (29970us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759639.808687:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5249 00000100:00100000:1.0:1782759639.825697:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+2:2401:x1869355218563968:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 29532us (46936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759639.825714:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1099 00010000:00010000:1.0:1782759639.946834:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759640.977848:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759641.504770:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759641.504996:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218564224 00000100:00100000:1.0:1782759641.505007:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218564224 00000100:00100000:1.0:1782759641.505081:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2986 00000100:00100000:1.0:1782759641.505093:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111427:x1869355218564224:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:1.0:1782759641.505112:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759641.505116:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782759641.505119:0:6531:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60d1b9) 00010000:00010000:1.0:1782759641.505122:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759641.505141:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d27d lrc: 2/0,0 mode: --/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2752f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.505255:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 3/0,1 mode: --/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.505270:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.505282:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 3/0,1 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.505325:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.505333:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.505340:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759641.505949:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00000100:00080000:0.0:1782759641.506160:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759641.508975:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d292 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.508998:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d292 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509010:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d292 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509051:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509059:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 4/0,1 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509065:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 3/0,0 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509072:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509078:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759641.509083:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 4/0,0 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509091:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 5/0,0 mode: CW/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509103:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:1.0:1782759641.509106:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759641.509111:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 3/0,0 mode: --/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509128:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d284 lrc: 0/0,0 mode: --/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759641.509141:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049451c13 reply state 0000000047d0fe0f transno 4294968024 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509152:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509159:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cdf02149500) 00010000:00010000:1.0:1782759641.509161:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759641.509164:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759641.509196:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d27d lrc: 0/0,0 mode: --/CW res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2752f expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509214:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d292 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2752f expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.509222:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149300) 00010000:00010000:1.0:1782759641.509225:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759641.509227:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759641.509947:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111427:x1869355218564224:12345-192.168.202.31@tcp:101:touch.500 Request processed in 4853us (5180us total) trans 4294968024 rc 0/0 00000100:00100000:1.0:1782759641.509957:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2986 00000100:00100000:0.0:1782759641.520637:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759641.520935:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218564480 00000100:00100000:1.0:1782759641.520945:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218564480 00000100:00100000:1.0:1782759641.520991:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2987 00000100:00100000:1.0:1782759641.521001:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111427:x1869355218564480:12345-192.168.202.31@tcp:36:touch.500 00010000:00010000:1.0:1782759641.521057:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759641.521082:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d292 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2752f expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.521098:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149300) 00010000:00010000:1.0:1782759641.521108:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759641.521157:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.521171:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.521181:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759641.521293:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf275dba reply state 00000000e33e3ff1 transno 4294968025 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.521305:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.521312:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:1.0:1782759641.521315:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759641.521317:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759641.521406:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111427:x1869355218564480:12345-192.168.202.31@tcp:36:touch.500 Request processed in 405us (840us total) trans 4294968025 rc 0/0 00000100:00100000:1.0:1782759641.521415:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2987 00000100:00100000:0.0:1782759641.527362:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759641.527420:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218564608 00000100:00100000:1.0:1782759641.527431:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218564608 00000100:00100000:1.0:1782759641.527494:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2988 00000100:00100000:1.0:1782759641.527512:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111427:x1869355218564608:12345-192.168.202.31@tcp:101:touch.500 00010000:00010000:1.0:1782759641.527537:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759641.527556:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d2a7 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27536 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.529168:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d2a7 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27536 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.529186:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d2a7 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27536 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.529207:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:0.0:1782759641.529211:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759641.529215:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:0.0:1782759641.529282:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:111427:x1869355218564608:12345-192.168.202.31@tcp:101:touch.500 Request processed in 1771us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759641.529300:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2988 00000100:00100000:3.0:1782759641.531507:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759641.531614:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218564736 00000100:00100000:0.0:1782759641.531624:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218564736 00000100:00100000:0.0:1782759641.531667:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1100 00000100:00100000:0.0:1782759641.531686:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1869355218564736:12345-192.168.202.31@tcp:8:touch.500 00010000:00080000:0.0:1782759641.531720:0:8447:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp t0 exp 0000000000000000 cur 3681 last 0 00000020:00000080:0.0:1782759641.531750:0:8447:0:(genops.c:1406:class_connect()) connect: client e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0, cookie 0xd5b45c7f5c60d2ae 00002000:00100000:0.0:1782759641.531762:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0/ffff8cddc4e20000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759641.531779:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782759641.531842:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782759641.531876:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cddc4d1f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759641.531935:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2401:x1869355218564736:12345-192.168.202.31@tcp:8:touch.500 Request processed in 249us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759641.531943:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1100 00000100:00100000:1.0:1782759641.541629:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759641.541728:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218564864 00000100:00100000:0.0:1782759641.541741:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218564864 00000100:00100000:0.0:1782759641.541815:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1101 00000100:00100000:0.0:1782759641.541824:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:0:x1869355218564864:12345-192.168.202.31@tcp:2:touch.500 00000100:00080000:3.0:1782759641.541991:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782759641.548800:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967413 is committed 00000001:00100000:3.0:1782759641.548815:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000001:00100000:3.0:1782759641.548820:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759641.548824:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc3780000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759641.548850:0:62521:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc3780000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:3.0:1782759641.548900:0:62521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc3785000 for lustre-OST0001 00000100:00100000:0.0:1782759641.549066:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:0:x1869355218564864:12345-192.168.202.31@tcp:2:touch.500 Request processed in 7237us (7441us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1782759641.549079:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1101 00000100:00100000:2.0:1782759641.560494:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759641.560547:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218565120 00000100:00100000:1.0:1782759641.560559:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218565120 00000100:00100000:0.0:1782759641.561564:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 351 00000100:00100000:0.0:1782759641.562296:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:111427:x1869355218565120:12345-192.168.202.31@tcp:35:touch.500 00000100:00100000:0.0:1782759641.562789:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111427:x1869355218565120:12345-192.168.202.31@tcp:35:touch.500 Request processed in 1212us (2316us total) trans 4294968026 rc 0/0 00000100:00100000:0.0:1782759641.562808:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 351 00000100:00100000:0.0:1782759641.597919:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759641.598422:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218565248 00000100:00100000:1.0:1782759641.598433:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218565248 00000100:00100000:1.0:1782759641.598502:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2989 00000100:00100000:1.0:1782759641.598513:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111428:x1869355218565248:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759641.598538:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759641.598559:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d2b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2753d expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598659:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598673:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598684:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598698:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598706:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598733:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598834:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d2ca lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598842:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d2ca lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598849:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d2ca lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759641.598882:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:1.0:1782759641.598886:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759641.598906:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d2ca lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598919:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.598926:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599354:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599361:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599368:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759641.599372:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599388:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599411:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759641.599415:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759641.599420:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599428:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429000/0xd5b45c7f5c60d2bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599443:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599450:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599456:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599462:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759641.599465:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599482:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599490:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x42be4999 (ffff8cdf02149300) 00010000:00010000:1.0:1782759641.599493:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759641.599496:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599512:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d2c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x42be4999 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599545:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d2b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2753d expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599560:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d2ca lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2753d expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759641.599568:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149800) 00010000:00010000:1.0:1782759641.599570:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759641.599573:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759641.599802:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111428:x1869355218565248:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 1289us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759641.599811:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2989 00000100:00100000:1.0:1782759641.614700:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759641.614856:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218565376 00000100:00100000:2.0:1782759641.614866:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218565376 00000100:00100000:2.0:1782759641.615012:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2990 00000100:00100000:2.0:1782759641.615024:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111428:x1869355218565376:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:2.0:1782759641.615061:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759641.615087:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d2d1 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27544 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615153:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615169:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615181:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615211:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615220:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615227:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615317:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615326:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615334:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759641.615377:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00000004:00200000:2.0:1782759641.615382:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759641.615418:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615431:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615440:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615448:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615465:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615482:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615489:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759641.615494:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615502:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615515:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149800) 00010000:00010000:2.0:1782759641.615518:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759641.615523:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615529:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d2d8 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615542:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615547:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615552:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615557:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759641.615566:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615572:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615609:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cdf02149500) 00010000:00010000:2.0:1782759641.615612:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759641.615615:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615621:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d2df lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615648:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d2d1 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27544 expref: 14 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615662:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27544 expref: 13 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.615668:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:2.0:1782759641.615670:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759641.615673:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766400, rc 0) 00000100:00100000:2.0:1782759641.615736:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111428:x1869355218565376:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 715us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759641.615743:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2990 00000100:00100000:3.0:1782759641.623415:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759641.623545:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218565504 00000100:00100000:1.0:1782759641.623559:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218565504 00000100:00100000:0.0:1782759641.623672:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1102 00000100:00100000:0.0:1782759641.623688:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218565504:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759641.623714:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759641.623736:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000683e39bb/0xd5b45c7f5c60d2ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2754b expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759641.623763:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a42c0da, atime: 0x6a42c0da, ctime: 0x6a42c0da, blocks: 0x0 00010000:00010000:0.0:1782759641.623784:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=3681s v=(0 0) 00010000:00010000:0.0:1782759641.623788:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759641.623799:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000683e39bb/0xd5b45c7f5c60d2ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2754b expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.623817:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000683e39bb/0xd5b45c7f5c60d2ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2754b expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.623832:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d200, rc 0) 00000100:00100000:0.0:1782759641.623899:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218565504:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 216us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759641.623907:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1102 00000100:00100000:3.0:1782759641.628805:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759641.628947:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218565760 00000100:00100000:2.0:1782759641.628957:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218565760 00000100:00100000:2.0:1782759641.629033:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2991 00000100:00100000:2.0:1782759641.629045:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111428:x1869355218565760:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:2.0:1782759641.629109:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759641.629138:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d2e6 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27544 expref: 13 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629157:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:2.0:1782759641.629162:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759641.629187:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629200:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629209:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629235:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629242:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629249:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629255:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759641.629259:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629266:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629285:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:2.0:1782759641.629288:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759641.629292:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.629299:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d2f4 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759641.629377:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111428:x1869355218565760:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 334us (579us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759641.629384:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2991 00000100:00100000:1.0:1782759641.650065:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759641.650482:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218565888 00000100:00100000:0.0:1782759641.650493:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218565888 00000100:00100000:0.0:1782759641.650555:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2992 00000100:00100000:0.0:1782759641.650566:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111429:x1869355218565888:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759641.650657:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759641.650677:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d2fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27552 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.650748:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d302 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.650762:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d302 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.650772:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d302 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759641.650822:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:0.0:1782759641.650827:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759641.650848:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d302 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.650872:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d2fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27552 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.650891:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d302 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27552 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759641.650900:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149800) 00010000:00010000:0.0:1782759641.650904:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759641.650908:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166ca00, rc 0) 00000100:00100000:0.0:1782759641.650962:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111429:x1869355218565888:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 398us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759641.650969:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2992 00000100:00100000:3.0:1782759641.666059:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759641.666157:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566016 00000100:00100000:2.0:1782759641.666167:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566016 00000100:00100000:2.0:1782759641.666230:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2993 00000100:00100000:2.0:1782759641.666241:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111429:x1869355218566016:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:2.0:1782759641.666325:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111429:x1869355218566016:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 85us (274us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759641.666333:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2993 00000100:00100000:3.0:1782759641.738670:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759641.738973:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566272 00000100:00100000:2.0:1782759641.738983:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566272 00000100:00100000:2.0:1782759641.739062:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2994 00000100:00100000:2.0:1782759641.739075:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111430:x1869355218566272:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759641.739131:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759641.739172:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d302 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27552 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739192:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149800) 00010000:00010000:2.0:1782759641.739207:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759641.739231:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739244:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739254:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739289:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739295:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739304:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739310:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759641.739314:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739322:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739329:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149800) 00010000:00010000:2.0:1782759641.739332:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759641.739335:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759641.739342:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60d309 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759641.739426:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111430:x1869355218566272:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 355us (766us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759641.739434:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2994 00000100:00100000:3.0:1782759641.995230:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759641.995252:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232998912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759641.995313:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759641.995424:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232998912 00000100:00100000:0.0:1782759641.995433:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232998912 00000100:00100000:0.0:1782759641.995519:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:0.0:1782759641.995530:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232998912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759641.995569:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:0.0:1782759641.995634:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355232998912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759641.995642:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:3.0:1782759641.995783:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355232998912:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759641.996176:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782759642.509802:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968026 is committed 00010000:00010000:3.0:1782759642.509880:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.509894:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.509901:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.509907:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759642.509912:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.509928:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.509945:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cdf02149500) 00010000:00010000:3.0:1782759642.509949:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759642.509954:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.509973:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428800/0xd5b45c7f5c60d28b lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510001:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510007:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510013:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510018:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759642.510020:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510026:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510034:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:3.0:1782759642.510036:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759642.510039:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.510044:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d2a0 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759642.813144:0:154266:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1d82b6c0 20000000:00000080:2.0:1782759642.813161:0:154266:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6f800 uarg=0000000000000000 00010000:00010000:2.0:1782759642.813376:0:154266:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759642.813414:0:154266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cdf02149800) 00010000:00010000:2.0:1782759642.813419:0:154266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759642.816288:0:154266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d2ca lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2753d expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.819014:0:154266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cdf02149b00) 00010000:00010000:3.0:1782759642.819026:0:154266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759642.819039:0:154266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d2a7 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27536 expref: 5 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.819087:0:154266:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1782759642.819192:0:154266:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759642.819205:0:154266:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759642.819226:0:154266:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759642.819242:0:154266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.819259:0:154266:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.819268:0:154266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.819312:0:154266:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.819327:0:154266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 23 pid: 6526 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759642.819342:0:154266:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154266:1869355232999040:0@lo:104: 00000100:00100000:3.0:1782759642.819413:0:154266:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759642.819973:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999040 00000100:00100000:2.0:1782759642.819981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999040 00000100:00100000:3.0:1782759642.820074:0:154266:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759642.839000:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1782759642.839022:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:154266:x1869355232999040:12345-0@lo:104: 00010000:00010000:3.0:1782759642.839042:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759642.839170:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759642.839188:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:154266:x1869355232999040:12345-0@lo:104: Request processed in 176us (19775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759642.839196:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1782759642.839343:0:154266:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154266:1869355232999040:0@lo:104: 00010000:00010000:1.0:1782759642.839371:0:154266:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.839521:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759642.839528:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.839536:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759642.839541:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.839550:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759642.839557:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759642.839573:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759642.839655:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.839662:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759642.839679:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.839685:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d26f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d276 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.839701:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759642.839703:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759642.839704:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759642.839801:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759642.839816:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232999168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759642.839858:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759642.840239:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999168 00000100:00100000:2.0:1782759642.840245:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999168 00010000:00010000:2.0:1782759642.840277:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 24 pid: 6526 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759642.840310:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1782759642.840319:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355232999168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759642.840331:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759642.840337:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 24 pid: 6526 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840347:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 24 pid: 6526 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840361:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5600/0xd5b45c7f5c60d276 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d26f expref: 24 pid: 6526 timeout: 3833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840381:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840389:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840403:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840411:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840418:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840424:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840555:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759642.840560:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.840569:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759642.872847:0:154266:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759642.872867:0:154266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.874788:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.874807:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d310 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759642.874846:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759642.875559:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355232999168:12345-0@lo:103:ldlm_bl.0 Request processed in 35237us (35696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759642.875572:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1782759642.875777:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355232999168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759643.018933:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759643.022240:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232999296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759643.022388:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759643.023438:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999296 00000100:00100000:0.0:1782759643.023447:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999296 00000100:00100000:0.0:1782759643.023518:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5250 00000100:00100000:0.0:1782759643.023698:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232999296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.023904:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232999424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.023940:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.023963:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232999936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.023985:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.024006:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233000448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024026:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.024043:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782759643.024049:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232999808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024069:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.024085:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233000320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024105:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.024131:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999936 00000100:00100000:1.0:1782759643.024135:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999936 00000100:00100000:1.0:1782759643.024180:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000448 00000100:00100000:1.0:1782759643.024183:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000448 00000100:00100000:1.0:1782759643.024195:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999808 00000100:00100000:1.0:1782759643.024197:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999808 00000100:00100000:1.0:1782759643.024205:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000320 00000100:00100000:1.0:1782759643.024206:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000320 00000100:00100000:1.0:1782759643.024216:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5251 00000100:00100000:1.0:1782759643.024221:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232999936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024275:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355232999936:12345-0@lo:400:kworker.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.024301:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5251 00000100:00100000:1.0:1782759643.024320:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1782759643.024326:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233000448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024367:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233000448:12345-0@lo:400:kworker.0 Request processed in 41us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.024373:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5252 00000100:00100000:1.0:1782759643.024392:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5253 00000100:00100000:1.0:1782759643.024398:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232999808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024422:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355232999808:12345-0@lo:400:kworker.0 Request processed in 24us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.024428:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5253 00000100:00100000:1.0:1782759643.024438:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5254 00000100:00100000:1.0:1782759643.024443:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355233000320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024477:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355233000320:12345-0@lo:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.024482:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5254 00000100:00100000:1.0:1782759643.024500:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232999552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024522:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.024934:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233000064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024962:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.024980:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233000576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.024999:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.025019:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759643.025025:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232999680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025058:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.025078:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233000192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025099:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.025114:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233000704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025136:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759643.025180:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999424 00000100:00100000:1.0:1782759643.025185:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999424 00000100:00100000:1.0:1782759643.025228:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999680 00000100:00100000:1.0:1782759643.025232:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999680 00000100:00100000:1.0:1782759643.025245:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:1.0:1782759643.025251:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232999424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025285:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355232999424:12345-0@lo:400:kworker.0 Request processed in 34us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.025441:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:1.0:1782759643.025464:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:1.0:1782759643.025472:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232999680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025506:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355232999680:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.025512:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:1.0:1782759643.025707:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355232999552 00000100:00100000:1.0:1782759643.025712:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355232999552 00000100:00100000:1.0:1782759643.025735:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5255 00000100:00100000:1.0:1782759643.025742:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232999552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025775:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355232999552:12345-0@lo:400:kworker.0 Request processed in 34us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.025782:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5255 00000100:00080000:1.0:1782759643.025819:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759643.025823:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759643.025833:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000064 00000100:00100000:1.0:1782759643.025837:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000064 00000100:00100000:1.0:1782759643.025867:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000576 00000100:00100000:1.0:1782759643.025869:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000576 00000100:00100000:1.0:1782759643.025881:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000192 00000100:00100000:1.0:1782759643.025883:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000192 00000100:00100000:1.0:1782759643.025892:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000704 00000100:00100000:1.0:1782759643.025894:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000704 00000100:00100000:1.0:1782759643.025907:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3046 00000100:00100000:1.0:1782759643.025913:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233000064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025946:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233000064:12345-0@lo:400:kworker.0 Request processed in 33us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.025952:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3046 00000100:00100000:1.0:1782759643.025963:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3047 00000100:00100000:1.0:1782759643.025968:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233000576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.025995:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233000576:12345-0@lo:400:kworker.0 Request processed in 27us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.026000:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3047 00000100:00100000:1.0:1782759643.026011:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3048 00000100:00100000:1.0:1782759643.026016:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233000192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026043:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233000192:12345-0@lo:400:kworker.0 Request processed in 27us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.026049:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3048 00000100:00100000:1.0:1782759643.026058:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3049 00000100:00100000:1.0:1782759643.026062:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233000704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026082:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233000704:12345-0@lo:400:kworker.0 Request processed in 20us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759643.026093:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3049 00000100:00080000:1.0:1782759643.026124:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759643.026126:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759643.026151:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355232999680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026173:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233000192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026180:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233000704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026187:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355232999552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026195:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233000064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759643.026202:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233000576:0@lo:400:kworker.0 00000100:00100000:3.0:1782759643.026800:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355232999808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759643.026817:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233000320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759643.026829:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355232999424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759643.026840:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355232999936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759643.026852:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233000448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759643.027284:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355232999296:12345-0@lo:400:kworker.0 Request processed in 3756us (4960us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759643.027302:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5250 00000100:00100000:2.0:1782759643.029325:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355232999296:0@lo:400:kworker.0 00000100:00100000:0.0:1782759643.532300:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759643.539862:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233000832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759643.539996:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759643.540748:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000832 00000100:00100000:0.0:1782759643.540763:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000832 00000100:00100000:0.0:1782759643.540850:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2716 00000100:00100000:0.0:1782759643.540861:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233000832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759643.540906:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759643.540988:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233000832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759643.540996:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2716 00000100:00100000:1.0:1782759643.541156:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233000832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759643.547294:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759643.547983:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233000960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759643.548213:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759643.548304:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233000960 00000100:00100000:2.0:1782759643.548314:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233000960 00000100:00100000:2.0:1782759643.549706:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00100000:2.0:1782759643.549722:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233000960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759643.549765:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759643.549873:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233000960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759643.549881:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00100000:3.0:1782759643.551283:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233000960:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759644.063082:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759644.330526:0:154314:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa088a4a0 20000000:00000080:1.0:1782759644.330552:0:154314:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf852800 uarg=0000000000000000 00010000:00010000:1.0:1782759644.331154:0:154314:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759644.331177:0:154314:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759644.331199:0:154314:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759644.331332:0:154314:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759644.331355:0:154314:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759644.331382:0:154314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.331402:0:154314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.331427:0:154314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336208:0:154314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336234:0:154314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336244:0:154314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336252:0:154314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759644.336257:0:154314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336269:0:154314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336291:0:154314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336302:0:154314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.336309:0:154314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d317 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759644.556918:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233001088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759644.557022:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759644.557111:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759644.557120:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233001216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759644.557150:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759644.557193:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001088 00000100:00100000:1.0:1782759644.557202:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001088 00000100:00100000:1.0:1782759644.557263:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1782759644.557273:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233001088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759644.557329:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759644.557834:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233001088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 560us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759644.557843:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00100000:1.0:1782759644.557875:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001216 00000100:00100000:1.0:1782759644.557880:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001216 00000100:00100000:1.0:1782759644.557931:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:1.0:1782759644.557939:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233001216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759644.557969:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1782759644.558004:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233001216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759644.558010:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00000100:00100000:1.0:1782759644.558059:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233001216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759644.558073:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233001088:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759644.561619:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759644.561651:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233001344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759644.561981:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759644.562054:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001344 00000100:00100000:0.0:1782759644.562064:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001344 00000100:00100000:0.0:1782759644.562134:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2719 00000100:00100000:0.0:1782759644.562145:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233001344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759644.562177:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759644.562240:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233001344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.562249:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2719 00000100:00100000:1.0:1782759644.562324:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233001344:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1782759644.749192:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759644.749202:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759644.749208:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759644.749270:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759644.749283:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759644.749296:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759644.749343:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233001472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759644.749456:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759644.749507:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759644.749710:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001472 00000100:00100000:1.0:1782759644.749720:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001472 00000100:00100000:1.0:1782759644.749789:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:1.0:1782759644.749800:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233001472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759644.749832:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759644.749849:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d31e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.749877:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.749890:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759644.749902:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428000, rc 0) 00000100:00100000:1.0:1782759644.749950:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233001472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759644.749958:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:3.0:1782759644.750961:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233001472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759644.750995:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759644.751006:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759644.751031:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759644.751037:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759644.751044:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759644.897289:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759644.897346:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759644.897380:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759644.897404:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759644.897432:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759644.897483:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566400 00000100:00100000:0.0:1782759644.897496:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566400 00000100:00100000:0.0:1782759644.897563:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3290 00000100:00100000:0.0:1782759644.897596:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218566400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759644.897695:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218566400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 121us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.897704:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3290 00000100:00100000:0.0:1782759644.901824:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566656 00000100:00100000:0.0:1782759644.901845:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566656 00000100:00100000:0.0:1782759644.901944:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566528 00000100:00100000:0.0:1782759644.901946:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566528 00000100:00100000:0.0:1782759644.901981:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5256 00000100:00100000:0.0:1782759644.902006:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218566656:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759644.902114:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218566656:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 110us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.902122:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5256 00000100:00100000:0.0:1782759644.902142:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5257 00000100:00100000:0.0:1782759644.902148:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218566528:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759644.902171:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218566528:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (4767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.902177:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5257 00000100:00100000:0.0:1782759644.902216:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566912 00000100:00100000:0.0:1782759644.902220:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566912 00000100:00100000:0.0:1782759644.902248:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218566784 00000100:00100000:0.0:1782759644.902251:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218566784 00000100:00100000:0.0:1782759644.902269:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3050 00000100:00100000:0.0:1782759644.902274:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218566912:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759644.902297:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218566912:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (4917us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.902304:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3050 00000100:00100000:0.0:1782759644.902313:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3051 00000100:00100000:0.0:1782759644.902318:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218566784:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759644.902336:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218566784:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 18us (4904us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759644.902341:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3051 00000100:00080000:0.0:1782759644.902530:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759644.902541:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759644.902544:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759644.902546:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759645.068564:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759646.091068:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759647.125002:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233001600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759647.125078:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759647.125145:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001600 00000100:00100000:0.0:1782759647.125153:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001600 00000100:00100000:0.0:1782759647.125213:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:0.0:1782759647.125222:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233001600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759647.125256:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:0.0:1782759647.125302:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233001600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759647.125309:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00000100:00100000:0.0:1782759647.125348:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233001600:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759647.129736:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759648.158180:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759648.159646:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233001728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.159719:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.159764:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233002240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.159792:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.159810:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233002752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.159835:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.159852:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233003264:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.159873:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.159895:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759648.159902:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233001856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.159934:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.159951:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233002368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.159998:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160016:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233002880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160037:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160065:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233001984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160089:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160106:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233002496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160125:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160140:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233003008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160160:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160178:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759648.160183:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233002112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160205:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160221:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233002624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160242:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160258:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233003136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160276:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759648.160302:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001728 00000100:00100000:3.0:1782759648.160309:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001728 00000100:00100000:3.0:1782759648.160347:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3291 00000100:00100000:3.0:1782759648.160354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233001728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160396:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233001728:12345-0@lo:400:kworker.0 Request processed in 42us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.160401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3291 00000100:00100000:3.0:1782759648.160441:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002240 00000100:00100000:3.0:1782759648.160445:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002240 00000100:00100000:3.0:1782759648.160490:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001984 00000100:00100000:3.0:1782759648.160494:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001984 00000100:00100000:3.0:1782759648.160510:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:3.0:1782759648.160515:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233002240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160546:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233002240:12345-0@lo:400:kworker.0 Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.160552:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00000100:00100000:3.0:1782759648.160562:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375 00000100:00100000:3.0:1782759648.160567:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233001984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160620:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233001984:12345-0@lo:400:kworker.0 Request processed in 53us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.160626:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375 00000100:00100000:3.0:1782759648.160644:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002752 00000100:00100000:3.0:1782759648.160647:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002752 00000100:00100000:3.0:1782759648.160677:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003264 00000100:00100000:3.0:1782759648.160680:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003264 00000100:00100000:3.0:1782759648.160689:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002624 00000100:00100000:3.0:1782759648.160691:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002624 00000100:00100000:3.0:1782759648.160705:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003136 00000100:00100000:3.0:1782759648.160707:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003136 00000100:00100000:3.0:1782759648.160721:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3052 00000100:00100000:3.0:1782759648.160726:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233002752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.160758:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233002752:12345-0@lo:400:kworker.0 Request processed in 31us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.160764:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3052 00000100:00100000:3.0:1782759648.161764:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1782759648.161773:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233003264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.161817:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233003264:12345-0@lo:400:kworker.0 Request processed in 46us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.163936:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3053 00000100:00100000:3.0:1782759648.164327:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3054 00000100:00100000:3.0:1782759648.164684:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233002624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.164769:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233002624:12345-0@lo:400:kworker.0 Request processed in 432us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.164776:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3054 00000100:00100000:3.0:1782759648.164792:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1782759648.164798:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233003136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.164828:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233003136:12345-0@lo:400:kworker.0 Request processed in 30us (4550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.164834:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3055 00000100:00100000:3.0:1782759648.164861:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233001856 00000100:00100000:3.0:1782759648.164870:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233001856 00000100:00100000:3.0:1782759648.164898:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002368 00000100:00100000:3.0:1782759648.164902:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002368 00000100:00100000:3.0:1782759648.164917:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002880 00000100:00100000:3.0:1782759648.164920:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002880 00000100:00100000:3.0:1782759648.164932:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002496 00000100:00100000:3.0:1782759648.164935:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002496 00000100:00100000:3.0:1782759648.164947:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003008 00000100:00100000:3.0:1782759648.164949:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003008 00000100:00100000:3.0:1782759648.164966:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233002112 00000100:00100000:3.0:1782759648.164969:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233002112 00000100:00100000:3.0:1782759648.165102:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00000100:00100000:3.0:1782759648.165111:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233001856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165156:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233001856:12345-0@lo:400:kworker.0 Request processed in 47us (5221us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.165163:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00000100:00100000:3.0:1782759648.165189:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:3.0:1782759648.165195:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233002368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165224:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233002368:12345-0@lo:400:kworker.0 Request processed in 30us (5226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.165230:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00100000:3.0:1782759648.165241:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00000100:00100000:3.0:1782759648.165246:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233002880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165271:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233002880:12345-0@lo:400:kworker.0 Request processed in 25us (5234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.165277:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00000100:00100000:3.0:1782759648.165286:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00000100:00100000:3.0:1782759648.165291:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233002496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165317:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233002496:12345-0@lo:400:kworker.0 Request processed in 27us (5191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.165322:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00000100:00100000:3.0:1782759648.165331:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1782759648.165336:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233003008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165490:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233003008:12345-0@lo:400:kworker.0 Request processed in 153us (5328us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.165497:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00000100:00100000:3.0:1782759648.165511:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:3.0:1782759648.165517:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233002112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165706:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233002112:12345-0@lo:400:kworker.0 Request processed in 189us (5500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759648.165714:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:3.0:1782759648.165861:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233001856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165878:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233002368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165892:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233002880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.165975:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233001728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166119:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233002240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166138:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233002752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166155:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233003264:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166224:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233002112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166237:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233002624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166248:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233003136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166262:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233001984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166274:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233002496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759648.166288:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233003008:0@lo:400:kworker.0 00000100:00080000:3.0:1782759648.166325:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759648.166330:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759648.166333:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759648.166335:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759648.650746:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759648.650767:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233003392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759648.650837:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759648.650898:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003392 00000100:00100000:1.0:1782759648.650914:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003392 00000100:00100000:1.0:1782759648.650954:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1782759648.650962:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233003392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759648.650989:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759648.651029:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233003392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759648.651036:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00100000:1.0:1782759648.651077:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233003392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759648.652879:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759648.652894:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233003520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759648.652948:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759648.652986:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003520 00000100:00100000:1.0:1782759648.652990:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003520 00000100:00100000:1.0:1782759648.653029:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1782759648.653037:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233003520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759648.653053:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759648.653087:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233003520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759648.653093:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00100000:1.0:1782759648.653124:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233003520:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759649.173726:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759649.526418:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759649.527426:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218567040 00000100:00100000:0.0:1782759649.527439:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218567040 00000100:00100000:0.0:1782759649.527518:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2995 00000100:00100000:0.0:1782759649.527527:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111512:x1869355218567040:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759649.527547:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759649.527569:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d32c lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27559 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527657:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527671:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527695:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527708:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527715:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527722:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527817:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527825:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527832:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759649.527865:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1782759649.527869:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759649.527885:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527896:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527905:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527920:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527925:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527931:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527937:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759649.527940:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527949:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527961:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc24d2500) 00010000:00010000:0.0:1782759649.527964:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759649.527968:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527975:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d333 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527988:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527993:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.527998:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528009:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ca00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759649.528012:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528017:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528025:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759649.528027:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759649.528030:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528035:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d33a lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528078:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d32c lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27559 expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528094:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27559 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.528102:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:0.0:1782759649.528104:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759649.528106:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166da00, rc 0) 00000100:00100000:0.0:1782759649.528168:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111512:x1869355218567040:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 641us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759649.528175:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2995 00000100:00080000:3.0:1782759649.528713:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759649.531003:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759649.531225:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218567296 00000100:00100000:3.0:1782759649.531234:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218567296 00000100:00100000:3.0:1782759649.531299:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2996 00000100:00100000:3.0:1782759649.531308:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111512:x1869355218567296:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:3.0:1782759649.531361:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759649.531387:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d341 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27559 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531415:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc24d2600) 00010000:00010000:3.0:1782759649.531430:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759649.531459:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531472:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531483:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531509:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531516:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531523:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531529:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759649.531532:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531540:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531555:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:3.0:1782759649.531557:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759649.531561:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 2/0,0 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.531567:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d348 lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759649.531678:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111512:x1869355218567296:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 370us (682us total) trans 0 rc -1/-1 00000100:00100000:3.0:1782759649.531685:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2996 00000100:00100000:0.0:1782759649.564017:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759649.564094:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218567424 00000100:00100000:3.0:1782759649.564104:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218567424 00000100:00100000:3.0:1782759649.564161:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2997 00000100:00100000:3.0:1782759649.564169:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111513:x1869355218567424:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759649.564190:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759649.564208:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27560 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.564275:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d356 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.564294:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d356 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.564305:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d356 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759649.564364:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1782759649.564379:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759649.564417:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d356 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.564440:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27560 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.564455:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d356 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27560 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759649.564463:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:3.0:1782759649.564466:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759649.564469:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759649.564533:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111513:x1869355218567424:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 364us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759649.564540:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2997 00000100:00100000:2.0:1782759649.575308:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759649.575411:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218567552 00000100:00100000:0.0:1782759649.575421:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218567552 00000100:00100000:0.0:1782759649.575479:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2998 00000100:00100000:0.0:1782759649.575489:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111513:x1869355218567552:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:0.0:1782759649.575603:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111513:x1869355218567552:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 115us (303us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759649.575611:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2998 00000100:00100000:0.0:1782759649.649198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759649.649238:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218567808 00000100:00100000:0.0:1782759649.649249:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218567808 00000100:00100000:0.0:1782759649.649297:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 2999 00000100:00100000:0.0:1782759649.649307:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111514:x1869355218567808:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759649.649357:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759649.649383:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d356 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27560 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649411:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:0.0:1782759649.649422:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759649.649447:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649459:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649468:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649496:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649511:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 2/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649518:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649523:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ca00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759649.649527:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 3/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649535:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 4/0,0 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649543:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc24d2500) 00010000:00010000:0.0:1782759649.649546:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759649.649549:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 2/0,0 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759649.649555:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d35d lrc: 0/0,0 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759649.649648:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111514:x1869355218567808:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 342us (458us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759649.649655:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 2999 00000100:00100000:1.0:1782759649.675165:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233003776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759649.675234:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759649.675337:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003776 00000100:00100000:0.0:1782759649.675345:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003776 00000100:00100000:0.0:1782759649.675395:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2722 00000100:00100000:0.0:1782759649.675414:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233003776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759649.675444:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759649.675506:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233003776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759649.675514:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2722 00000100:00100000:2.0:1782759649.675528:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233003648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759649.675558:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233003776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759649.675560:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759649.675604:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003648 00000100:00100000:2.0:1782759649.675609:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003648 00000100:00100000:2.0:1782759649.675668:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:2.0:1782759649.675677:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233003648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759649.675701:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:2.0:1782759649.675751:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233003648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759649.675757:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:1.0:1782759649.675832:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233003648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759649.676223:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233003904:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759649.676252:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759649.676331:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233003904 00000100:00100000:2.0:1782759649.676336:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233003904 00000100:00100000:2.0:1782759649.676366:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00100000:2.0:1782759649.676375:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233003904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759649.676386:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759649.676431:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233003904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759649.676438:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00100000:2.0:1782759649.676464:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233003904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759650.054307:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759650.054422:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759650.054468:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759650.054543:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759650.054631:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759650.054707:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568448 00000100:00100000:1.0:1782759650.054716:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568448 00000100:00100000:1.0:1782759650.054824:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568320 00000100:00100000:1.0:1782759650.054828:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568320 00000100:00100000:1.0:1782759650.054876:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3056 00000100:00100000:1.0:1782759650.054912:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218568448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759650.055441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218567936 00000100:00100000:3.0:1782759650.055447:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218567936 00000100:00100000:3.0:1782759650.055476:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3292 00000100:00100000:3.0:1782759650.055485:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218567936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759650.055547:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218567936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 63us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759650.055568:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3292 00000100:00100000:3.0:1782759650.055614:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568192 00000100:00100000:3.0:1782759650.055618:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568192 00000100:00100000:3.0:1782759650.055647:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568064 00000100:00100000:3.0:1782759650.055657:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568064 00000100:00100000:3.0:1782759650.055681:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5264 00000100:00100000:3.0:1782759650.055688:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218568192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759650.055720:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218568192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759650.055727:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5264 00000100:00100000:3.0:1782759650.055738:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5265 00000100:00100000:3.0:1782759650.055744:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218568064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759650.055767:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218568064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759650.055773:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5265 00000100:00100000:3.0:1782759650.055791:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3057 00000100:00100000:3.0:1782759650.055797:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218568320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759650.055818:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218568320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759650.055824:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3057 00000100:00080000:3.0:1782759650.055841:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759650.055845:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759650.055847:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759650.056520:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218568448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1610us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759650.056529:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3056 00010000:00010000:3.0:1782759650.186941:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759651.010931:0:154510:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd20a69b50 20000000:00000080:2.0:1782759651.010948:0:154510:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6d000 uarg=0000000000000000 00010000:00010000:2.0:1782759651.011150:0:154510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759651.011165:0:154510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759651.011186:0:154510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759651.011196:0:154510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759651.011211:0:154510:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759651.011229:0:154510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.011245:0:154510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.011254:0:154510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.011298:0:154510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.011310:0:154510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 23 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759651.011323:0:154510:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154510:1869355233004032:0@lo:104: 00000100:00100000:2.0:1782759651.011383:0:154510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759651.011489:0:154510:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded3397240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759651.013972:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004032 00000100:00100000:1.0:1782759651.013986:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004032 00000100:00100000:1.0:1782759651.014083:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1782759651.014094:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:154510:x1869355233004032:12345-0@lo:104: 00010000:00010000:1.0:1782759651.014112:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759651.014217:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759651.014224:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:154510:x1869355233004032:12345-0@lo:104: Request processed in 132us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759651.014232:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00010000:00010000:0.0:1782759651.014285:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759651.014293:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014300:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759651.014305:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014315:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759651.014322:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759651.014329:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759651.014364:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014370:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759651.014401:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014409:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d31e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d325 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014424:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759651.014435:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759651.014437:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759651.014460:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233004160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759651.014500:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759651.014545:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004160 00000100:00100000:0.0:1782759651.014549:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004160 00010000:00010000:0.0:1782759651.014568:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 24 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759651.014620:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1782759651.014627:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233004160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759651.014637:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759651.014642:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 24 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014651:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 24 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014666:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014674:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014686:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014693:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014699:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014711:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014716:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759651.014719:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014726:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014734:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759651.014742:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759651.014769:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233004160:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759651.014775:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1782759651.014807:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233004160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759651.016601:0:154510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428000/0xd5b45c7f5c60d325 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d31e expref: 23 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759651.016620:0:154510:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154510:1869355233004032:0@lo:104: 00010000:00010000:2.0:1782759651.016648:0:154510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.016658:0:154510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.016663:0:154510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759651.016669:0:154510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d364 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759651.212025:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759652.238638:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759652.243987:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759652.244015:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233004288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759652.244095:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759652.245731:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004288 00000100:00100000:2.0:1782759652.245743:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004288 00000100:00100000:2.0:1782759652.245831:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:2.0:1782759652.245843:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233004288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759652.245893:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:2.0:1782759652.245974:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233004288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759652.245981:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:1.0:1782759652.246132:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233004288:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1782759652.555399:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759652.555408:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759652.555413:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759652.555533:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759652.555547:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759652.555558:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759652.555732:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233004416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759652.555802:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759652.557420:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc6827600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759652.563353:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004416 00000100:00100000:1.0:1782759652.563369:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004416 00000100:00100000:1.0:1782759652.563449:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293 00000100:00100000:1.0:1782759652.563736:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233004416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759652.563756:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759652.563789:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d36b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.563816:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.563828:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759652.563839:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429a00, rc 0) 00000100:00100000:1.0:1782759652.563915:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233004416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 456us (8112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759652.563921:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293 00000100:00100000:0.0:1782759652.564368:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233004416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759652.564399:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759652.564410:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759652.564429:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759652.564434:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759652.564442:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759653.262267:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759653.280311:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233004544:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.280401:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.280506:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759653.280513:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233004672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.280545:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.280601:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004672 00000100:00100000:0.0:1782759653.280610:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004672 00000100:00100000:0.0:1782759653.280656:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1782759653.280665:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233004672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.280732:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233004672:12345-0@lo:400:kworker.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759653.280741:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1782759653.280790:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233004672:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.280830:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233004800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.280857:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283492:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233005312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283554:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283597:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233005824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283620:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283639:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759653.283645:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233004928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283666:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283686:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233005440:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283710:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283727:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233005952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283748:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283779:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233005056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283803:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.283823:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233005568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.283845:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.285235:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233006080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.285290:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.285349:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759653.285356:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233005184:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.285390:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.285410:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233005696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.285430:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759653.285470:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005312 00000100:00100000:0.0:1782759653.286938:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005312 00000100:00100000:1.0:1782759653.287053:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004800 00000100:00100000:1.0:1782759653.287061:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004800 00000100:00100000:1.0:1782759653.287141:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005056 00000100:00100000:1.0:1782759653.287145:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005056 00000100:00100000:1.0:1782759653.287169:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:1.0:1782759653.287180:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233004800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759653.287282:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233004800:12345-0@lo:400:kworker.0 Request processed in 103us (6423us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759653.287289:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000100:00100000:1.0:1782759653.287308:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:1.0:1782759653.287315:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759653.287350:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233005056:12345-0@lo:400:kworker.0 Request processed in 36us (3546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759653.287356:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00000100:00100000:0.0:1782759653.287435:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005824 00000100:00100000:0.0:1782759653.287439:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005824 00000100:00100000:1.0:1782759653.287477:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004928 00000100:00100000:1.0:1782759653.287500:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004928 00000100:00100000:1.0:1782759653.287520:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005184 00000100:00100000:1.0:1782759653.287523:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005184 00000100:00100000:3.0:1782759653.289727:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233004544 00000100:00100000:3.0:1782759653.289740:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233004544 00000100:00100000:3.0:1782759653.289886:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294 00000100:00100000:3.0:1782759653.289897:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233004544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759653.289978:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233004544:12345-0@lo:400:kworker.0 Request processed in 83us (9579us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759653.289998:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00100000:3.0:1782759653.294687:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005440 00000100:00100000:3.0:1782759653.294704:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005440 00000100:00080000:2.0:1782759653.295911:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759653.295924:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759653.295928:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759653.296743:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005952 00000100:00100000:2.0:1782759653.296757:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005952 00000100:00100000:2.0:1782759653.296829:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005568 00000100:00100000:2.0:1782759653.296832:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005568 00000100:00100000:2.0:1782759653.296876:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006080 00000100:00100000:2.0:1782759653.296879:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006080 00000100:00100000:2.0:1782759653.296905:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3058 00000100:00100000:2.0:1782759653.296916:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233005952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759653.297016:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233005952:12345-0@lo:400:kworker.0 Request processed in 103us (13266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.297024:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3058 00000100:00100000:2.0:1782759653.297041:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3059 00000100:00100000:2.0:1782759653.297048:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233005568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759653.297078:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233005568:12345-0@lo:400:kworker.0 Request processed in 32us (13232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.297083:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3059 00000100:00100000:2.0:1782759653.297096:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3060 00000100:00100000:2.0:1782759653.297103:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233006080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759653.297129:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233006080:12345-0@lo:400:kworker.0 Request processed in 28us (11839us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.297149:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3060 00000100:00080000:2.0:1782759653.297197:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759653.297200:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759653.302769:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233005696 00000100:00100000:0.0:1782759653.302784:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233005696 00000100:00100000:0.0:1782759653.302814:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1782759653.302824:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233005312:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782759653.304813:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759653.307781:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5268 00000100:00100000:2.0:1782759653.307816:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233004928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759653.307913:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233004928:12345-0@lo:400:kworker.0 Request processed in 120us (24245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.307920:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5268 00000100:00100000:2.0:1782759653.307945:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:2.0:1782759653.307953:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233005824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759653.307980:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233005824:12345-0@lo:400:kworker.0 Request processed in 30us (24360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.307984:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00000100:00100000:2.0:1782759653.307995:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00000100:00100000:2.0:1782759653.308001:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233005696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759653.308024:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233005696:12345-0@lo:400:kworker.0 Request processed in 24us (22593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759653.308028:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00000100:00100000:0.0:1782759653.310759:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233005312:12345-0@lo:400:kworker.0 Request processed in 7926us (27194us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759653.310775:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1782759653.310882:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233004928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.310900:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233005952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.310910:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233005312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.310923:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233005824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.310937:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233004800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.310983:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233005696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.310994:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233005056:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.311004:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233005568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.311032:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233006080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759653.311042:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233004544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759653.317406:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00000100:00100000:1.0:1782759653.317423:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233005184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759653.317536:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233005184:12345-0@lo:400:kworker.0 Request processed in 118us (32143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759653.317544:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00000100:00100000:1.0:1782759653.317618:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233005184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759653.319459:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3061 00000100:00100000:3.0:1782759653.319475:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233005440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759653.319592:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233005440:12345-0@lo:400:kworker.0 Request processed in 108us (35866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759653.319600:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3061 00000100:00100000:3.0:1782759653.319657:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233005440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759653.771637:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759653.771658:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233006208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759653.771723:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759653.771798:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233006336:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759653.779630:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006208 00000100:00100000:0.0:1782759653.779654:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006208 00000100:00100000:0.0:1782759653.779712:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00100000:0.0:1782759653.779723:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233006208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759653.779757:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759653.779824:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233006208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (8100us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759653.779831:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00100000:3.0:1782759653.780008:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759653.780204:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006336 00000100:00100000:1.0:1782759653.780210:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006336 00000100:00100000:1.0:1782759653.780240:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1782759653.780247:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233006336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759653.780260:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759653.780377:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233006336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759653.780384:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00100000:1.0:1782759653.780432:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233006336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759653.780889:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233006208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759654.278708:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759654.278872:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568576 00000100:00100000:1.0:1782759654.278884:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568576 00000100:00100000:1.0:1782759654.278958:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3000 00000100:00100000:1.0:1782759654.278970:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111588:x1869355218568576:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:1.0:1782759654.279002:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759654.279047:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d379 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27567 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279118:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279133:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279146:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279171:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279178:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279186:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279353:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279372:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279380:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759654.279419:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1782759654.279430:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759654.279453:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279500:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279511:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279517:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279524:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279531:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279537:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759654.279541:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279550:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279563:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:1.0:1782759654.279566:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759654.279571:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279606:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d380 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279628:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279634:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279641:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279647:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759654.279650:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279657:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279666:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cddc34fe700) 00010000:00010000:1.0:1782759654.279668:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759654.279671:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279678:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d387 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279707:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d379 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27567 expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279723:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27567 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.279742:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:1.0:1782759654.279744:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759654.279746:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759654.279816:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111588:x1869355218568576:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 847us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759654.279825:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3000 00000100:00080000:3.0:1782759654.280066:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759654.285011:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759654.302373:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759654.303150:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568832 00000100:00100000:2.0:1782759654.303160:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568832 00000100:00100000:2.0:1782759654.303244:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3001 00000100:00100000:2.0:1782759654.303256:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111588:x1869355218568832:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:2.0:1782759654.303316:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759654.303349:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d38e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27567 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.303374:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fe300) 00010000:00010000:2.0:1782759654.303385:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759654.303414:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.303427:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.303435:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759654.303605:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009df00bf7 reply state 00000000b1d05c17 transno 4294968027 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.303618:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.303624:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:2.0:1782759654.303627:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782759654.303629:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759654.303720:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111588:x1869355218568832:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 467us (1365us total) trans 4294968027 rc 0/0 00000100:00100000:2.0:1782759654.303728:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3001 00000100:00100000:1.0:1782759654.319162:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759654.324831:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218568960 00000100:00100000:2.0:1782759654.324847:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218568960 00000100:00100000:2.0:1782759654.324915:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1103 00000100:00100000:2.0:1782759654.325670:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218568960:12345-192.168.202.31@tcp:2:chmod.0 00002000:00010000:2.0:1782759654.325845:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759654.325849:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1782759642 -> 1782759642 00002000:00010000:2.0:1782759654.325851:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1782759642 -> 1782759642 00002000:00010000:2.0:1782759654.325854:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782759642 -> 1782759655 00002000:00010000:2.0:1782759654.325856:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782759654.325926:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218568960:12345-192.168.202.31@tcp:2:chmod.0 Request processed in 266us (6772us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1782759654.325934:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1103 00000100:00080000:2.0:1782759654.325959:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759654.372843:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759654.372935:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218569088 00000100:00100000:3.0:1782759654.372944:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218569088 00000100:00100000:3.0:1782759654.372994:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3002 00000100:00100000:3.0:1782759654.373004:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111589:x1869355218569088:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759654.373026:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759654.373046:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2756e expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.373111:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d3a3 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.373126:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.373137:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759654.373188:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:3.0:1782759654.373192:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759654.373210:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d3a3 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.373232:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2756e expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.373246:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d3a3 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2756e expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.373255:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:3.0:1782759654.373258:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759654.373260:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:3.0:1782759654.373315:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111589:x1869355218569088:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 312us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759654.373322:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3002 00000100:00100000:3.0:1782759654.381748:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759654.381784:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218569216 00000100:00100000:3.0:1782759654.381794:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218569216 00000100:00100000:3.0:1782759654.381861:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3003 00000100:00100000:3.0:1782759654.381871:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111589:x1869355218569216:12345-192.168.202.31@tcp:48:lfs.0 00000001:00080000:3.0:1782759654.390320:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968027 is committed 00000100:00100000:3.0:1782759654.390459:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111589:x1869355218569216:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 8584us (8715us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759654.390483:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3003 00010000:00010000:1.0:1782759654.390738:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.390750:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.390759:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.390765:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759654.390769:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.390777:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.390792:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fde00) 00010000:00010000:1.0:1782759654.390795:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759654.390799:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.390827:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d395 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759654.434136:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759654.434388:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218569472 00000100:00100000:2.0:1782759654.434401:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218569472 00000100:00100000:2.0:1782759654.434480:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3004 00000100:00100000:2.0:1782759654.434493:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:111590:x1869355218569472:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759654.434547:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759654.434574:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60d3a3 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2756e expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.434630:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34f4b00) 00010000:00010000:2.0:1782759654.434643:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759654.434671:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.434684:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.434695:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759654.434950:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007080b312 reply state 00000000466aeccd transno 4294968028 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.434963:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759654.434969:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759654.434972:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1782759654.434974:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759654.434983:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000100:00100000:2.0:1782759654.435072:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111590:x1869355218569472:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 580us (943us total) trans 4294968028 rc 0/0 00000100:00100000:2.0:1782759654.435078:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3004 00000100:00100000:3.0:1782759654.437963:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759654.438069:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218569600 00000100:00100000:1.0:1782759654.438079:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218569600 00000100:00100000:1.0:1782759654.438139:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3005 00000100:00100000:1.0:1782759654.438148:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111590:x1869355218569600:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759654.438189:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759654.438210:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27575 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.438279:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d3b8 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.438308:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.438321:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759654.438381:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:1.0:1782759654.438385:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759654.438405:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.438427:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27575 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.438444:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27575 expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.438468:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:1.0:1782759654.438481:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759654.438485:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428000, rc 0) 00000100:00100000:1.0:1782759654.438543:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111590:x1869355218569600:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 395us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759654.438550:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3005 00000100:00100000:3.0:1782759654.445074:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759654.445186:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218569728 00000100:00100000:1.0:1782759654.445196:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218569728 00000100:00100000:1.0:1782759654.445258:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 352 00000100:00100000:1.0:1782759654.445267:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111590:x1869355218569728:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759654.452081:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111590:x1869355218569728:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 6803us (7005us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759654.452097:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 352 00000100:00100000:1.0:1782759654.462861:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759654.462956:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218569856 00000100:00100000:3.0:1782759654.462968:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218569856 00000100:00100000:3.0:1782759654.463037:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3006 00000100:00100000:3.0:1782759654.463047:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111590:x1869355218569856:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759654.463067:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759654.463087:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d3bf lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2757c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463150:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463165:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463175:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463188:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463195:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463201:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463317:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463345:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463353:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759654.463404:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00000004:00200000:3.0:1782759654.463409:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759654.463430:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463441:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463450:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463457:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463463:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463481:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463487:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759654.463491:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463499:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463523:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:3.0:1782759654.463527:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759654.463532:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463539:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d3c6 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463553:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463559:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463565:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463569:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759654.463572:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463629:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463637:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cddc34f4600) 00010000:00010000:3.0:1782759654.463639:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759654.463642:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463648:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d3cd lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463688:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d3bf lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2757c expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463701:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2757c expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759654.463709:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34f4400) 00010000:00010000:3.0:1782759654.463711:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759654.463714:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759654.463784:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111590:x1869355218569856:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 738us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759654.463793:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3006 00000100:00100000:3.0:1782759654.480984:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759654.481094:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218570112 00000100:00100000:0.0:1782759654.481104:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218570112 00000100:00100000:0.0:1782759654.481176:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3007 00000100:00100000:0.0:1782759654.481188:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111590:x1869355218570112:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759654.481208:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759654.481226:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d3db lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27583 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759654.481352:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d3e2 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759654.481378:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759654.481390:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759654.481426:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00010000:00010000:0.0:1782759654.481558:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d3db lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27583 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759654.481640:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27583 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759654.481650:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34f4400) 00010000:00010000:0.0:1782759654.481653:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759654.481656:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d000, rc 0) 00000100:00100000:0.0:1782759654.481716:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111590:x1869355218570112:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 530us (743us total) trans 4294968029 rc 0/0 00000100:00100000:0.0:1782759654.481724:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3007 00000100:00100000:2.0:1782759654.487302:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759654.487387:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218570368 00000100:00100000:1.0:1782759654.487399:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218570368 00000100:00100000:1.0:1782759654.487460:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3008 00000100:00100000:1.0:1782759654.487479:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111590:x1869355218570368:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759654.487537:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759654.487567:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d3e2 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27583 expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.487632:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60d3d4 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2757c expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.487665:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34f4400) 00010000:00010000:1.0:1782759654.487675:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759654.487700:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.487713:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.487723:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782759654.487954:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 88 off10232 00000004:00080000:1.0:1782759654.487964:0:12673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3694764386007ns, next at 3695764384025ns, rc = 0 00000004:00010000:1.0:1782759654.488028:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000782caea6 reply state 00000000bac7d9a5 transno 4294968030 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.488041:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759654.488047:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:1.0:1782759654.488050:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1782759654.488052:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759654.488153:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111590:x1869355218570368:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 683us (871us total) trans 4294968030 rc 0/0 00000100:00100000:1.0:1782759654.488160:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3008 00000100:00100000:0.0:1782759654.492131:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759654.492254:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218570624 00000100:00100000:2.0:1782759654.492264:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218570624 00000100:00100000:2.0:1782759654.492334:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 353 00000100:00100000:2.0:1782759654.492344:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111590:x1869355218570624:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:2.0:1782759654.492634:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111590:x1869355218570624:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 291us (517us total) trans 4294968031 rc 0/0 00000100:00100000:2.0:1782759654.492643:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 353 00000100:00100000:2.0:1782759654.795017:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233006464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759654.795097:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759654.795229:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006464 00000100:00100000:0.0:1782759654.795237:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006464 00000100:00100000:0.0:1782759654.795297:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1782759654.795307:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233006464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759654.795337:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759654.795398:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233006464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759654.795405:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00100000:0.0:1782759654.795451:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233006464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759654.795610:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759654.795621:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233006592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759654.795651:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759654.795682:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006592 00000100:00100000:3.0:1782759654.795686:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006592 00000100:00100000:3.0:1782759654.795713:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2727 00000100:00100000:3.0:1782759654.795730:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233006592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759654.795742:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759654.795774:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233006592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759654.795780:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2727 00000100:00100000:3.0:1782759654.795806:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233006592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759654.796418:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759654.796428:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233006720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759654.796461:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759654.796574:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006720 00000100:00100000:0.0:1782759654.796592:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006720 00000100:00100000:0.0:1782759654.796650:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:0.0:1782759654.796658:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233006720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759654.796681:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759654.796735:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233006720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759654.796742:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:3.0:1782759654.796906:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233006720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759655.134677:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759655.134721:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759655.134756:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218570752 00000100:00100000:3.0:1782759655.134764:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759655.134770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218570752 00000100:00100000:3.0:1782759655.134805:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759655.134830:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3295 00000100:00100000:1.0:1782759655.134841:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218570752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759655.134943:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218570752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759655.134952:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3295 00000100:00100000:3.0:1782759655.134960:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759655.135127:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571264 00000100:00100000:2.0:1782759655.135132:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571264 00000100:00100000:2.0:1782759655.135182:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571136 00000100:00100000:2.0:1782759655.135185:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571136 00000100:00100000:2.0:1782759655.135217:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3062 00000100:00100000:2.0:1782759655.135227:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218571264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759655.135256:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3063 00000100:00100000:2.0:1782759655.135272:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218571264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 44us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759655.135273:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218571136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759655.135284:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3062 00000100:00080000:2.0:1782759655.135301:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759655.135412:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571008 00000100:00100000:0.0:1782759655.135417:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571008 00000100:00100000:0.0:1782759655.135448:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218570880 00000100:00100000:0.0:1782759655.135451:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218570880 00000100:00100000:0.0:1782759655.135467:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5272 00000100:00100000:0.0:1782759655.135473:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218571008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759655.135540:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5273 00000100:00100000:1.0:1782759655.135547:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2403:x1869355218570880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:2.0:1782759655.135730:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759655.137389:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218571008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1901us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759655.137405:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5272 00000100:00100000:3.0:1782759655.137432:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218571136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2164us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759655.137442:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3063 00000100:00100000:1.0:1782759655.139305:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2403:x1869355218570880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 3750us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759655.139318:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5273 00000020:00000080:2.0:1782759655.276960:0:154705:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe607f0140 20000000:00000080:2.0:1782759655.276978:0:154705:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc49df000 uarg=0000000000000000 00010000:00010000:2.0:1782759655.277168:0:154705:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782759655.277206:0:154705:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759655.277210:0:154705:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759655.277221:0:154705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d3b8 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27575 expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.277237:0:154705:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1782759655.277262:0:154705:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759655.277274:0:154705:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759655.277291:0:154705:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759655.277305:0:154705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.277401:0:154705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.277422:0:154705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.277462:0:154705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.277477:0:154705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 23 pid: 6526 timeout: 3845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759655.277493:0:154705:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154705:1869355233006848:0@lo:104: 00000100:00100000:2.0:1782759655.277568:0:154705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759655.277725:0:154705:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79b780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759655.277852:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006848 00000100:00100000:0.0:1782759655.277860:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006848 00000100:00100000:1.0:1782759655.277963:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1782759655.277972:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:154705:x1869355233006848:12345-0@lo:104: 00010000:00010000:1.0:1782759655.277985:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.278052:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759655.278058:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:154705:x1869355233006848:12345-0@lo:104: Request processed in 87us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759655.278065:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00010000:00010000:0.0:1782759655.278148:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759655.278155:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759655.278163:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759655.278167:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759655.278176:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759655.278184:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759655.278198:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759655.278236:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759655.278242:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759655.278268:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759655.278276:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166c600/0xd5b45c7f5c60d36b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d372 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759655.278295:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759655.278297:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759655.278299:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759655.278306:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759655.278454:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233006976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759655.278491:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759655.278553:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233006976 00000100:00100000:3.0:1782759655.278558:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233006976 00010000:00010000:3.0:1782759655.278720:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 24 pid: 6526 timeout: 3845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759655.278748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1782759655.278756:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5714c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233006976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759655.278766:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759655.278771:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 24 pid: 6526 timeout: 3845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278781:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 24 pid: 6526 timeout: 3845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278796:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278829:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278836:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278841:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278847:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278853:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759655.278857:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278863:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278871:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759655.278878:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759655.278911:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5714c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233006976:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759655.278918:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:0.0:1782759655.279180:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233006976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759655.279415:0:154705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d372 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d36b expref: 23 pid: 6526 timeout: 3845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759655.279425:0:154705:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:154705:1869355233006848:0@lo:104: 00010000:00010000:2.0:1782759655.279446:0:154705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.279455:0:154705:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.279461:0:154705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759655.279467:0:154705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767e00/0xd5b45c7f5c60d3f7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759655.307011:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759656.278228:0:154754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4bd49370 20000000:00000080:1.0:1782759656.278262:0:154754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdecd8a8400 uarg=0000000000000000 00010000:00010000:1.0:1782759656.278600:0:154754:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759656.278622:0:154754:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759656.278649:0:154754:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759656.278666:0:154754:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759656.278683:0:154754:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759656.278719:0:154754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278741:0:154754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278755:0:154754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278765:0:154754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278775:0:154754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278786:0:154754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278792:0:154754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759656.278800:0:154754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278811:0:154754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278827:0:154754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278837:0:154754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.278846:0:154754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d3fe lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 154754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759656.330715:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759657.099494:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759657.099503:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759657.099508:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759657.099556:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759657.099568:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759657.099597:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759657.099769:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233007104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759657.099848:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759657.099909:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4bf4300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759657.099963:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007104 00000100:00100000:1.0:1782759657.099971:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007104 00000100:00100000:1.0:1782759657.100031:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:1.0:1782759657.100041:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233007104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759657.100056:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759657.100069:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d405 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759657.100093:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759657.100103:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759657.100111:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759657.100150:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233007104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759657.100156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1782759657.100415:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233007104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759657.100430:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759657.100440:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759657.101401:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759657.101414:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759657.101424:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759657.356852:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759657.356880:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233007232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759657.356960:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759657.359212:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007232 00000100:00100000:0.0:1782759657.359236:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007232 00000100:00100000:0.0:1782759657.360842:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:0.0:1782759657.360861:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233007232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759657.360903:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:0.0:1782759657.360991:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233007232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (4030us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759657.360998:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00010000:00010000:0.0:1782759657.361030:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759657.361099:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233007232:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759658.386361:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759658.386736:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233007488:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.386819:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.386866:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233008000:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.386889:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.386906:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233008512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.386928:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.386954:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1782759658.386960:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233007360:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.386990:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387010:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233007872:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387035:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387052:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233008384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387073:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387088:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233008896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387108:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387132:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233007616:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387152:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387182:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233008128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387203:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387219:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233008640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387240:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387258:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759658.387264:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233007744:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387287:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387300:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233008256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387338:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387355:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233008768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387374:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759658.387418:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007488 00000100:00100000:2.0:1782759658.387424:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007488 00000100:00100000:2.0:1782759658.387468:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008000 00000100:00100000:2.0:1782759658.387472:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008000 00000100:00100000:2.0:1782759658.387494:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008512 00000100:00100000:2.0:1782759658.387497:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008512 00000100:00100000:2.0:1782759658.387512:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008128 00000100:00100000:2.0:1782759658.387514:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008128 00000100:00100000:2.0:1782759658.387525:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008640 00000100:00100000:2.0:1782759658.387527:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008640 00000100:00100000:2.0:1782759658.387538:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007744 00000100:00100000:2.0:1782759658.387540:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007744 00000100:00100000:2.0:1782759658.387555:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00000100:00100000:2.0:1782759658.387563:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355233007488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387643:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355233007488:12345-0@lo:400:kworker.0 Request processed in 80us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.387651:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00000100:00100000:2.0:1782759658.387670:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00000100:00100000:2.0:1782759658.387678:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355233008000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387707:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355233008000:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.387713:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00000100:00100000:2.0:1782759658.387725:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276 00000100:00100000:2.0:1782759658.387732:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355233008512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387757:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355233008512:12345-0@lo:400:kworker.0 Request processed in 27us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.387770:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276 00000100:00100000:2.0:1782759658.387782:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277 00000100:00100000:2.0:1782759658.387789:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233008128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387821:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233008128:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.387827:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277 00000100:00100000:2.0:1782759658.387838:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5278 00000100:00100000:2.0:1782759658.387845:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233008640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387871:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233008640:12345-0@lo:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.387876:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5278 00000100:00100000:2.0:1782759658.387887:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5279 00000100:00100000:2.0:1782759658.387895:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233007744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.387920:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233007744:12345-0@lo:400:kworker.0 Request processed in 27us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.387925:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5279 00000100:00100000:2.0:1782759658.387947:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007872 00000100:00100000:2.0:1782759658.387950:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007872 00000100:00100000:2.0:1782759658.387988:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007616 00000100:00100000:2.0:1782759658.387991:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007616 00000100:00100000:2.0:1782759658.388003:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3382 00000100:00100000:2.0:1782759658.388008:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233007872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388037:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233007872:12345-0@lo:400:kworker.0 Request processed in 29us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.388043:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3382 00000100:00100000:2.0:1782759658.388062:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383 00000100:00100000:2.0:1782759658.388069:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233007616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388098:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233007616:12345-0@lo:400:kworker.0 Request processed in 31us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.388104:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383 00000100:00100000:2.0:1782759658.388121:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008384 00000100:00100000:2.0:1782759658.388125:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008384 00000100:00100000:2.0:1782759658.388148:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008896 00000100:00100000:2.0:1782759658.388151:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008896 00000100:00100000:2.0:1782759658.388161:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008256 00000100:00100000:2.0:1782759658.388163:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008256 00000100:00100000:2.0:1782759658.388175:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233008768 00000100:00100000:2.0:1782759658.388177:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233008768 00000100:00100000:2.0:1782759658.388189:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3064 00000100:00100000:2.0:1782759658.388195:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233008384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388226:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233008384:12345-0@lo:400:kworker.0 Request processed in 32us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.388232:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3064 00000100:00100000:2.0:1782759658.388243:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3065 00000100:00100000:2.0:1782759658.388249:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233008896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388275:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233008896:12345-0@lo:400:kworker.0 Request processed in 27us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.388280:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3065 00000100:00100000:2.0:1782759658.388291:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1782759658.388297:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233008256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388322:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233008256:12345-0@lo:400:kworker.0 Request processed in 26us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.388351:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3066 00000100:00100000:2.0:1782759658.388363:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3067 00000100:00100000:2.0:1782759658.388370:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233008768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388398:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233008768:12345-0@lo:400:kworker.0 Request processed in 30us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759658.388403:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3067 00000100:00080000:2.0:1782759658.388438:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759658.388442:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759658.388445:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759658.388447:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759658.388482:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233007744:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388493:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233008256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388502:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233008768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388511:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233007616:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388520:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233008128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388530:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233008640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388573:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233007872:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388610:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233008384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388619:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233008896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388628:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233007488:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388638:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233008000:0@lo:400:kworker.0 00000100:00100000:2.0:1782759658.388657:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233008512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759658.389019:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233007360 00000100:00100000:1.0:1782759658.389027:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233007360 00000100:00100000:1.0:1782759658.389069:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3297 00000100:00100000:1.0:1782759658.389078:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233007360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759658.389132:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233007360:12345-0@lo:400:kworker.0 Request processed in 56us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759658.389139:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3297 00000100:00100000:2.0:1782759658.413850:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233007360:0@lo:400:kworker.0 00000004:00080000:1.0:1782759658.891720:0:10000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3699168140444ns, next at 3700168137999ns, rc = 0 00000100:00100000:1.0:1782759658.891783:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759658.891801:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233009024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759658.891870:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759658.891945:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233009152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759658.891970:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759658.892005:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009024 00000100:00100000:1.0:1782759658.892014:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009024 00000100:00100000:1.0:1782759658.892056:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009152 00000100:00100000:1.0:1782759658.892059:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009152 00000100:00100000:1.0:1782759658.892081:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1782759658.892089:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233009024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759658.892122:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759658.892184:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233009024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759658.892191:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00100000:1.0:1782759658.892206:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00100000:1.0:1782759658.892212:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233009152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759658.892221:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759658.892244:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233009152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759658.892250:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00100000:1.0:1782759658.892296:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233009152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759658.892354:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233009024:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759659.402903:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759659.567129:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759659.567646:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571392 00000100:00100000:0.0:1782759659.567657:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571392 00000100:00100000:0.0:1782759659.567742:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3009 00000100:00100000:0.0:1782759659.567753:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111674:x1869355218571392:12345-192.168.202.31@tcp:101:chmod.0 00010000:00010000:0.0:1782759659.567775:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759659.567797:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d413 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2758a expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.567878:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.567892:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.567904:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.567919:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.567927:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.567934:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568016:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568025:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568043:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759659.568096:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00000004:00200000:0.0:1782759659.568101:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759659.568123:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568135:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568145:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568152:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568158:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568165:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568171:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759659.568175:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568182:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568196:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:0.0:1782759659.568205:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759659.568210:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 3/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568217:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d41a lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568233:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568239:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568245:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.568250:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759659.568253:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759659.568382:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759659.571066:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.571090:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759659.571094:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759659.571099:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.571106:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d421 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.571167:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d413 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2758a expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.571199:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2758a expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.571207:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:0.0:1782759659.571209:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759659.571211:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d800, rc 0) 00000100:00100000:0.0:1782759659.572007:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111674:x1869355218571392:12345-192.168.202.31@tcp:101:chmod.0 Request processed in 4251us (4884us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759659.572018:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3009 00000100:00100000:2.0:1782759659.585124:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759659.590532:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571648 00000100:00100000:2.0:1782759659.590549:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571648 00000100:00100000:2.0:1782759659.590644:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3010 00000100:00100000:2.0:1782759659.590657:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111674:x1869355218571648:12345-192.168.202.31@tcp:36:chmod.0 00010000:00010000:2.0:1782759659.590713:0:42628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759659.590741:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d428 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2758a expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.590760:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:2.0:1782759659.590765:0:42628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759659.590791:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.590803:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.590812:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759659.590976:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021e078ab reply state 000000000bd803f7 transno 4294968032 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.590990:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.591008:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:2.0:1782759659.591011:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1782759659.591013:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759659.591111:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:111674:x1869355218571648:12345-192.168.202.31@tcp:36:chmod.0 Request processed in 457us (5995us total) trans 4294968032 rc 0/0 00000100:00100000:2.0:1782759659.591118:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3010 00000100:00100000:1.0:1782759659.609083:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759659.610637:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571776 00000100:00100000:2.0:1782759659.610662:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571776 00000100:00100000:3.0:1782759659.611718:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1104 00000100:00100000:3.0:1782759659.611730:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218571776:12345-192.168.202.31@tcp:2:chmod.0 00002000:00010000:3.0:1782759659.611908:0:82628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759659.611912:0:82628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1782759642 -> 1782759642 00002000:00010000:3.0:1782759659.611914:0:82628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1782759642 -> 1782759642 00002000:00010000:3.0:1782759659.611916:0:82628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782759655 -> 1782759660 00002000:00010000:3.0:1782759659.611918:0:82628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782759659.611989:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218571776:12345-192.168.202.31@tcp:2:chmod.0 Request processed in 261us (2914us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1782759659.611997:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1104 00000100:00080000:3.0:1782759659.612019:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1782759659.623514:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968032 is committed 00000004:00080000:2.0:1782759659.623534:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000004:00080000:2.0:1782759659.623552:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00010000:00010000:2.0:1782759659.623600:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623612:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623620:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623626:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759659.623631:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623638:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623654:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd400) 00010000:00010000:2.0:1782759659.623657:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759659.623662:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623679:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d3aa lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623705:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623711:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623717:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623721:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759659.623724:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623729:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623737:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:2.0:1782759659.623739:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759659.623742:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623749:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d3f0 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623759:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623765:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623778:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623783:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759659.623785:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623791:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623800:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fec00) 00010000:00010000:2.0:1782759659.623802:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759659.623805:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.623809:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d42f lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759659.623914:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233009280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782759659.623980:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759659.624044:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009280 00000100:00100000:2.0:1782759659.624051:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009280 00000100:00100000:2.0:1782759659.624105:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1782759659.624116:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233009280:12345-0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1782759659.625405:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967415 is committed 00002000:00010000:2.0:1782759659.626134:0:8445:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759659.626140:0:8445:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1782759642 -> 1782759642 00002000:00010000:2.0:1782759659.626143:0:8445:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1782759642 -> 1782759642 00002000:00010000:2.0:1782759659.626145:0:8445:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782759660 -> 1782759660 00002000:00010000:2.0:1782759659.626157:0:8445:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782759659.626524:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355233009280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2405us (2538us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1782759659.626536:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000004:00080000:3.0:1782759659.639837:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc479e300/2, rc 0, transno 4294967416 00000100:00100000:3.0:1782759659.639853:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233009280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1782759659.640914:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759659.641066:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218571904 00000100:00100000:1.0:1782759659.641076:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218571904 00000100:00100000:1.0:1782759659.641136:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3011 00000100:00100000:1.0:1782759659.641146:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111675:x1869355218571904:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759659.658394:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111675:x1869355218571904:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 17235us (17471us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759659.658420:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3011 00000100:00100000:3.0:1782759659.691146:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759659.693026:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218572160 00000100:00100000:2.0:1782759659.693051:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218572160 00000100:00100000:2.0:1782759659.693156:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3012 00000100:00100000:2.0:1782759659.693167:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:111676:x1869355218572160:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759659.693220:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759659.693225:0:6533:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60d3b8) 00010000:00010000:2.0:1782759659.693227:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759659.693262:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.693281:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.693292:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759659.693522:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf208687 reply state 00000000ebeed72a transno 4294968033 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.693537:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759659.693544:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd600) 00010000:00010000:2.0:1782759659.693548:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1782759659.693552:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759659.693559:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000100:00100000:2.0:1782759659.693707:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111676:x1869355218572160:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 541us (2570us total) trans 4294968033 rc 0/0 00000100:00100000:2.0:1782759659.693715:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3012 00000100:00100000:2.0:1782759659.702497:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759659.703112:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218572288 00000100:00100000:0.0:1782759659.703123:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218572288 00000100:00100000:0.0:1782759659.703233:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3013 00000100:00100000:0.0:1782759659.703259:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:111676:x1869355218572288:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759659.703286:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759659.703306:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d43d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27591 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.703393:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d444 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.703409:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d444 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.703422:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d444 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759659.703472:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1e:0x0]: returning size 4096 00000004:00200000:0.0:1782759659.703490:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759659.703517:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d444 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.703544:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d43d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27591 expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.703564:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d444 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27591 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759659.703613:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd600) 00010000:00010000:0.0:1782759659.703617:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759659.703621:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166c400, rc 0) 00000100:00100000:0.0:1782759659.704293:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111676:x1869355218572288:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1047us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759659.704303:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3013 00000100:00100000:3.0:1782759659.708307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759659.709295:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218572416 00000100:00100000:1.0:1782759659.709307:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218572416 00000100:00100000:1.0:1782759659.709386:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 354 00000100:00100000:1.0:1782759659.709398:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9333850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111676:x1869355218572416:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:3.0:1782759659.717922:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9333850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111676:x1869355218572416:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 8515us (9625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759659.717939:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 354 00000100:00100000:3.0:1782759659.727694:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759659.727934:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218572544 00000100:00100000:1.0:1782759659.727950:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218572544 00000100:00100000:1.0:1782759659.728019:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3014 00000100:00100000:1.0:1782759659.728030:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:111676:x1869355218572544:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759659.728053:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759659.728077:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d44b lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27598 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728222:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 3/1,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728270:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728285:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 3/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728303:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728310:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728326:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.728416:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729408:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729434:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759659.729490:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00000004:00200000:1.0:1782759659.729495:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759659.729515:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729528:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729553:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729559:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 4/1,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729566:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 3/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729573:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729605:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759659.729610:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 4/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729618:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 5/0,0 mode: CR/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729631:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd600) 00010000:00010000:1.0:1782759659.729634:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759659.729638:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 3/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729644:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d452 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729656:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729662:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 2/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729674:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729680:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759659.729683:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729689:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 4/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729698:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x6a16dcec (ffff8cddc34fef00) 00010000:00010000:1.0:1782759659.729700:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759659.729704:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729711:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429a00/0xd5b45c7f5c60d459 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x6a16dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729745:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429800/0xd5b45c7f5c60d44b lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27598 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729758:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27598 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759659.729765:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:1.0:1782759659.729767:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759659.729769:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759659.729834:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111676:x1869355218572544:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1805us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759659.729850:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3014 00000100:00100000:2.0:1782759659.737956:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759659.738048:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218572800 00000100:00100000:3.0:1782759659.738059:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218572800 00000100:00100000:3.0:1782759659.738170:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3015 00000100:00100000:3.0:1782759659.738181:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:111676:x1869355218572800:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759659.738204:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759659.738241:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d467 lrc: 2/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2759f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.738364:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d46e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.738381:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d46e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.738392:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d46e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759659.738404:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1f:0x0]: returning size 0 00010000:00010000:3.0:1782759659.738525:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60d467 lrc: 0/0,0 mode: --/CR res: [0x200000421:0x1e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2759f expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.738871:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d46e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2759f expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.738881:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:3.0:1782759659.738884:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759659.738888:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759659.738952:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111676:x1869355218572800:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 773us (1006us total) trans 4294968034 rc 0/0 00000100:00100000:3.0:1782759659.738960:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3015 00000100:00100000:1.0:1782759659.741801:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759659.741897:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573056 00000100:00100000:3.0:1782759659.741907:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573056 00000100:00100000:3.0:1782759659.742001:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3016 00000100:00100000:3.0:1782759659.742012:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111676:x1869355218573056:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759659.742083:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782759659.742109:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60d46e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2759f expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.742130:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d460 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27598 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.742141:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34fe900) 00010000:00010000:3.0:1782759659.742150:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759659.742173:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,1 mode: --/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.742185:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.742194:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759659.742451:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 88 off10320 00000004:00010000:3.0:1782759659.742501:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dfa4d00 reply state 00000000933b4afe transno 4294968035 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,1 mode: PW/PW res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.742512:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759659.742518:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34f4f00) 00010000:00010000:3.0:1782759659.742520:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1782759659.742522:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759659.742633:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111676:x1869355218573056:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 623us (843us total) trans 4294968035 rc 0/0 00000100:00100000:3.0:1782759659.742655:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3016 00000100:00100000:2.0:1782759659.745226:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759659.745300:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573312 00000100:00100000:3.0:1782759659.745310:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573312 00000100:00100000:3.0:1782759659.745394:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 355 00000100:00100000:3.0:1782759659.745404:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:111676:x1869355218573312:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759659.745875:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:111676:x1869355218573312:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 470us (658us total) trans 4294968036 rc 0/0 00000100:00100000:3.0:1782759659.745884:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 355 00000100:00100000:2.0:1782759659.915298:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759659.915334:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233009408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759659.915411:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759659.915665:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009408 00000100:00100000:3.0:1782759659.915684:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009408 00000100:00100000:3.0:1782759659.915741:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2730 00000100:00100000:3.0:1782759659.915751:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233009408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759659.915783:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759659.915839:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233009408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759659.915847:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2730 00000100:00100000:2.0:1782759659.915997:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233009408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759659.917266:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233009536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759659.917342:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759659.917520:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233009664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759659.917551:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759659.918052:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009664 00000100:00100000:1.0:1782759659.918061:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009664 00000100:00100000:1.0:1782759659.918139:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1782759659.918150:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233009664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759659.918177:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759659.918235:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233009664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759659.918242:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:1.0:1782759659.918289:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233009664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759659.919003:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009536 00000100:00100000:0.0:1782759659.919010:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009536 00000100:00100000:0.0:1782759659.919067:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:0.0:1782759659.919085:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233009536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759659.919114:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759659.919175:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233009536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759659.919181:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:3.0:1782759659.919363:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233009536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759660.252626:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759660.252658:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759660.252694:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759660.252727:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759660.252749:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759660.252832:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573696 00000100:00100000:1.0:1782759660.252842:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573696 00000100:00100000:1.0:1782759660.252908:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573568 00000100:00100000:1.0:1782759660.252912:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573568 00000100:00100000:1.0:1782759660.252934:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5280 00000100:00100000:1.0:1782759660.252946:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218573696:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759660.253022:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218573696:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759660.253030:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5280 00000100:00100000:1.0:1782759660.253047:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5281 00000100:00100000:1.0:1782759660.253053:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2403:x1869355218573568:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759660.253081:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2403:x1869355218573568:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759660.253087:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5281 00000100:00100000:0.0:1782759660.253185:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573440 00000100:00100000:0.0:1782759660.253189:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573440 00000100:00100000:0.0:1782759660.253225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3298 00000100:00100000:0.0:1782759660.253232:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218573440:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759660.253280:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218573440:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 48us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759660.253287:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3298 00000100:00080000:2.0:1782759660.253431:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759660.253886:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573952 00000100:00100000:3.0:1782759660.253893:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573952 00000100:00100000:3.0:1782759660.253933:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218573824 00000100:00100000:3.0:1782759660.253937:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218573824 00000100:00100000:3.0:1782759660.253992:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3068 00000100:00100000:3.0:1782759660.254000:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218573952:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759660.254045:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218573952:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 46us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759660.254062:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3068 00000100:00100000:3.0:1782759660.254076:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3069 00000100:00100000:3.0:1782759660.254082:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218573824:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759660.254108:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218573824:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759660.254114:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3069 00000100:00080000:0.0:1782759660.254605:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759660.427080:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759661.456136:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759662.475175:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759662.475206:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759662.475239:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233009792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759662.475324:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759662.475612:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009792 00000100:00100000:0.0:1782759662.475623:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009792 00000100:00100000:0.0:1782759662.475701:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:0.0:1782759662.475711:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233009792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759662.475758:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:0.0:1782759662.475827:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233009792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759662.475836:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000100:00100000:2.0:1782759662.476362:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233009792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759663.499767:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233010176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.499854:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759663.499900:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233010688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.499924:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759663.499946:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233011200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.499962:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759663.499983:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759663.499988:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233010304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500004:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759663.500027:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233010816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500048:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759663.500063:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233011328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500081:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759663.500107:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010176 00000100:00100000:2.0:1782759663.500114:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010176 00000100:00100000:2.0:1782759663.500181:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:2.0:1782759663.500192:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233010176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500262:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233010176:12345-0@lo:400:kworker.0 Request processed in 72us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.500268:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000100:00100000:2.0:1782759663.500316:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010688 00000100:00100000:2.0:1782759663.500320:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010688 00000100:00100000:2.0:1782759663.500356:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011200 00000100:00100000:2.0:1782759663.500359:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011200 00000100:00100000:2.0:1782759663.500402:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010304 00000100:00100000:2.0:1782759663.500405:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010304 00000100:00100000:2.0:1782759663.500428:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5282 00000100:00100000:2.0:1782759663.500434:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233010688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500477:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233010688:12345-0@lo:400:kworker.0 Request processed in 44us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.500484:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5282 00000100:00100000:2.0:1782759663.500500:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5283 00000100:00100000:2.0:1782759663.500507:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233011200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500531:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233011200:12345-0@lo:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.500536:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5283 00000100:00100000:2.0:1782759663.500554:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5284 00000100:00100000:2.0:1782759663.500562:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233010304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500611:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233010304:12345-0@lo:400:kworker.0 Request processed in 51us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.500617:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5284 00000100:00100000:2.0:1782759663.500636:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010816 00000100:00100000:2.0:1782759663.500639:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010816 00000100:00100000:2.0:1782759663.500665:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011328 00000100:00100000:2.0:1782759663.500669:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011328 00000100:00100000:2.0:1782759663.500688:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3070 00000100:00100000:2.0:1782759663.500696:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233010816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500726:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233010816:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.500733:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3070 00000100:00100000:2.0:1782759663.500744:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3071 00000100:00100000:2.0:1782759663.500752:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233011328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500777:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233011328:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.500792:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3071 00000100:00100000:2.0:1782759663.500841:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233010304:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500853:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233010816:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500862:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233011328:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500871:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233010176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500879:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233010688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.500888:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233011200:0@lo:400:kworker.0 00000100:00080000:2.0:1782759663.500927:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759663.500932:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759663.500934:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759663.501411:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233009920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501458:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501506:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233010432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501532:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501551:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233010944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501571:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501610:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233011456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501630:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501650:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759663.501657:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233010048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501679:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501694:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233010560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501729:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501748:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233011072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501768:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759663.501793:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010432 00000100:00100000:0.0:1782759663.501797:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010432 00000100:00100000:0.0:1782759663.501848:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:0.0:1782759663.501855:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233010432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.501901:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233010432:12345-0@lo:400:kworker.0 Request processed in 45us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.501908:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387 00000100:00100000:0.0:1782759663.501928:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010944 00000100:00100000:0.0:1782759663.501932:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010944 00000100:00100000:0.0:1782759663.501959:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011456 00000100:00100000:0.0:1782759663.501962:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011456 00000100:00100000:0.0:1782759663.501978:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1782759663.501984:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233010944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502012:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233010944:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.502018:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3072 00000100:00100000:0.0:1782759663.502027:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3073 00000100:00100000:0.0:1782759663.502032:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233011456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502054:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233011456:12345-0@lo:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.502059:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3073 00000100:00100000:0.0:1782759663.502076:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010048 00000100:00100000:0.0:1782759663.502079:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010048 00000100:00100000:0.0:1782759663.502094:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233010560 00000100:00100000:0.0:1782759663.502103:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233010560 00000100:00100000:0.0:1782759663.502117:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011072 00000100:00100000:0.0:1782759663.502119:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011072 00000100:00100000:0.0:1782759663.502135:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5285 00000100:00100000:0.0:1782759663.502141:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233010048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502170:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233010048:12345-0@lo:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.502176:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5285 00000100:00100000:0.0:1782759663.502187:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286 00000100:00100000:0.0:1782759663.502192:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502231:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233010560:12345-0@lo:400:kworker.0 Request processed in 39us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.502236:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286 00000100:00100000:0.0:1782759663.502247:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5287 00000100:00100000:0.0:1782759663.502253:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233011072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502280:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233011072:12345-0@lo:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759663.502304:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5287 00000100:00100000:0.0:1782759663.502344:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233010048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502353:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233010560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502361:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233011072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502370:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233010432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502379:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233010944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759663.502389:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233011456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.502768:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233009920 00000100:00100000:2.0:1782759663.502775:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233009920 00000100:00100000:2.0:1782759663.502813:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1782759663.502822:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233009920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759663.502866:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233009920:12345-0@lo:400:kworker.0 Request processed in 47us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759663.502872:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00080000:2.0:1782759663.502908:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759663.502912:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759663.502914:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759663.502931:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233009920:0@lo:400:kworker.0 00010000:00010000:2.0:1782759663.507181:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782759664.011703:0:10000:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3704288123181ns, next at 3705288120531ns, rc = 0 00000100:00100000:1.0:1782759664.011742:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759664.011763:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759664.011833:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759664.011981:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233011712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759664.012009:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759664.012220:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011584 00000100:00100000:3.0:1782759664.012228:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011584 00000100:00100000:3.0:1782759664.012286:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011712 00000100:00100000:3.0:1782759664.012290:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011712 00000100:00100000:3.0:1782759664.012313:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1782759664.012321:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233011584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759664.012351:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759664.012533:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2733 00000100:00100000:0.0:1782759664.012544:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233011712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759664.012557:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759664.013562:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233011584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1237us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759664.013571:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:3.0:1782759664.013652:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759664.020615:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233011712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 8062us (8593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759664.020631:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2733 00000100:00100000:1.0:1782759664.021368:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233011712:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759664.523378:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759665.035506:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759665.035530:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233011840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759665.035531:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233011968:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759665.035721:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233012096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759665.035928:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759665.036066:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011840 00000100:00100000:1.0:1782759665.036075:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011840 00000100:00100000:1.0:1782759665.036141:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1782759665.036152:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233011840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759665.036182:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759665.036236:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233011840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759665.036243:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1782759665.036390:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233011840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759665.036507:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759665.041179:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759665.041296:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233011968 00000100:00100000:0.0:1782759665.041308:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233011968 00000100:00100000:0.0:1782759665.041407:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:0.0:1782759665.041417:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233011968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759665.041445:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759665.041511:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233011968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759665.041518:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00100000:3.0:1782759665.041625:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233011968:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1782759665.041645:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759665.041716:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759665.041801:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012096 00000100:00100000:0.0:1782759665.041805:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012096 00000100:00100000:0.0:1782759665.041861:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1782759665.041869:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233012096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759665.041896:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:0.0:1782759665.041944:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233012096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759665.041950:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:3.0:1782759665.042047:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233012096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759665.374353:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759665.374400:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759665.374436:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759665.374477:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759665.374505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759665.374535:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574592 00000100:00100000:3.0:1782759665.374546:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574592 00000100:00100000:3.0:1782759665.374630:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574464 00000100:00100000:3.0:1782759665.374634:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574464 00000100:00100000:3.0:1782759665.374662:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3074 00000100:00100000:3.0:1782759665.374673:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218574592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759665.374792:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218574592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 121us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759665.374800:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3074 00000100:00100000:3.0:1782759665.374818:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3075 00000100:00100000:3.0:1782759665.374825:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218574464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759665.374854:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218574464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759665.374860:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3075 00000100:00100000:3.0:1782759665.374881:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574336 00000100:00100000:3.0:1782759665.374885:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574336 00000100:00100000:3.0:1782759665.374913:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574208 00000100:00100000:3.0:1782759665.374916:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574208 00000100:00100000:3.0:1782759665.374938:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5288 00000100:00100000:3.0:1782759665.374943:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218574336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759665.374973:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218574336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759665.374980:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5288 00000100:00100000:3.0:1782759665.374992:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5289 00000100:00100000:3.0:1782759665.375004:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2404:x1869355218574208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759665.375029:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:2404:x1869355218574208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759665.375035:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5289 00000100:00100000:1.0:1782759665.375331:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574080 00000100:00100000:1.0:1782759665.375337:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574080 00000100:00100000:1.0:1782759665.375368:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3300 00000100:00100000:1.0:1782759665.375376:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218574080:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759665.375404:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218574080:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759665.375421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3300 00000100:00080000:1.0:1782759665.375448:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759665.375453:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759665.375456:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759665.375459:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759665.549786:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759665.565369:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967416 is committed 00000004:00080000:2.0:1782759665.573919:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000001:00080000:2.0:1782759665.573971:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968036 is committed 00000100:00100000:1.0:1782759665.574153:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759665.574173:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233012224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1782759665.574666:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759665.574788:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012224 00010000:00010000:0.0:1782759665.574791:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759665.574795:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012224 00010000:00010000:0.0:1782759665.574803:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574811:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574817:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759665.574822:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574830:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574846:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd600) 00010000:00010000:0.0:1782759665.574849:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759665.574853:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574859:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d436 lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759665.574864:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1782759665.574874:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233012224:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1782759665.574875:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,1 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574881:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 2/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574886:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574902:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759665.574905:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 3/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574910:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 4/0,0 mode: TXN/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574918:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1f:0x0].0x0 (ffff8cddc34f4f00) 00010000:00010000:0.0:1782759665.574920:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782759665.574923:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 2/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759665.574927:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60d47c lrc: 0/0,0 mode: --/TXN res: [0x200000421:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759665.574987:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1782759665.575102:0:82628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759665.575106:0:82628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1782759642 -> 1782759642 00002000:00010000:2.0:1782759665.575108:0:82628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 1782759642 -> 1782759642 00002000:00010000:2.0:1782759665.575111:0:82628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1782759660 -> 1782759660 00002000:00010000:2.0:1782759665.575113:0:82628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782759665.575178:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355233012224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (503us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1782759665.575186:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1782759665.576353:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967416 gen 2 00000004:00080000:1.0:1782759665.576362:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc479e300, transno 4294967416 00000100:00100000:1.0:1782759665.576386:0:3663:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8cddc3cab800 x1869355233012224/t4294967417(4294967417) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1782759681 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1782759665.576398:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc3cab800/2, rc 0, transno 4294967417 00000100:00100000:1.0:1782759665.576403:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233012224:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1782759666.572779:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759666.982527:0:155107:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff762fea50 20000000:00000080:3.0:1782759666.982548:0:155107:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc264e400 uarg=0000000000000000 00010000:00010000:3.0:1782759666.983857:0:155107:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759666.983905:0:155107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34fd600) 00010000:00010000:3.0:1782759666.983911:0:155107:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759666.983925:0:155107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d444 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27591 expref: 5 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.983947:0:155107:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759666.983976:0:155107:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759666.983989:0:155107:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759666.984036:0:155107:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759666.984052:0:155107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.984066:0:155107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.984074:0:155107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.984115:0:155107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.984151:0:155107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 23 pid: 6525 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759666.984166:0:155107:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155107:1869355233012352:0@lo:104: 00000100:00100000:3.0:1782759666.984315:0:155107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759666.984369:0:155107:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759666.984396:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759666.984408:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012352 00000100:00100000:1.0:1782759666.984416:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012352 00000100:00100000:1.0:1782759666.984464:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1782759666.984473:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:155107:x1869355233012352:12345-0@lo:104: 00010000:00010000:1.0:1782759666.984485:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759666.984551:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759666.984566:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf8a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:155107:x1869355233012352:12345-0@lo:104: Request processed in 94us (251us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759666.984598:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759666.984605:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759666.984609:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00010000:00010000:2.0:1782759666.984612:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ca00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759666.984616:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.984624:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759666.984631:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759666.984646:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759666.984690:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.984697:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759666.984716:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.984723:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d405 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d40c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.984742:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759666.984744:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759666.984746:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759666.984753:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759666.984763:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233012480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759666.984795:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759666.985276:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012480 00000100:00100000:3.0:1782759666.985282:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012480 00010000:00010000:3.0:1782759666.985304:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 24 pid: 6525 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759666.985367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:3.0:1782759666.985376:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233012480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759666.985387:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759666.985392:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 24 pid: 6525 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985402:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 24 pid: 6525 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985418:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985427:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985440:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985458:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985465:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985473:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985477:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759666.985482:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985489:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985497:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759666.985507:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759666.985618:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233012480:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759666.985626:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1782759666.987467:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233012480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759666.987553:0:155107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d40c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d405 expref: 23 pid: 6525 timeout: 3857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759666.987569:0:155107:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155107:1869355233012352:0@lo:104: 00010000:00010000:2.0:1782759666.987626:0:155107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.987636:0:155107:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.987662:0:155107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759666.987668:0:155107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d483 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759667.596744:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233012608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759667.596815:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759667.596880:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012608 00000100:00100000:3.0:1782759667.596888:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012608 00000100:00100000:3.0:1782759667.596944:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00000100:00100000:3.0:1782759667.596952:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233012608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759667.596991:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:3.0:1782759667.597609:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233012608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 656us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759667.597618:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00010000:00010000:3.0:1782759667.599850:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759667.600462:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233012608:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759667.972668:0:155155:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9f206cb0 20000000:00000080:1.0:1782759667.972687:0:155155:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc5463800 uarg=0000000000000000 00010000:00010000:1.0:1782759667.973485:0:155155:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759667.973505:0:155155:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759667.973529:0:155155:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759667.973542:0:155155:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759667.973563:0:155155:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759667.974147:0:155155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974165:0:155155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974307:0:155155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974316:0:155155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974323:0:155155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974331:0:155155:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974337:0:155155:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759667.974342:0:155155:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974467:0:155155:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974480:0:155155:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974487:0:155155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759667.974493:0:155155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d48a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759668.492078:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759668.492087:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759668.492092:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759668.492144:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492158:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492170:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759668.492198:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233012736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759668.492287:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759668.492332:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc1095f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759668.492356:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012736 00000100:00100000:1.0:1782759668.492363:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012736 00000100:00100000:1.0:1782759668.492419:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:1.0:1782759668.492436:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233012736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759668.492451:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759668.492463:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d491 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492486:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492497:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492507:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759668.492545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233012736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759668.492553:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:1.0:1782759668.492644:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233012736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759668.492659:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492670:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759668.492687:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759668.492691:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759668.492698:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759668.619443:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233013248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.619509:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759668.619621:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233012864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.619654:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759668.619699:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233013376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.619732:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759668.619749:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233013888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.619770:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620041:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233013760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620068:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620091:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233014272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620110:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620321:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233012992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620360:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620474:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233013504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620496:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620513:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233014016:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620544:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620561:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759668.620567:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233013120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620610:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620627:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233013632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620648:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620663:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233014144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.620683:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759668.620846:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013248 00000100:00100000:3.0:1782759668.620854:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013248 00000100:00100000:3.0:1782759668.620912:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012992 00000100:00100000:3.0:1782759668.620916:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012992 00000100:00100000:3.0:1782759668.620933:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1782759668.620940:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233013248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.621000:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233013248:12345-0@lo:400:kworker.0 Request processed in 59us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.621008:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1782759668.621024:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391 00000100:00100000:3.0:1782759668.621030:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233012992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.621060:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233012992:12345-0@lo:400:kworker.0 Request processed in 31us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.621066:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391 00000100:00100000:3.0:1782759668.621084:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233012864 00000100:00100000:3.0:1782759668.621088:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233012864 00000100:00100000:3.0:1782759668.621107:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013376 00000100:00100000:3.0:1782759668.621110:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013376 00000100:00100000:3.0:1782759668.622248:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013888 00000100:00100000:3.0:1782759668.622258:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013888 00000100:00100000:3.0:1782759668.622288:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013504 00000100:00100000:3.0:1782759668.622291:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013504 00000100:00100000:3.0:1782759668.622303:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014016 00000100:00100000:3.0:1782759668.622307:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014016 00000100:00100000:0.0:1782759668.622833:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013760 00000100:00100000:0.0:1782759668.622841:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013760 00000100:00100000:0.0:1782759668.622876:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014272 00000100:00100000:0.0:1782759668.622880:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014272 00000100:00100000:0.0:1782759668.622893:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013632 00000100:00100000:0.0:1782759668.622895:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013632 00000100:00100000:0.0:1782759668.622905:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014144 00000100:00100000:0.0:1782759668.622914:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014144 00000100:00100000:0.0:1782759668.622939:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1782759668.622946:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233013760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.623015:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233013760:12345-0@lo:400:kworker.0 Request processed in 70us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759668.623021:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3076 00000100:00100000:0.0:1782759668.623037:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3077 00000100:00100000:0.0:1782759668.623043:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233014272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.623070:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233014272:12345-0@lo:400:kworker.0 Request processed in 29us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759668.623076:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3077 00000100:00100000:0.0:1782759668.623086:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1782759668.623091:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233013632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.623116:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233013632:12345-0@lo:400:kworker.0 Request processed in 25us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759668.623121:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3078 00000100:00100000:0.0:1782759668.623147:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3079 00000100:00100000:0.0:1782759668.623154:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233014144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.623182:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233014144:12345-0@lo:400:kworker.0 Request processed in 29us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759668.623187:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3079 00000100:00100000:3.0:1782759668.623461:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233013120 00000100:00100000:3.0:1782759668.623466:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233013120 00000100:00100000:3.0:1782759668.623483:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5290 00000100:00100000:3.0:1782759668.623489:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355233012864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.623544:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3665:x1869355233012864:12345-0@lo:400:kworker.0 Request processed in 55us (3889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.623561:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5290 00000100:00100000:3.0:1782759668.623595:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5291 00000100:00100000:3.0:1782759668.623603:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355233013376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.623634:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3665:x1869355233013376:12345-0@lo:400:kworker.0 Request processed in 34us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.623640:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5291 00000100:00100000:3.0:1782759668.623653:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5292 00000100:00100000:3.0:1782759668.623659:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355233013888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.623687:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3665:x1869355233013888:12345-0@lo:400:kworker.0 Request processed in 28us (3915us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.623692:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5292 00000100:00100000:3.0:1782759668.624608:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5293 00000100:00100000:3.0:1782759668.624621:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233013504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.624671:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233013504:12345-0@lo:400:kworker.0 Request processed in 54us (4173us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.624677:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5293 00000100:00100000:3.0:1782759668.624696:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5294 00000100:00100000:3.0:1782759668.625207:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233014016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625260:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233014016:12345-0@lo:400:kworker.0 Request processed in 557us (4714us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.625267:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5294 00000100:00100000:3.0:1782759668.625282:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5295 00000100:00100000:3.0:1782759668.625288:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233013120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.625589:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233012864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.625605:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233013376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759668.625618:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233013888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625812:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233013120:12345-0@lo:400:kworker.0 Request processed in 29us (4707us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759668.625827:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5295 00000100:00080000:3.0:1782759668.625886:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759668.625890:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759668.625894:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759668.625896:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759668.625919:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233013120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625930:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233013632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625939:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233014144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625950:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233012992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625960:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233013504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.625970:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233014016:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.626008:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233013248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.626021:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233013760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759668.626032:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233014272:0@lo:400:kworker.0 00010000:00010000:0.0:1782759668.637780:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759669.007509:0:155203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc6483e50 20000000:00000080:1.0:1782759669.007794:0:155203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf944400 uarg=0000000000000000 00010000:00010000:1.0:1782759669.008076:0:155203:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759669.008100:0:155203:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759669.008128:0:155203:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759669.008139:0:155203:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759669.008163:0:155203:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759669.008183:0:155203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.008202:0:155203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.008211:0:155203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.008263:0:155203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759669.008278:0:155203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 23 pid: 6526 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759669.008295:0:155203:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155203:1869355233014400:0@lo:104: 00000100:00100000:1.0:1782759669.008360:0:155203:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759669.008466:0:155203:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759669.008831:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014400 00000100:00100000:3.0:1782759669.008841:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014400 00000100:00100000:3.0:1782759669.008926:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1782759669.008937:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:155203:x1869355233014400:12345-0@lo:104: 00010000:00010000:3.0:1782759669.008950:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759669.009031:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759669.009037:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:155203:x1869355233014400:12345-0@lo:104: Request processed in 103us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759669.009056:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:2.0:1782759669.009129:0:155203:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155203:1869355233014400:0@lo:104: 00010000:00010000:2.0:1782759669.009154:0:155203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009276:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759669.009284:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009293:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759669.009296:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009305:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759669.009312:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759669.009318:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759669.009361:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009368:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759669.009390:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009397:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428c00/0xd5b45c7f5c60d491 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d498 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009413:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759669.009414:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759669.009416:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759669.009428:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233014528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759669.009472:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759669.009527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014528 00000100:00100000:0.0:1782759669.009532:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014528 00010000:00010000:0.0:1782759669.009554:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 24 pid: 6526 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759669.009612:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1782759669.009620:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233014528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759669.009632:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759669.009637:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 24 pid: 6526 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009647:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 24 pid: 6526 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009660:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d498 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d491 expref: 24 pid: 6526 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009673:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009681:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009694:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009712:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009719:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009732:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009737:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759669.009741:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009748:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009758:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759669.009767:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759669.009796:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233014528:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759669.009803:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1782759669.009835:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233014528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759669.010136:0:155203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.010146:0:155203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759669.010152:0:155203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d49f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759669.147655:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233014656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759669.147759:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759669.147838:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759669.147847:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233014784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759669.147875:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759669.147911:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014656 00000100:00100000:1.0:1782759669.147919:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014656 00000100:00100000:1.0:1782759669.147966:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014784 00000100:00100000:1.0:1782759669.147970:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014784 00000100:00100000:1.0:1782759669.147995:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2736 00000100:00100000:1.0:1782759669.148017:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233014656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759669.148056:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759669.148104:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233014656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759669.148111:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2736 00000100:00100000:1.0:1782759669.148129:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2737 00000100:00100000:1.0:1782759669.148134:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233014784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759669.148144:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:1.0:1782759669.148178:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233014784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759669.148184:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2737 00000100:00100000:1.0:1782759669.148225:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233014784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759669.148250:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233014656:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782759669.645493:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759670.157211:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233014912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759670.157303:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759670.158451:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759670.158470:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233015040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759670.158518:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759670.158572:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015040 00000100:00100000:2.0:1782759670.158605:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015040 00000100:00100000:2.0:1782759670.158682:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1782759670.158703:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233015040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759670.158743:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759670.158803:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233015040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759670.158810:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2738 00000100:00100000:2.0:1782759670.158871:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233015040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759670.158907:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759670.166972:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759670.166995:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233015168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759670.167065:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759670.167121:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015168 00000100:00100000:0.0:1782759670.167129:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015168 00000100:00100000:0.0:1782759670.167683:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2739 00000100:00100000:0.0:1782759670.167693:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233015168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759670.167717:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759670.167776:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233015168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759670.167783:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2739 00000100:00080000:0.0:1782759670.167807:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759670.167841:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233015168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759670.168077:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233014912 00000100:00100000:1.0:1782759670.168083:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233014912 00000100:00100000:1.0:1782759670.169412:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3392 00000100:00100000:1.0:1782759670.169426:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233014912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759670.169463:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1782759670.169555:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233014912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (12251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759670.169563:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3392 00000100:00100000:3.0:1782759670.169739:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233014912:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1782759670.240294:0:155252:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff03340d0 20000000:00000080:0.0:1782759670.240319:0:155252:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf629000 uarg=0000000000000000 00010000:00010000:0.0:1782759670.240572:0:155252:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759670.240738:0:155252:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759670.240763:0:155252:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759670.240774:0:155252:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759670.240792:0:155252:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759670.240813:0:155252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240830:0:155252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240841:0:155252:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240849:0:155252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240856:0:155252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240863:0:155252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240882:0:155252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759670.240887:0:155252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240895:0:155252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240907:0:155252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240916:0:155252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759670.240922:0:155252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166d800/0xd5b45c7f5c60d4a6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759670.497530:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759670.497559:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759670.497597:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759670.497618:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759670.497636:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759670.497659:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574720 00000100:00100000:3.0:1782759670.497668:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574720 00000100:00100000:3.0:1782759670.497712:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3302 00000100:00100000:3.0:1782759670.497720:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218574720:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759670.497776:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218574720:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 57us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759670.497783:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3302 00000100:00100000:3.0:1782759670.497809:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574976 00000100:00100000:3.0:1782759670.497812:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574976 00000100:00100000:3.0:1782759670.497840:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218574848 00000100:00100000:3.0:1782759670.497843:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218574848 00000100:00100000:3.0:1782759670.497859:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5296 00000100:00100000:3.0:1782759670.497864:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218574976:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759670.497889:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218574976:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759670.497896:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5296 00000100:00100000:3.0:1782759670.497905:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5297 00000100:00100000:3.0:1782759670.497909:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218574848:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759670.497941:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218574848:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759670.497947:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5297 00000100:00100000:3.0:1782759670.497962:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575232 00000100:00100000:3.0:1782759670.497965:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575232 00000100:00100000:3.0:1782759670.497988:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575104 00000100:00100000:3.0:1782759670.497990:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575104 00000100:00100000:3.0:1782759670.498006:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3080 00000100:00100000:3.0:1782759670.498011:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218575232:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759670.498031:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218575232:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759670.498037:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3080 00000100:00100000:3.0:1782759670.498045:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3081 00000100:00100000:3.0:1782759670.498050:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218575104:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759670.498066:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218575104:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 16us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759670.498071:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3081 00000100:00080000:3.0:1782759670.498181:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759670.498185:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759670.498187:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759670.498189:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759670.666930:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759670.922671:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759670.922680:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759670.922685:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759670.922731:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.922743:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.922754:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759670.922778:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233015296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759670.922844:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759670.922886:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759670.922909:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015296 00000100:00100000:2.0:1782759670.922915:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015296 00000100:00100000:2.0:1782759670.923199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:2.0:1782759670.923210:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233015296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759670.923232:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759670.923257:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d4ad expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.923278:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.923288:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.923297:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767600, rc 0) 00000100:00100000:2.0:1782759670.923336:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233015296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759670.923342:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:2.0:1782759670.923387:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233015296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759670.923401:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.923409:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759670.923427:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759670.923433:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759670.923438:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759671.691642:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759671.693741:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967417 is committed 00000100:00100000:2.0:1782759672.714707:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759672.714731:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233015424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759672.714822:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759672.714881:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015424 00000100:00100000:2.0:1782759672.714888:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015424 00000100:00100000:2.0:1782759672.714951:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393 00000100:00100000:2.0:1782759672.714959:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233015424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759672.714991:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:2.0:1782759672.715028:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233015424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759672.715034:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393 00000100:00100000:2.0:1782759672.715079:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233015424:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759672.715305:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759673.739680:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759673.739772:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575360 00000100:00100000:2.0:1782759673.739783:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575360 00000100:00100000:2.0:1782759673.739852:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3017 00000100:00100000:2.0:1782759673.739870:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112214:x1869355218575360:12345-192.168.202.31@tcp:48:lfs.0 00000100:00080000:1.0:1782759673.742372:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759673.746533:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233015552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746642:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.746695:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233016064:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746726:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.746755:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233016576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746781:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.746800:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233017088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746823:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.746862:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759673.746868:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233015680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746896:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.746915:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233016192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746938:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.746955:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233016704:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.746974:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747002:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233015808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747027:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747046:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233016320:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747066:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747081:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233016832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747098:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747112:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759673.747117:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233015936:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747154:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747165:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233016448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747185:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747210:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233016960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747230:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759673.747262:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015552 00000100:00100000:0.0:1782759673.747270:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015552 00000100:00100000:0.0:1782759673.747320:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:0.0:1782759673.747328:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233015552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747381:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233015552:12345-0@lo:400:kworker.0 Request processed in 53us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747396:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00000100:00100000:0.0:1782759673.747431:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016576 00000100:00100000:0.0:1782759673.747435:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016576 00000100:00100000:0.0:1782759673.747469:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017088 00000100:00100000:0.0:1782759673.747471:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017088 00000100:00100000:0.0:1782759673.747483:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016448 00000100:00100000:0.0:1782759673.747486:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016448 00000100:00100000:0.0:1782759673.747498:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016960 00000100:00100000:0.0:1782759673.747500:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016960 00000100:00100000:0.0:1782759673.747511:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3082 00000100:00100000:0.0:1782759673.747517:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233016576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747548:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233016576:12345-0@lo:400:kworker.0 Request processed in 31us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747555:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3082 00000100:00100000:0.0:1782759673.747566:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3083 00000100:00100000:0.0:1782759673.747571:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233017088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747627:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233017088:12345-0@lo:400:kworker.0 Request processed in 55us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747633:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3083 00000100:00100000:0.0:1782759673.747643:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1782759673.747648:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747676:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233016448:12345-0@lo:400:kworker.0 Request processed in 28us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747682:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3084 00000100:00100000:0.0:1782759673.747691:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3085 00000100:00100000:0.0:1782759673.747697:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233016960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747731:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233016960:12345-0@lo:400:kworker.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747737:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3085 00000100:00100000:0.0:1782759673.747755:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015680 00000100:00100000:0.0:1782759673.747759:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015680 00000100:00100000:0.0:1782759673.747774:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016192 00000100:00100000:0.0:1782759673.747776:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016192 00000100:00100000:0.0:1782759673.747788:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016704 00000100:00100000:0.0:1782759673.747790:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016704 00000100:00100000:0.0:1782759673.747800:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016320 00000100:00100000:0.0:1782759673.747802:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016320 00000100:00100000:0.0:1782759673.747813:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016832 00000100:00100000:0.0:1782759673.747815:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016832 00000100:00100000:0.0:1782759673.747826:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015936 00000100:00100000:0.0:1782759673.747829:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015936 00000100:00100000:0.0:1782759673.747841:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5298 00000100:00100000:0.0:1782759673.747846:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233015680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747874:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233015680:12345-0@lo:400:kworker.0 Request processed in 27us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747879:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5298 00000100:00100000:0.0:1782759673.747890:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5299 00000100:00100000:0.0:1782759673.747896:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233016192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747924:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233016192:12345-0@lo:400:kworker.0 Request processed in 28us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747930:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5299 00000100:00100000:0.0:1782759673.747940:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5300 00000100:00100000:0.0:1782759673.747946:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233016704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.747971:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233016704:12345-0@lo:400:kworker.0 Request processed in 25us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.747983:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5300 00000100:00100000:0.0:1782759673.747994:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5301 00000100:00100000:0.0:1782759673.747998:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233016320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748029:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233016320:12345-0@lo:400:kworker.0 Request processed in 30us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.748034:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5301 00000100:00100000:0.0:1782759673.748046:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5302 00000100:00100000:0.0:1782759673.748051:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233016832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748079:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233016832:12345-0@lo:400:kworker.0 Request processed in 28us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.748083:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5302 00000100:00100000:0.0:1782759673.748093:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5303 00000100:00100000:0.0:1782759673.748098:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233015936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748121:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1869355233015936:12345-0@lo:400:kworker.0 Request processed in 24us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.748127:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5303 00000100:00100000:0.0:1782759673.748150:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233016064 00000100:00100000:0.0:1782759673.748154:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233016064 00000100:00100000:0.0:1782759673.748194:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233015808 00000100:00100000:0.0:1782759673.748210:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233015808 00000100:00100000:0.0:1782759673.748225:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394 00000100:00100000:0.0:1782759673.748230:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233016064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748264:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233016064:12345-0@lo:400:kworker.0 Request processed in 33us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.748269:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394 00000100:00100000:0.0:1782759673.748288:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395 00000100:00100000:0.0:1782759673.748294:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233015808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748322:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233015808:12345-0@lo:400:kworker.0 Request processed in 29us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759673.748328:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395 00000100:00100000:0.0:1782759673.748386:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233015680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748399:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233016192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748409:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233016704:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748418:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233015552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748428:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233016064:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748439:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233016576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748449:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967417 gen 2 00000004:00080000:0.0:1782759673.748454:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc3cab800, transno 4294967417 00000100:00100000:0.0:1782759673.748464:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233017088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748517:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233015936:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748528:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233016448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748537:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233016960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748548:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233015808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748560:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233016320:0@lo:400:kworker.0 00000100:00100000:0.0:1782759673.748571:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233016832:0@lo:400:kworker.0 00000100:00080000:0.0:1782759673.759430:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759673.759440:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759673.759444:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759673.759447:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759673.759748:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112214:x1869355218575360:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 19880us (20069us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759673.759762:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3017 00010000:00010000:0.0:1782759673.760039:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759674.250908:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759674.250932:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233017216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759674.251020:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759674.251153:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017216 00000100:00100000:0.0:1782759674.251162:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017216 00000100:00100000:0.0:1782759674.251228:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2740 00000100:00100000:0.0:1782759674.251238:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233017216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759674.251273:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759674.251322:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233017216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759674.251329:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2740 00000100:00100000:3.0:1782759674.251417:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233017216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759674.251656:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759674.251679:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233017344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759674.251706:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759674.251826:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017344 00000100:00100000:2.0:1782759674.251832:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017344 00000100:00100000:2.0:1782759674.251879:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2741 00000100:00100000:2.0:1782759674.251886:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233017344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759674.251899:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759674.251939:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233017344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759674.251945:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2741 00000100:00100000:3.0:1782759674.252050:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233017344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759674.762865:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759675.276498:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233017472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759675.276573:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759675.276668:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233017600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759675.276696:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759675.276731:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017472 00000100:00100000:1.0:1782759675.276738:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017472 00000100:00100000:1.0:1782759675.276795:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1782759675.276805:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233017472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759675.276839:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1782759675.276884:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233017472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759675.276891:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1782759675.276915:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017600 00000100:00100000:1.0:1782759675.276919:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017600 00000100:00100000:1.0:1782759675.276954:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2742 00000100:00100000:1.0:1782759675.276961:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233017600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759675.276981:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759675.277014:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233017600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759675.277030:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2742 00000100:00080000:1.0:1782759675.277050:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759675.277089:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233017600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759675.277120:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233017472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759675.284784:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233017728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759675.284856:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759675.285050:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017728 00000100:00100000:0.0:1782759675.285060:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017728 00000100:00100000:0.0:1782759675.285132:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2743 00000100:00100000:0.0:1782759675.285142:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233017728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759675.285177:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759675.285236:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233017728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759675.285243:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2743 00000100:00080000:1.0:1782759675.285437:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759675.285477:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233017728:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1782759675.608842:0:155447:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64i: Nodemap quota enforcement with local_admin RBAC and offsets ========================================================== 15:01:14 (1782759674) 00000100:00100000:0.0:1782759675.619379:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759675.619427:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759675.619465:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759675.619489:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759675.619526:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759675.619556:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575488 00000100:00100000:0.0:1782759675.619566:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575488 00000100:00100000:0.0:1782759675.619632:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3305 00000100:00100000:0.0:1782759675.619642:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218575488:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759675.619706:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218575488:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 65us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759675.619713:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3305 00000100:00100000:0.0:1782759675.619745:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575616 00000100:00100000:0.0:1782759675.619748:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575616 00000100:00100000:0.0:1782759675.619776:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575744 00000100:00100000:0.0:1782759675.619778:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575744 00000100:00100000:0.0:1782759675.619796:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5304 00000100:00100000:0.0:1782759675.619802:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218575616:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759675.619829:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218575616:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759675.619835:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5304 00000100:00100000:0.0:1782759675.619846:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5305 00000100:00100000:0.0:1782759675.619851:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218575744:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759675.619870:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218575744:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759675.619876:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5305 00000100:00100000:0.0:1782759675.619890:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218575872 00000100:00100000:0.0:1782759675.619892:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218575872 00000100:00100000:0.0:1782759675.619923:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218576000 00000100:00100000:0.0:1782759675.619926:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218576000 00000100:00100000:0.0:1782759675.619950:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3086 00000100:00100000:0.0:1782759675.619955:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218575872:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759675.619981:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218575872:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759675.619987:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3086 00000100:00100000:0.0:1782759675.619996:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3087 00000100:00100000:0.0:1782759675.620001:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218576000:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759675.620018:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218576000:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 18us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759675.620024:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3087 00000100:00080000:0.0:1782759675.620169:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759675.620173:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759675.620176:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759675.620178:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759675.789242:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759676.810932:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1782759676.906327:0:155495:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782759676.906334:0:155495:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000004:00000400:1.0:1782759676.906492:0:155495:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0001: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1782759676.906494:0:155495:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to NONE 00010000:00010000:1.0:1782759677.836317:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759677.837260:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759677.837292:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233017856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759677.837367:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759677.837524:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017856 00000100:00100000:2.0:1782759677.837532:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017856 00000100:00100000:2.0:1782759677.837639:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3397 00000100:00100000:2.0:1782759677.837650:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233017856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759677.837695:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445863424 avail 1299623936 00000100:00100000:2.0:1782759677.837749:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233017856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759677.837758:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3397 00000100:00100000:1.0:1782759677.839084:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233017856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759678.861981:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233017984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862053:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862101:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233018496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862130:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862149:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233019008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862183:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862199:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233019520:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862217:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862238:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759678.862252:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233018368:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862278:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862292:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233018880:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862312:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862326:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233019392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862343:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862367:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233018112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862389:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862407:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233018624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862430:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862446:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233019136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862466:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862481:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759678.862487:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233018240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862506:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862522:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233018752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862540:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862556:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233019264:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862596:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759678.862629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233017984 00000100:00100000:0.0:1782759678.862638:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233017984 00000100:00100000:0.0:1782759678.862691:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1782759678.862700:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233017984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862753:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233017984:12345-0@lo:400:kworker.0 Request processed in 53us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.862771:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:0.0:1782759678.862804:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018496 00000100:00100000:0.0:1782759678.862807:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018496 00000100:00100000:0.0:1782759678.862841:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018240 00000100:00100000:0.0:1782759678.862843:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018240 00000100:00100000:0.0:1782759678.862854:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:0.0:1782759678.862860:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233018496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862890:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233018496:12345-0@lo:400:kworker.0 Request processed in 30us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.862896:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:0.0:1782759678.862905:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:0.0:1782759678.862911:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233018240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.862936:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233018240:12345-0@lo:400:kworker.0 Request processed in 25us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.862942:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:0.0:1782759678.862959:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019008 00000100:00100000:0.0:1782759678.862962:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019008 00000100:00100000:0.0:1782759678.862996:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019520 00000100:00100000:0.0:1782759678.862999:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019520 00000100:00100000:0.0:1782759678.863011:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018880 00000100:00100000:0.0:1782759678.863013:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018880 00000100:00100000:0.0:1782759678.863024:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019392 00000100:00100000:0.0:1782759678.863026:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019392 00000100:00100000:0.0:1782759678.863039:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3088 00000100:00100000:0.0:1782759678.863044:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233019008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863072:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233019008:12345-0@lo:400:kworker.0 Request processed in 28us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863078:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3088 00000100:00100000:0.0:1782759678.863095:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3089 00000100:00100000:0.0:1782759678.863101:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233019520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863129:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233019520:12345-0@lo:400:kworker.0 Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863135:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3089 00000100:00100000:0.0:1782759678.863145:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3090 00000100:00100000:0.0:1782759678.863150:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233018880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863189:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233018880:12345-0@lo:400:kworker.0 Request processed in 39us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863195:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3090 00000100:00100000:0.0:1782759678.863206:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1782759678.863212:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863235:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233019392:12345-0@lo:400:kworker.0 Request processed in 24us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863241:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3091 00000100:00100000:0.0:1782759678.863260:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018368 00000100:00100000:0.0:1782759678.863263:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018368 00000100:00100000:0.0:1782759678.863280:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018112 00000100:00100000:0.0:1782759678.863282:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018112 00000100:00100000:0.0:1782759678.863292:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018624 00000100:00100000:0.0:1782759678.863294:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018624 00000100:00100000:0.0:1782759678.863305:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019136 00000100:00100000:0.0:1782759678.863308:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019136 00000100:00100000:0.0:1782759678.863329:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233018752 00000100:00100000:0.0:1782759678.863331:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233018752 00000100:00100000:0.0:1782759678.863344:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019264 00000100:00100000:0.0:1782759678.863346:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019264 00000100:00100000:0.0:1782759678.863359:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5306 00000100:00100000:0.0:1782759678.863365:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355233018368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863402:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3663:x1869355233018368:12345-0@lo:400:kworker.0 Request processed in 37us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863408:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5306 00000100:00100000:0.0:1782759678.863420:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5307 00000100:00100000:0.0:1782759678.863426:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233018112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863451:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3664:x1869355233018112:12345-0@lo:400:kworker.0 Request processed in 25us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863456:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5307 00000100:00100000:0.0:1782759678.863467:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5308 00000100:00100000:0.0:1782759678.863472:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233018624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863497:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3664:x1869355233018624:12345-0@lo:400:kworker.0 Request processed in 26us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863503:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5308 00000100:00100000:0.0:1782759678.863513:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5309 00000100:00100000:0.0:1782759678.863519:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863541:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3664:x1869355233019136:12345-0@lo:400:kworker.0 Request processed in 23us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863547:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5309 00000100:00100000:0.0:1782759678.863556:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5310 00000100:00100000:0.0:1782759678.863561:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233018752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863605:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233018752:12345-0@lo:400:kworker.0 Request processed in 44us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863610:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5310 00000100:00100000:0.0:1782759678.863628:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5311 00000100:00100000:0.0:1782759678.863633:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233019264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863665:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233019264:12345-0@lo:400:kworker.0 Request processed in 32us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759678.863671:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5311 00000100:00100000:0.0:1782759678.863748:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233018368:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863758:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233018880:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863768:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233019392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863777:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233017984:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863786:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233018496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863796:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233019008:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863807:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233019520:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863869:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233018240:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863881:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233018752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863891:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233019264:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863902:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233018112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863913:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233018624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759678.863923:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233019136:0@lo:400:kworker.0 00000100:00080000:0.0:1782759678.863951:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759678.863955:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759678.863958:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759678.863960:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759678.872709:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759679.155340:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759679.155378:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759679.155421:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218576128 00000100:00100000:1.0:1782759679.155431:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218576128 00000100:00100000:1.0:1782759679.155485:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218576384 00000100:00100000:1.0:1782759679.155489:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218576384 00000100:00100000:1.0:1782759679.155512:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3018 00000100:00100000:1.0:1782759679.155522:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218576128:12345-192.168.202.31@tcp:41:mkdir.0 00000004:00000024:1.0:1782759679.155567:0:12673:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446129664 avail 1299890176 00000100:00100000:1.0:1782759679.155654:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218576128:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 133us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.155663:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3018 00000100:00100000:1.0:1782759679.155679:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3019 00000100:00100000:1.0:1782759679.155685:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112476:x1869355218576384:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:1.0:1782759679.155773:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233019648:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.155815:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.155862:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78d80 going to sleep for 11 seconds 00000100:00080000:1.0:1782759679.155878:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759679.155990:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019648 00000100:00100000:1.0:1782759679.155993:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019648 00000100:00100000:1.0:1782759679.156029:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400 00000100:00100000:1.0:1782759679.156034:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355233019648:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.156092:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355233019648:12345-0@lo:1000:mdt00_004.0 Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.156099:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400 00000100:00100000:1.0:1782759679.156136:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233019648:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.156188:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233019776:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.156210:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.156226:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.156238:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019776 00000100:00100000:1.0:1782759679.156241:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019776 00000100:00100000:1.0:1782759679.156265:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:1.0:1782759679.156271:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355233019776:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.156348:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355233019776:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759679.156354:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000100:00100000:1.0:1782759679.156376:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233019776:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1782759679.156420:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156431:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156441:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.156452:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233019904:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1782759679.156475:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.156489:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.156502:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233019904 00000100:00100000:1.0:1782759679.156505:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233019904 00000100:00100000:1.0:1782759679.156529:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3402 00000100:00100000:1.0:1782759679.156535:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:12673:x1869355233019904:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759679.156545:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759679.156562:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d4c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d4bb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156621:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d4c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4bb expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156638:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d4c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4bb expref: 7 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156654:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759679.156659:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759679.156662:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759679.156691:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355233019904:12345-0@lo:101:mdt00_004.0 Request processed in 156us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.156697:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3402 00000100:00100000:1.0:1782759679.156722:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233019904:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759679.156734:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156744:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759679.156758:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1782759679.156778:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156784:0:12673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156790:0:12673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759679.156799:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020032:0@lo:101:mdt00_004.0 00000100:00100000:1.0:1782759679.156819:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.156838:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.156847:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020032 00000100:00100000:1.0:1782759679.156856:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020032 00000100:00100000:1.0:1782759679.156877:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403 00000100:00100000:1.0:1782759679.156882:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:12673:x1869355233020032:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759679.156889:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759679.156898:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d4c9 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156912:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4c9 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156921:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4c9 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156927:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff8cddc34fea00) 00010000:00010000:1.0:1782759679.156930:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759679.156932:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759679.156956:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020032:12345-0@lo:101:mdt00_004.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.156961:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403 00000100:00100000:1.0:1782759679.156982:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020032:0@lo:101:mdt00_004.0 00010000:00010000:1.0:1782759679.156991:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.156998:0:12673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759679.157009:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1782759679.157030:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020160:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157058:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.157071:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.157082:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020160 00000100:00100000:1.0:1782759679.157085:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020160 00000100:00100000:1.0:1782759679.157107:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3404 00000100:00100000:1.0:1782759679.157112:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020160:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157176:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020160:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.157182:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3404 00000100:00100000:1.0:1782759679.157206:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020160:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157236:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157256:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.157268:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.157278:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020288 00000100:00100000:1.0:1782759679.157281:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020288 00000100:00100000:1.0:1782759679.157302:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3405 00000100:00100000:1.0:1782759679.157308:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020288:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157362:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020288:12345-0@lo:1000:mdt00_004.0 Request processed in 54us (105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759679.157369:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3405 00000100:00100000:1.0:1782759679.157393:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020288:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157501:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020416:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157524:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.157537:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.157547:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020416 00000100:00100000:1.0:1782759679.157550:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020416 00000100:00100000:1.0:1782759679.157600:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3406 00000100:00100000:1.0:1782759679.157606:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020416:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157657:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020416:12345-0@lo:1000:mdt00_004.0 Request processed in 51us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759679.157664:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3406 00000100:00100000:1.0:1782759679.157689:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020416:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157730:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020544:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1782759679.157752:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.157780:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759679.157867:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020544 00000100:00100000:3.0:1782759679.157872:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020544 00000100:00100000:3.0:1782759679.157909:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3407 00000100:00100000:3.0:1782759679.157915:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020544:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1782759679.158030:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020544:12345-0@lo:1000:mdt00_004.0 Request processed in 114us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759679.158037:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3407 00000100:00100000:0.0:1782759679.160861:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020544:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1782759679.160964:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1782759679.161039:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.161502:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759679.161644:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020672 00000100:00100000:0.0:1782759679.161652:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020672 00000100:00100000:0.0:1782759679.161732:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3408 00000100:00100000:0.0:1782759679.161742:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1782759679.161875:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020672:12345-0@lo:1000:mdt00_004.0 Request processed in 134us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.161883:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3408 00000100:00100000:2.0:1782759679.163647:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020672:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782759679.163739:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020800:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1782759679.163795:0:12673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759679.163839:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759679.164109:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233020800 00000100:00100000:0.0:1782759679.164116:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233020800 00000100:00100000:0.0:1782759679.164198:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3409 00000100:00100000:0.0:1782759679.164217:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1782759679.164298:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:12673:x1869355233020800:12345-0@lo:1000:mdt00_004.0 Request processed in 91us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.164307:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3409 00000100:00100000:2.0:1782759679.164544:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:12673:1869355233020800:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1782759679.165167:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].36, 992 off67952 00000040:00080000:2.0:1782759679.165240:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].36, 1144 off72536 00000004:00080000:2.0:1782759679.165248:0:12673:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc56e1840 with version 72 00000004:00080000:0.0:1782759679.165361:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 72 rpc_version 72 00000020:00100000:0.0:1782759679.165458:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759679.165467:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf92c000 x1869355233021056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2424/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759679.165486:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233021056:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759679.165549:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.165611:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc263a840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.165727:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021056 00000100:00100000:1.0:1782759679.165733:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021056 00000100:00100000:1.0:1782759679.165790:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410 00000100:00100000:1.0:1782759679.165799:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355233021056:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759679.166485:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355233021056:12345-0@lo:1000:osp_up0-1.0 Request processed in 685us (933us total) trans 4294968037 rc 0/0 00000100:00100000:1.0:1782759679.166494:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410 00000100:00100000:0.0:1782759679.167676:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233021056:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1782759679.168744:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168765:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168780:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759679.168801:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d946d30 reply state 00000000ad491a55 transno 4294967730 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168814:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168821:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:2.0:1782759679.168834:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759679.168840:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759679.168847:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00000004:00080000:2.0:1782759679.168859:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1782759679.168872:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168881:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168889:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168906:0:12673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1782759679.168910:0:12673:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1782759679.168915:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.168922:0:12673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759679.169035:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:112476:x1869355218576384:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 13345us (13651us total) trans 4294967730 rc 0/0 00000100:00100000:2.0:1782759679.169045:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3019 00010000:00010000:0.0:1782759679.169809:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759679.169820:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.169830:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428800 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:0.0:1782759679.169836:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759679.169846:0:6518:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.169890:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.169897:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759679.169931:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.169940:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5428800/0xd5b45c7f5c60d4bb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60d4c2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.169955:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759679.169957:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759679.169959:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759679.169981:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759679.170002:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233021184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759679.170067:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759679.170125:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021184 00000100:00100000:2.0:1782759679.170134:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021184 00000100:00100000:2.0:1782759679.170213:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1782759679.170223:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:3665:x1869355233021184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759679.170237:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759679.172028:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5429e00/0xd5b45c7f5c60d4c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4bb expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.172048:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759679.172053:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759679.172134:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3665:x1869355233021184:12345-0@lo:103:ldlm_bl.0 Request processed in 1912us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.172144:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1782759679.172345:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233021184:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1782759679.172933:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968037 is committed 00000100:00100000:1.0:1782759679.232538:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759679.232667:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218576512 00000100:00100000:0.0:1782759679.232678:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218576512 00000100:00100000:0.0:1782759679.232773:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3020 00000100:00100000:0.0:1782759679.232784:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112477:x1869355218576512:12345-192.168.202.31@tcp:101:chown.0 00010000:00010000:0.0:1782759679.232820:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759679.232850:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d4de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275a6 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759679.232900:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759679.232915:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.232930:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.232941:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.232951:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.232960:0:42628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4c9 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.232968:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.233005:0:42628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d4c9 expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759679.233022:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233021312:0@lo:104: 00000100:00100000:0.0:1782759679.233079:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.233137:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc263a840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759679.233191:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021312 00000100:00100000:1.0:1782759679.233196:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021312 00000100:00100000:1.0:1782759679.233237:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1782759679.233244:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355233021312:12345-0@lo:104: 00010000:00010000:1.0:1782759679.233256:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.233332:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759679.233339:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355233021312:12345-0@lo:104: Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759679.233353:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00010000:00010000:1.0:1782759679.233375:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759679.233381:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.233390:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429c00 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759679.233396:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759679.233406:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.233432:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.233439:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759679.233460:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.233467:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cddc5429c00/0xd5b45c7f5c60d4c9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d4d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.233486:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.233488:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759679.233490:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759679.233497:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759679.233508:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233021440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759679.233551:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759679.233669:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233021312:0@lo:104: 00010000:00010000:0.0:1782759679.233689:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.233783:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021440 00000100:00100000:3.0:1782759679.233788:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021440 00010000:00010000:3.0:1782759679.233810:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4c9 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.233850:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1782759679.233857:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3664:x1869355233021440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759679.233869:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759679.234797:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428e00/0xd5b45c7f5c60d4d0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4c9 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.234818:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff8cddc34fea00) 00010000:00010000:3.0:1782759679.234825:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.234837:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.234926:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.234964:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759679.235046:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233021440:12345-0@lo:103:ldlm_bl.0 Request processed in 1188us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.235205:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233021440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759679.235258:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.235277:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.235319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00100000:1.0:1782759679.235479:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:42628:1869355233021568:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1782759679.235678:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759679.235700:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759679.235826:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021568 00000100:00100000:0.0:1782759679.235834:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021568 00000100:00100000:0.0:1782759679.235897:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3411 00000100:00100000:0.0:1782759679.235907:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42628:x1869355233021568:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1782759679.236046:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:42628:x1869355233021568:12345-0@lo:1000:mdt00_005.0 Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.236053:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3411 00000100:00100000:2.0:1782759679.239597:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:42628:1869355233021568:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1782759679.239692:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d4f3 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239711:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239722:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759679.239749:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239769:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239775:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239797:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239805:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239811:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ce00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759679.239815:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239822:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239835:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759679.239838:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759679.239842:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239849:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d4e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239864:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239870:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239875:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239879:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759679.239887:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239893:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239900:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff8cddc34fea00) 00010000:00010000:2.0:1782759679.239902:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759679.239905:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239911:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d4ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239950:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d4de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275a6 expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239966:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275a6 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759679.239973:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759679.239975:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759679.239977:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766800, rc 0) 00000100:00100000:2.0:1782759679.240103:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112477:x1869355218576512:12345-192.168.202.31@tcp:101:chown.0 Request processed in 7320us (7574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.240113:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3020 00000100:00100000:2.0:1782759679.252456:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759679.252563:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218576640 00000100:00100000:1.0:1782759679.252736:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218576640 00000100:00100000:0.0:1782759679.257793:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3021 00000100:00100000:0.0:1782759679.257812:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:112477:x1869355218576640:12345-192.168.202.31@tcp:101:chown.0 00010000:00010000:0.0:1782759679.257843:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759679.257867:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d4fa lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275ad expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.257927:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d501 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.257943:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d501 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.257954:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d501 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759679.258012:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00000004:00200000:0.0:1782759679.258016:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1782759679.258053:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d4fa lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275ad expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.258095:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d501 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275ad expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.258104:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:0.0:1782759679.258107:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759679.258110:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166c800, rc 0) 00000100:00100000:0.0:1782759679.258202:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:112477:x1869355218576640:12345-192.168.202.31@tcp:101:chown.0 Request processed in 393us (5754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759679.258210:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3021 00000100:00100000:1.0:1782759679.264797:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759679.265011:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218576896 00000100:00100000:0.0:1782759679.265026:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218576896 00000100:00100000:0.0:1782759679.265220:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3022 00000100:00100000:0.0:1782759679.265241:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:112477:x1869355218576896:12345-192.168.202.31@tcp:36:chown.0 00010000:00010000:0.0:1782759679.265316:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759679.265354:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d501 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275ad expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.265378:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:0.0:1782759679.265383:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759679.265408:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.265423:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.265433:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759679.271025:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967731 is committed 00000004:00010000:0.0:1782759679.272693:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e70c9de reply state 0000000035c491f8 transno 4294967731 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.272736:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759679.272746:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:0.0:1782759679.272749:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1782759679.272754:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759679.272772:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00010000:00010000:3.0:1782759679.272773:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.272781:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.272788:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.272794:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759679.272799:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.272807:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.272876:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:3.0:1782759679.272879:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759679.272884:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759679.272891:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60d4d7 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1782759679.273038:0:8593:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1782759679.273062:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112477:x1869355218576896:12345-192.168.202.31@tcp:36:chown.0 Request processed in 7820us (8272us total) trans 4294967731 rc 0/0 00000100:00100000:0.0:1782759679.273072:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3022 00010000:00010000:1.0:1782759679.273090:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.273097:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.273103:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.273108:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ca00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759679.273111:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.273117:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.273126:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500d00) 00010000:00010000:1.0:1782759679.273128:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759679.273131:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759679.273147:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166ca00/0xd5b45c7f5c60d508 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759679.371697:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233021696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759679.371777:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759679.371965:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021696 00000100:00100000:2.0:1782759679.371974:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021696 00000100:00100000:2.0:1782759679.372061:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2744 00000100:00100000:2.0:1782759679.372070:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233021696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759679.372107:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759679.372170:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233021696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.372177:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2744 00000100:00100000:3.0:1782759679.372287:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233021696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759679.372482:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233021824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759679.372512:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759679.372596:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021824 00000100:00100000:2.0:1782759679.372600:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021824 00000100:00100000:2.0:1782759679.372634:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2745 00000100:00100000:2.0:1782759679.372641:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233021824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759679.372651:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759679.372785:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233021824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759679.372791:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2745 00000100:00100000:1.0:1782759679.372836:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233021824:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759679.888130:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759680.397126:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233021952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759680.397212:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759680.397268:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759680.397275:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233022080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759680.397301:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759680.397334:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759680.397343:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233022208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759680.397365:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759680.397621:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022080 00000100:00100000:2.0:1782759680.397629:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022080 00000100:00100000:2.0:1782759680.397677:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022208 00000100:00100000:2.0:1782759680.397679:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022208 00000100:00100000:2.0:1782759680.397710:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2746 00000100:00100000:2.0:1782759680.397720:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233022080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759680.397750:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759680.397793:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233022080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759680.397799:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2746 00000100:00100000:2.0:1782759680.397815:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2747 00000100:00100000:2.0:1782759680.397822:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233022208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759680.397831:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759680.397865:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233022208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759680.397871:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2747 00000100:00080000:2.0:1782759680.397886:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759680.397934:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233022208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759680.397961:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233022080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759680.400366:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233021952 00000100:00100000:1.0:1782759680.400378:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233021952 00000100:00100000:1.0:1782759680.402301:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:1.0:1782759680.402318:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233021952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759680.402359:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:1.0:1782759680.402455:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233021952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (5243us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759680.402463:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:2.0:1782759680.406959:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233021952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759680.744462:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759680.744509:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759680.744536:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759680.744595:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759680.744623:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759680.744652:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577024 00000100:00100000:1.0:1782759680.744661:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577024 00000100:00100000:1.0:1782759680.744725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3307 00000100:00100000:1.0:1782759680.744735:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218577024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759680.744807:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218577024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759680.744814:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3307 00000100:00100000:1.0:1782759680.744848:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577536 00000100:00100000:1.0:1782759680.744852:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577536 00000100:00100000:1.0:1782759680.744886:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577408 00000100:00100000:1.0:1782759680.744888:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577408 00000100:00100000:1.0:1782759680.744911:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3092 00000100:00100000:1.0:1782759680.744918:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218577536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759680.744946:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2405:x1869355218577536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759680.744952:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3092 00000100:00100000:1.0:1782759680.744965:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3093 00000100:00100000:1.0:1782759680.744971:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218577408:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759680.744993:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218577408:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759680.744999:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3093 00000100:00100000:3.0:1782759680.746926:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577280 00000100:00100000:3.0:1782759680.746937:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577280 00000100:00100000:3.0:1782759680.746989:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577152 00000100:00100000:3.0:1782759680.746993:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577152 00000100:00100000:3.0:1782759680.747025:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5312 00000100:00100000:3.0:1782759680.747034:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218577280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759680.747109:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218577280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759680.747117:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5312 00000100:00100000:3.0:1782759680.747135:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5313 00000100:00100000:3.0:1782759680.747198:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218577152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759680.747227:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218577152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 87us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759680.747234:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5313 00000100:00080000:3.0:1782759680.747387:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759680.747394:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759680.915001:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759681.932314:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759682.957165:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759682.958372:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759682.958406:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233022336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759682.958499:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759682.958562:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022336 00000100:00100000:0.0:1782759682.958570:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022336 00000100:00100000:1.0:1782759682.962912:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3413 00000100:00100000:1.0:1782759682.962933:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233022336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759682.962992:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445859328 avail 1299619840 00000100:00100000:1.0:1782759682.963088:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233022336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (4589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759682.963096:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3413 00000100:00100000:0.0:1782759682.963501:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968037 gen 2 00000004:00080000:0.0:1782759682.963507:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968037 committed transno 4294968037 00000020:00080000:0.0:1782759682.963515:0:3662:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc56e13c0 refcount 2 committed 0 result 0 batchid 35 00000020:00080000:0.0:1782759682.963519:0:3662:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec5282200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc56e1840 00000020:00080000:0.0:1782759682.963523:0:3662:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].36 00000020:00080000:0.0:1782759682.963526:0:3662:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdec5282700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc4acf800 00000020:00080000:0.0:1782759682.963529:0:3662:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].36 00000100:00100000:0.0:1782759682.963836:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233022336:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1782759682.963890:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 35 committed batchid 34 00000020:00080000:1.0:1782759682.963965:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 34 00000020:00000080:0.0:1782759683.493967:0:155788:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdcedb79b0 20000000:00000080:0.0:1782759683.493993:0:155788:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedb4d8800 uarg=0000000000000000 10000000:01000000:0.0:1782759683.496390:0:155788:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759683.496610:0:155788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759683.496631:0:155788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759683.496639:0:155788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759683.496682:0:155788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759683.496699:0:155788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 23 pid: 6524 timeout: 3873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759683.496714:0:155788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155788:1869355233022464:0@lo:104: 00000100:00100000:0.0:1782759683.496778:0:155788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759683.496844:0:155788:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc26296c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759683.496877:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022464 00000100:00100000:3.0:1782759683.496885:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022464 00000100:00100000:0.0:1782759683.496967:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1782759683.496977:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:155788:x1869355233022464:12345-0@lo:104: 00010000:00010000:0.0:1782759683.496990:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759683.497170:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759683.497178:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:155788:x1869355233022464:12345-0@lo:104: Request processed in 202us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759683.497201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1782759683.497375:0:155788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155788:1869355233022464:0@lo:104: 00010000:00010000:3.0:1782759683.497395:0:155788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.501200:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759683.501328:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.501340:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759683.501345:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.501355:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759683.501362:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759683.501368:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759683.501487:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.501494:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759683.501532:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.501539:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766400/0xd5b45c7f5c60d4ad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d4b4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.501595:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759683.501598:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759683.501600:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759683.502524:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233022592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759683.502623:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759683.503315:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022592 00000100:00100000:1.0:1782759683.503326:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022592 00010000:00010000:1.0:1782759683.503399:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 24 pid: 6524 timeout: 3873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759683.503449:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:1.0:1782759683.503459:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233022592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759683.503474:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759683.503479:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 24 pid: 6524 timeout: 3873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.503491:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 24 pid: 6524 timeout: 3873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.503507:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d4b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d4ad expref: 24 pid: 6524 timeout: 3873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.503527:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.503535:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.503550:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504127:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504138:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504145:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504150:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759683.504154:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504162:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504182:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759683.504195:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759683.504303:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233022592:12345-0@lo:103:ldlm_bl.0 Request processed in 845us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759683.504311:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00010000:00010000:3.0:1782759683.504369:0:155788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759683.504378:0:155788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759683.504384:0:155788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d50f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759683.510658:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233022592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759683.979913:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233023104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980023:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980084:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233023616:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980119:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980139:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233024128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980160:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980182:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1782759683.980187:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233022720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980215:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980234:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233023232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980270:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980293:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233023744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980315:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980332:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233024256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980368:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980394:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233022976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980415:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980431:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233023488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980451:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980464:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233024000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980483:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980499:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782759683.980505:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233022848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980524:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980540:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233023360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980560:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980574:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233023872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980615:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759683.980642:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023616 00000100:00100000:3.0:1782759683.980649:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023616 00000100:00100000:3.0:1782759683.980699:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024128 00000100:00100000:3.0:1782759683.980702:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024128 00000100:00100000:3.0:1782759683.980719:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023744 00000100:00100000:3.0:1782759683.980721:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023744 00000100:00100000:3.0:1782759683.980733:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024256 00000100:00100000:3.0:1782759683.980735:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024256 00000100:00100000:3.0:1782759683.980748:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1782759683.980755:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233023616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980825:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233023616:12345-0@lo:400:kworker.0 Request processed in 69us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.980832:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3094 00000100:00100000:3.0:1782759683.980856:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1782759683.980862:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233024128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980893:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233024128:12345-0@lo:400:kworker.0 Request processed in 31us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.980899:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3095 00000100:00100000:3.0:1782759683.980909:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3096 00000100:00100000:3.0:1782759683.980914:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233023744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980938:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233023744:12345-0@lo:400:kworker.0 Request processed in 24us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.980944:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3096 00000100:00100000:3.0:1782759683.980953:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3097 00000100:00100000:3.0:1782759683.980958:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233024256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.980981:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233024256:12345-0@lo:400:kworker.0 Request processed in 23us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.980987:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3097 00000100:00100000:3.0:1782759683.981013:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023104 00000100:00100000:3.0:1782759683.981016:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023104 00000100:00100000:3.0:1782759683.981033:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023488 00000100:00100000:3.0:1782759683.981035:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023488 00000100:00100000:3.0:1782759683.981046:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024000 00000100:00100000:3.0:1782759683.981049:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024000 00000100:00100000:3.0:1782759683.981059:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022848 00000100:00100000:3.0:1782759683.981061:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022848 00000100:00100000:3.0:1782759683.981068:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023360 00000100:00100000:3.0:1782759683.981070:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023360 00000100:00100000:3.0:1782759683.981078:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023872 00000100:00100000:3.0:1782759683.981081:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023872 00000100:00100000:3.0:1782759683.981092:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5314 00000100:00100000:3.0:1782759683.981097:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355233023104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981150:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355233023104:12345-0@lo:400:kworker.0 Request processed in 52us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.981155:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5314 00000100:00100000:3.0:1782759683.981166:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5315 00000100:00100000:3.0:1782759683.981170:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233023488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981198:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233023488:12345-0@lo:400:kworker.0 Request processed in 28us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.981204:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5315 00000100:00100000:3.0:1782759683.981214:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5316 00000100:00100000:3.0:1782759683.981219:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233024000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981242:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233024000:12345-0@lo:400:kworker.0 Request processed in 24us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.981247:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5316 00000100:00100000:3.0:1782759683.981257:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5317 00000100:00100000:3.0:1782759683.981262:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355233022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981285:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3663:x1869355233022848:12345-0@lo:400:kworker.0 Request processed in 24us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.981291:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5317 00000100:00100000:3.0:1782759683.981301:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5318 00000100:00100000:3.0:1782759683.981307:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355233023360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981332:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3663:x1869355233023360:12345-0@lo:400:kworker.0 Request processed in 26us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.981337:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5318 00000100:00100000:3.0:1782759683.981348:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5319 00000100:00100000:3.0:1782759683.981353:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355233023872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981386:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3663:x1869355233023872:12345-0@lo:400:kworker.0 Request processed in 33us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759683.981392:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5319 00000100:00080000:3.0:1782759683.981418:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759683.981422:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759683.981425:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759683.981427:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759683.981457:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233022848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981469:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233023360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981477:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233023872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981487:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233023488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981494:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233024000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981535:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233023744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981544:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233024256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981553:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233023104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981562:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233023616:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.981572:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233024128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759683.981756:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022720 00000100:00100000:0.0:1782759683.981761:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022720 00000100:00100000:0.0:1782759683.981805:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1782759683.981812:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233022720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759683.981857:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233022720:12345-0@lo:400:kworker.0 Request processed in 47us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759683.981863:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00100000:1.0:1782759683.982048:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233023232 00000100:00100000:1.0:1782759683.982052:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233023232 00000100:00100000:1.0:1782759683.982124:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233022976 00000100:00100000:1.0:1782759683.982128:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233022976 00000100:00100000:1.0:1782759683.982144:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3414 00000100:00100000:1.0:1782759683.982151:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233023232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759683.982199:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233023232:12345-0@lo:400:kworker.0 Request processed in 49us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759683.982206:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3414 00000100:00100000:1.0:1782759683.982219:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3415 00000100:00100000:1.0:1782759683.982224:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233022976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759683.982256:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233022976:12345-0@lo:400:kworker.0 Request processed in 32us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759683.982262:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3415 00010000:00010000:1.0:1782759683.982318:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759683.982340:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233022976:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.987325:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233022720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759683.987350:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233023232:0@lo:400:kworker.0 00000100:00100000:0.0:1782759684.495628:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759684.495649:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233024384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759684.495717:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759684.495970:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024384 00000100:00100000:2.0:1782759684.495977:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024384 00000100:00100000:2.0:1782759684.496053:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2748 00000100:00100000:2.0:1782759684.496064:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233024384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759684.496096:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759684.496139:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233024512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759684.496147:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233024384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.496154:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2748 00000100:00100000:3.0:1782759684.496175:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759684.496294:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233024384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759684.498598:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024512 00000100:00100000:2.0:1782759684.498610:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024512 00000100:00100000:2.0:1782759684.498666:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2749 00000100:00100000:2.0:1782759684.498676:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233024512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759684.499348:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759684.499567:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233024512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 892us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759684.499598:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2749 00000100:00100000:2.0:1782759684.499659:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233024512:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1782759684.652466:0:155837:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff6c9b91b0 20000000:00000080:2.0:1782759684.652486:0:155837:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e83800 uarg=0000000000000000 10000000:01000000:2.0:1782759684.652673:0:155837:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759684.652693:0:155837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652710:0:155837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652720:0:155837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652727:0:155837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652734:0:155837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652742:0:155837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652747:0:155837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759684.652752:0:155837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652759:0:155837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652772:0:155837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652779:0:155837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759684.652799:0:155837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d516 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759685.005981:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759685.131094:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759685.131113:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759685.131119:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759685.131170:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.131181:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.131191:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759685.131564:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233024640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759685.131677:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759685.131725:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759685.133167:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024640 00000100:00100000:1.0:1782759685.133180:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024640 00000100:00100000:1.0:1782759685.133260:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:1.0:1782759685.133270:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233024640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759685.133286:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759685.133308:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d51d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759685.133332:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759685.133343:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759685.133351:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429000, rc 0) 00000100:00100000:1.0:1782759685.133432:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233024640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759685.133452:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:2.0:1782759685.133724:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233024640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759685.133742:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.133752:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759685.133773:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759685.133778:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759685.133799:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759685.524559:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233024896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759685.524652:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759685.524708:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759685.524715:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233024768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759685.524739:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759685.524883:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024896 00000100:00100000:2.0:1782759685.524891:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024896 00000100:00100000:2.0:1782759685.524950:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233024768 00000100:00100000:2.0:1782759685.524953:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233024768 00000100:00100000:2.0:1782759685.524986:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2750 00000100:00100000:2.0:1782759685.524995:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233024896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759685.525495:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759685.525563:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233024896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 569us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759685.525572:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2750 00000100:00100000:2.0:1782759685.525619:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2751 00000100:00100000:2.0:1782759685.525629:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233024768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759685.525641:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759685.525666:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233024768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759685.525671:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2751 00000100:00100000:2.0:1782759685.525727:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233024768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759685.525742:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233024896:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759685.525819:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759685.526179:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759685.526191:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233025024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759685.526239:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759685.526626:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025024 00000100:00100000:1.0:1782759685.526632:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025024 00000100:00100000:1.0:1782759685.526694:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3416 00000100:00100000:1.0:1782759685.526702:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233025024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759685.526729:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:1.0:1782759685.526777:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233025024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759685.526784:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3416 00000100:00100000:1.0:1782759685.526820:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233025024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759685.889705:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759685.889748:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759685.889774:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759685.889792:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759685.889814:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759685.889843:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577664 00000100:00100000:0.0:1782759685.889852:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577664 00000100:00100000:0.0:1782759685.889953:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3310 00000100:00100000:0.0:1782759685.889964:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218577664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759685.890042:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218577664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 79us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759685.890050:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3310 00000100:00100000:3.0:1782759685.891287:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577920 00000100:00100000:3.0:1782759685.891298:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577920 00000100:00100000:0.0:1782759685.893611:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218577792 00000100:00100000:0.0:1782759685.893635:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218577792 00000100:00100000:0.0:1782759685.893703:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5320 00000100:00100000:0.0:1782759685.893713:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218577792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759685.893798:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218577792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (4003us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759685.893805:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5320 00000100:00100000:0.0:1782759685.893830:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578176 00000100:00100000:0.0:1782759685.893834:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578176 00000100:00100000:0.0:1782759685.893862:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578048 00000100:00100000:0.0:1782759685.893865:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578048 00000100:00100000:0.0:1782759685.893899:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3098 00000100:00100000:0.0:1782759685.893905:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218578176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759685.893933:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218578176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759685.893939:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3098 00000100:00100000:0.0:1782759685.893951:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3099 00000100:00100000:0.0:1782759685.893957:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218578048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759685.893980:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218578048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (4165us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759685.893986:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3099 00000100:00080000:3.0:1782759685.894788:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759685.894793:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759685.894796:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759685.894798:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759685.894816:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5321 00000100:00100000:3.0:1782759685.894827:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218577920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759685.895130:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218577920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 304us (5380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759685.895138:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5321 00010000:00010000:1.0:1782759686.026779:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759687.051321:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759688.079266:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233025152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759688.079333:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759688.079602:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025152 00000100:00100000:3.0:1782759688.079610:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025152 00000100:00100000:3.0:1782759688.079679:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3417 00000100:00100000:3.0:1782759688.079688:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233025152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759688.079740:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445859328 avail 1299619840 00000100:00100000:3.0:1782759688.079787:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233025152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759688.079793:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3417 00000100:00100000:2.0:1782759688.079881:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233025152:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759688.100840:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759688.331168:0:155984:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc07559e60 20000000:00000080:1.0:1782759688.331188:0:155984:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3c5ac00 uarg=0000000000000000 10000000:01000000:1.0:1782759688.331523:0:155984:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759688.331542:0:155984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.331558:0:155984:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.331568:0:155984:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.331763:0:155984:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.331789:0:155984:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 23 pid: 6524 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759688.331805:0:155984:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155984:1869355233025280:0@lo:104: 00000100:00100000:1.0:1782759688.331877:0:155984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759688.332043:0:155984:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759688.332105:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025280 00000100:00100000:0.0:1782759688.332114:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025280 00000100:00100000:0.0:1782759688.332205:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1782759688.332214:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:155984:x1869355233025280:12345-0@lo:104: 00010000:00010000:0.0:1782759688.332228:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759688.332301:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759688.332308:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:155984:x1869355233025280:12345-0@lo:104: Request processed in 95us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759688.332315:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1782759688.332373:0:155984:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:155984:1869355233025280:0@lo:104: 00010000:00010000:1.0:1782759688.332392:0:155984:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332446:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759688.332453:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332460:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759688.332463:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332472:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759688.332479:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759688.332485:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759688.332520:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332527:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759688.332547:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332554:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d51d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d524 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332570:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759688.332605:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759688.332606:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759688.332618:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233025408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759688.332649:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759688.332684:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025408 00000100:00100000:3.0:1782759688.332688:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025408 00010000:00010000:3.0:1782759688.332705:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 24 pid: 6524 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759688.332727:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1782759688.332734:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233025408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759688.332744:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759688.332749:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 24 pid: 6524 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332758:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 24 pid: 6524 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332770:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429000/0xd5b45c7f5c60d524 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d51d expref: 24 pid: 6524 timeout: 3878 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332782:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332789:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332803:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332811:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332823:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332831:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332836:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759688.332840:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332849:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332859:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759688.332868:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759688.332895:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233025408:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759688.332902:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00010000:00010000:1.0:1782759688.333044:0:155984:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.333054:0:155984:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759688.333061:0:155984:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429a00/0xd5b45c7f5c60d52b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 155984 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759688.334014:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233025408:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1782759688.590383:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 35 batchid updated 00000020:00080000:0.0:1782759688.591112:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 35 00000004:00080000:0.0:1782759688.591180:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc4734d80 with version 73 00000020:00080000:0.0:1782759688.591192:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 35 cancel update log [0x200000401:0x2:0x0].36: rc = 0 00000020:00080000:0.0:1782759688.591331:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 35 cancel update log [0x240000400:0x2:0x0].36: rc = 0 00000020:00080000:0.0:1782759688.591347:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 35 00000004:00080000:0.0:1782759688.591356:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 73 rpc_version 73 00000020:00100000:0.0:1782759688.591388:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759688.591400:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf92c380 x1869355233025664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759688.591424:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233025664:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759688.591490:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759688.591540:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025664 00000100:00100000:0.0:1782759688.591544:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec32d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759688.591547:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025664 00000100:00100000:1.0:1782759688.591626:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3418 00000100:00100000:1.0:1782759688.591635:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355233025664:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759688.591786:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355233025664:12345-0@lo:1000:osp_up0-1.0 Request processed in 152us (295us total) trans 4294968038 rc 0/0 00000100:00100000:1.0:1782759688.591793:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3418 00000001:00080000:1.0:1782759688.593166:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968038 is committed 00000100:00100000:0.0:1782759688.596306:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233025664:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759689.101393:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233026176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.101474:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.101521:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233026688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.101850:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.101870:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233027200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.101891:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.101914:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782759689.101928:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233025792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.101958:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.101981:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233026304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102004:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102020:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233026816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102040:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102056:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233027328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102086:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102112:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233025920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102135:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102150:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233026432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102168:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102181:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233026944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102200:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102215:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759689.102220:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233026048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102241:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102256:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233026560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102276:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102289:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233027072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.102309:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.102349:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026688 00000100:00100000:0.0:1782759689.102355:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026688 00000100:00100000:0.0:1782759689.102404:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027200 00000100:00100000:0.0:1782759689.102408:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027200 00000100:00100000:0.0:1782759689.102439:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026816 00000100:00100000:0.0:1782759689.102443:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026816 00000100:00100000:0.0:1782759689.102456:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027328 00000100:00100000:0.0:1782759689.102458:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027328 00000100:00100000:0.0:1782759689.102474:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3100 00000100:00100000:0.0:1782759689.102482:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233026688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.106376:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233026688:12345-0@lo:400:kworker.0 Request processed in 3883us (4514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.106392:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3100 00000100:00100000:0.0:1782759689.106435:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3101 00000100:00100000:0.0:1782759689.106448:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233027200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.106526:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233027200:12345-0@lo:400:kworker.0 Request processed in 84us (4634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.106701:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3101 00000100:00100000:0.0:1782759689.106717:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3102 00000100:00100000:0.0:1782759689.106725:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233026816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.106828:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233026816:12345-0@lo:400:kworker.0 Request processed in 104us (4787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.106834:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3102 00000100:00100000:0.0:1782759689.106846:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3103 00000100:00100000:0.0:1782759689.106853:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233027328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.106882:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233027328:12345-0@lo:400:kworker.0 Request processed in 30us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.106887:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3103 00000100:00100000:0.0:1782759689.106919:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025792 00000100:00100000:0.0:1782759689.106926:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025792 00000100:00100000:0.0:1782759689.106966:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:0.0:1782759689.106978:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233025792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107009:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233025792:12345-0@lo:400:kworker.0 Request processed in 31us (5050us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107015:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:0.0:1782759689.107054:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026176 00000100:00100000:0.0:1782759689.107058:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026176 00000100:00100000:0.0:1782759689.107090:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233025920 00000100:00100000:0.0:1782759689.107093:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233025920 00000100:00100000:0.0:1782759689.107104:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026432 00000100:00100000:0.0:1782759689.107106:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026432 00000100:00100000:0.0:1782759689.107118:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026944 00000100:00100000:0.0:1782759689.107120:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026944 00000100:00100000:0.0:1782759689.107132:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1782759689.107137:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355233026176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107167:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355233026176:12345-0@lo:400:kworker.0 Request processed in 29us (5694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107172:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5322 00000100:00100000:0.0:1782759689.107181:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026560 00000100:00100000:0.0:1782759689.107183:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026560 00000100:00100000:0.0:1782759689.107196:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027072 00000100:00100000:0.0:1782759689.107199:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027072 00000100:00100000:0.0:1782759689.107210:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5323 00000100:00100000:0.0:1782759689.107215:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355233025920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107247:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355233025920:12345-0@lo:400:kworker.0 Request processed in 31us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107253:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5323 00000100:00100000:0.0:1782759689.107264:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5324 00000100:00100000:0.0:1782759689.107269:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355233026432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107302:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355233026432:12345-0@lo:400:kworker.0 Request processed in 32us (5133us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107308:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5324 00000100:00100000:0.0:1782759689.107706:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5325 00000100:00100000:0.0:1782759689.107715:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355233026944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107811:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355233026944:12345-0@lo:400:kworker.0 Request processed in 98us (5610us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107818:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5325 00000100:00100000:0.0:1782759689.107829:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5326 00000100:00100000:0.0:1782759689.107834:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233026560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107861:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233026560:12345-0@lo:400:kworker.0 Request processed in 27us (5585us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107866:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5326 00000100:00100000:0.0:1782759689.107877:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5327 00000100:00100000:0.0:1782759689.107882:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233027072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.107905:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233027072:12345-0@lo:400:kworker.0 Request processed in 24us (5595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.107911:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5327 00000100:00100000:0.0:1782759689.107937:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026304 00000100:00100000:0.0:1782759689.107942:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026304 00000100:00100000:0.0:1782759689.107979:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233026048 00000100:00100000:0.0:1782759689.107982:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233026048 00000100:00100000:0.0:1782759689.107994:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3419 00000100:00100000:0.0:1782759689.108000:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233026304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108030:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233026304:12345-0@lo:400:kworker.0 Request processed in 30us (6025us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.108042:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3419 00000100:00100000:0.0:1782759689.108054:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3420 00000100:00100000:0.0:1782759689.108059:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233026048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108106:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233026048:12345-0@lo:400:kworker.0 Request processed in 47us (5865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759689.108112:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3420 00000100:00080000:0.0:1782759689.108137:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759689.108141:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759689.108144:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759689.108146:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759689.108186:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968038 gen 2 00000004:00080000:0.0:1782759689.108191:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968038 committed transno 4294968038 00000100:00100000:0.0:1782759689.108215:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233026048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108230:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233026560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108240:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233027072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108250:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233025920:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108260:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233026432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108269:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233026944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108308:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233025792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108333:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233026304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108344:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233026816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108356:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233027328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108376:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233026176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108387:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233026688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759689.108397:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233027200:0@lo:400:kworker.0 00010000:00010000:1.0:1782759689.163127:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759689.230141:0:156032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0fa534c0 20000000:00000080:2.0:1782759689.230162:0:156032:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e80c00 uarg=0000000000000000 10000000:01000000:2.0:1782759689.232215:0:156032:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759689.232251:0:156032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232269:0:156032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232281:0:156032:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232287:0:156032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232294:0:156032:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232301:0:156032:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232307:0:156032:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759689.232311:0:156032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232325:0:156032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232340:0:156032:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232349:0:156032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759689.232373:0:156032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767a00/0xd5b45c7f5c60d532 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759689.486679:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759689.486687:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759689.486692:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759689.487237:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759689.487252:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759689.487265:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759689.487295:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233027456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759689.487382:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759689.487506:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759689.487658:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027456 00000100:00100000:1.0:1782759689.487666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027456 00000100:00100000:1.0:1782759689.487713:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3312 00000100:00100000:1.0:1782759689.487723:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233027456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759689.487747:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759689.487762:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d539 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759689.487786:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759689.487796:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759689.487805:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429800, rc 0) 00000100:00100000:1.0:1782759689.487843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233027456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759689.487850:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3312 00000100:00100000:0.0:1782759689.488017:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233027456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759689.488032:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759689.488041:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759689.488061:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759689.488078:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759689.488097:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759689.611473:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233027584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759689.611542:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759689.612240:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027584 00000100:00100000:3.0:1782759689.612249:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027584 00000100:00100000:3.0:1782759689.612308:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2752 00000100:00100000:3.0:1782759689.612317:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233027584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759689.612354:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759689.612411:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233027584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759689.612521:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233027712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759689.612557:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759689.612613:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027712 00000100:00100000:2.0:1782759689.612617:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027712 00000100:00100000:2.0:1782759689.612666:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2753 00000100:00100000:2.0:1782759689.612677:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233027712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759689.612683:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2752 00002000:00000024:2.0:1782759689.612691:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759689.612727:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233027712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759689.612734:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2753 00000100:00100000:1.0:1782759689.612863:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233027584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759689.612985:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233027712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759690.188623:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759690.233557:0:156080:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefa3a12a0 20000000:00000080:2.0:1782759690.233756:0:156080:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e82c00 uarg=0000000000000000 10000000:01000000:2.0:1782759690.234541:0:156080:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759690.234563:0:156080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759690.234883:0:156080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759690.234893:0:156080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759690.235443:0:156080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759690.235473:0:156080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 23 pid: 6524 timeout: 3880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759690.235490:0:156080:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156080:1869355233027840:0@lo:104: 00000100:00100000:2.0:1782759690.235556:0:156080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759690.235656:0:156080:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759690.236456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027840 00000100:00100000:0.0:1782759690.236465:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027840 00000100:00100000:0.0:1782759690.236531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1782759690.236541:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:156080:x1869355233027840:12345-0@lo:104: 00010000:00010000:0.0:1782759690.236557:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759690.236665:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759690.236671:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:156080:x1869355233027840:12345-0@lo:104: Request processed in 133us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.236678:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1782759690.237032:0:156080:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156080:1869355233027840:0@lo:104: 00010000:00010000:3.0:1782759690.237071:0:156080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237375:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759690.237383:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237391:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ce00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759690.237409:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237418:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759690.237425:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759690.237432:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759690.237476:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237482:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759690.237514:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237521:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d539 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d540 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237545:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759690.237547:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759690.237548:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759690.237556:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759690.237568:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233027968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759690.237638:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759690.237675:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233027968 00000100:00100000:1.0:1782759690.237678:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233027968 00010000:00010000:1.0:1782759690.237698:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 24 pid: 6524 timeout: 3880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759690.237733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1782759690.237741:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5717050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233027968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759690.237753:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759690.237758:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 24 pid: 6524 timeout: 3880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237768:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 24 pid: 6524 timeout: 3880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237782:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429800/0xd5b45c7f5c60d540 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d539 expref: 24 pid: 6524 timeout: 3880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237795:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237802:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237815:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237823:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237830:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237836:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237851:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759690.237855:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237863:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237873:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759690.237883:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759690.237926:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5717050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233027968:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759690.237933:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:1.0:1782759690.237993:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233027968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759690.238131:0:156080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759690.238139:0:156080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759690.238145:0:156080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767000/0xd5b45c7f5c60d547 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759690.634882:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759690.634904:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233028096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759690.634977:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759690.635108:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028096 00000100:00100000:2.0:1782759690.635116:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028096 00000100:00100000:2.0:1782759690.635190:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1782759690.635199:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233028096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759690.635230:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759690.635279:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233028096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759690.635286:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2754 00000100:00100000:2.0:1782759690.635339:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233028096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759690.635894:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233028224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759690.635934:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759690.635998:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028224 00000100:00100000:0.0:1782759690.636002:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028224 00000100:00100000:0.0:1782759690.636050:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3421 00000100:00100000:0.0:1782759690.636069:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233028224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759690.636096:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:0.0:1782759690.636150:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233028224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.636156:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3421 00000100:00100000:2.0:1782759690.636460:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233028352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759690.636495:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759690.636552:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028352 00000100:00100000:3.0:1782759690.636557:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028352 00000100:00100000:1.0:1782759690.636626:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4827800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233028224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759690.636723:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2755 00000100:00100000:3.0:1782759690.636731:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233028352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759690.636745:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759690.636785:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233028352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759690.636791:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2755 00000100:00100000:1.0:1782759690.636953:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233028352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759690.974770:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759690.974827:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759690.974855:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759690.974876:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759690.974899:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759690.974928:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578560 00000100:00100000:0.0:1782759690.974937:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578560 00000100:00100000:0.0:1782759690.975005:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578432 00000100:00100000:0.0:1782759690.975009:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578432 00000100:00100000:0.0:1782759690.975034:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5328 00000100:00100000:0.0:1782759690.975044:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218578560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759690.975135:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218578560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.975143:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5328 00000100:00100000:0.0:1782759690.975164:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5329 00000100:00100000:0.0:1782759690.975171:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218578432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759690.975199:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218578432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.975206:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5329 00000100:00100000:0.0:1782759690.975224:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578816 00000100:00100000:0.0:1782759690.975227:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578816 00000100:00100000:0.0:1782759690.975254:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578688 00000100:00100000:0.0:1782759690.975257:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578688 00000100:00100000:0.0:1782759690.975290:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3104 00000100:00100000:0.0:1782759690.975297:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218578816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759690.975325:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218578816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.975341:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3104 00000100:00100000:0.0:1782759690.975353:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3105 00000100:00100000:0.0:1782759690.975359:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218578688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759690.975385:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218578688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759690.975391:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3105 00000100:00080000:0.0:1782759690.975415:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759690.975419:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759690.975421:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759690.975423:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759690.975891:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578304 00000100:00100000:2.0:1782759690.975898:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578304 00000100:00100000:2.0:1782759690.975950:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3313 00000100:00100000:2.0:1782759690.975958:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218578304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759690.976008:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218578304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 50us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759690.976014:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3313 00010000:00010000:0.0:1782759691.214280:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759691.270152:0:156128:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb6ce62e0 20000000:00000080:2.0:1782759691.270183:0:156128:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e83c00 uarg=0000000000000000 10000000:01000000:2.0:1782759691.270494:0:156128:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759691.270519:0:156128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270537:0:156128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270547:0:156128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270553:0:156128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270560:0:156128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270566:0:156128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270572:0:156128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759691.270593:0:156128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270601:0:156128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270615:0:156128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270621:0:156128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759691.270638:0:156128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb766200/0xd5b45c7f5c60d54e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759691.787208:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759691.787217:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759691.787222:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759691.787268:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.787280:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.787292:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759691.787315:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233028480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759691.787381:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759691.787441:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028480 00000100:00100000:3.0:1782759691.787450:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028480 00000100:00100000:0.0:1782759691.787450:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded18030c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759691.787513:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314 00000100:00100000:3.0:1782759691.787523:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233028480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759691.787546:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759691.787560:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d555 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.787619:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.787629:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759691.787638:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759691.787678:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233028480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759691.787685:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314 00000100:00100000:0.0:1782759691.787901:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233028480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759691.787923:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.787932:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759691.787949:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759691.787954:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759691.787960:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782759692.208226:0:156177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd19937310 20000000:00000080:0.0:1782759692.208244:0:156177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4848800 uarg=0000000000000000 00010000:00010000:0.0:1782759692.208815:0:156177:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759692.208884:0:156177:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:0.0:1782759692.208889:0:156177:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759692.208899:0:156177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60d4f3 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275a6 expref: 5 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.208922:0:156177:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759692.208949:0:156177:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759692.208961:0:156177:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759692.208974:0:156177:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759692.208988:0:156177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.209001:0:156177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.209018:0:156177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.209064:0:156177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759692.209079:0:156177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 23 pid: 6525 timeout: 3882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759692.209093:0:156177:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156177:1869355233028608:0@lo:104: 00000100:00100000:0.0:1782759692.209155:0:156177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759692.209244:0:156177:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded18030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759692.209289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028608 00000100:00100000:2.0:1782759692.209296:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028608 00000100:00100000:2.0:1782759692.209377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1782759692.209387:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:156177:x1869355233028608:12345-0@lo:104: 00010000:00010000:2.0:1782759692.209399:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759692.209522:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759692.209529:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:156177:x1869355233028608:12345-0@lo:104: Request processed in 144us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759692.209536:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00010000:00010000:3.0:1782759692.209596:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759692.209602:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209609:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ce00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759692.209613:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209621:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759692.209628:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759692.209633:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759692.209668:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209674:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759692.209693:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166ce00/0xd5b45c7f5c60d555 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d55c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209717:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759692.209720:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759692.209721:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759692.209738:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759692.209749:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233028736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759692.209780:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759692.209812:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028736 00000100:00100000:3.0:1782759692.209816:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028736 00010000:00010000:3.0:1782759692.209834:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 24 pid: 6525 timeout: 3882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759692.209857:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1782759692.209864:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233028736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759692.209875:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759692.209880:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 24 pid: 6525 timeout: 3882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209889:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 24 pid: 6525 timeout: 3882 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209903:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209917:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209929:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209935:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209941:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209947:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209952:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166da00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759692.209956:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209963:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209971:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.209980:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759692.210008:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233028736:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759692.210014:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1782759692.210061:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233028736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759692.210783:0:156177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d55c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d555 expref: 23 pid: 6525 timeout: 3882 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759692.210794:0:156177:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156177:1869355233028608:0@lo:104: 00010000:00010000:1.0:1782759692.210808:0:156177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.210826:0:156177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.210832:0:156177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759692.210839:0:156177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166da00/0xd5b45c7f5c60d563 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759692.237721:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759693.195174:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233028864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759693.195246:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759693.195686:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028864 00000100:00100000:2.0:1782759693.195695:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028864 00000100:00100000:2.0:1782759693.195770:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3422 00000100:00100000:2.0:1782759693.195782:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233028864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759693.195818:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445859328 avail 1299619840 00000100:00100000:2.0:1782759693.195872:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233028864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759693.195879:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3422 00000100:00100000:2.0:1782759693.195924:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233028864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759693.263752:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759694.102811:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759694.102819:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759694.102824:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759694.102876:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.102889:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.102901:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759694.102929:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233028992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759694.103033:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759694.103083:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759694.103283:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233028992 00000100:00100000:1.0:1782759694.103290:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233028992 00000100:00100000:1.0:1782759694.103338:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:1.0:1782759694.103346:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233028992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759694.103359:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759694.103373:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d56a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.103394:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.103405:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759694.103413:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429e00, rc 0) 00000100:00100000:1.0:1782759694.103450:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233028992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759694.103457:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00000100:00100000:0.0:1782759694.104186:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233028992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759694.104204:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.104214:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759694.104233:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759694.104238:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759694.104246:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759694.218980:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233029376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759694.219072:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759694.219122:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233029888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219235:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233029120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219267:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.219355:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233029632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219380:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.219394:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233030144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219414:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.219434:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759694.219439:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233029248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219460:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.219475:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233029760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219493:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.219505:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233030272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219522:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.219547:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029376 00000100:00100000:3.0:1782759694.219554:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029376 00000100:00100000:3.0:1782759694.219611:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029120 00000100:00100000:3.0:1782759694.219615:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029120 00000100:00100000:3.0:1782759694.219626:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029632 00000100:00100000:3.0:1782759694.219629:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029632 00000100:00100000:3.0:1782759694.219645:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030144 00000100:00100000:3.0:1782759694.219647:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030144 00000100:00100000:3.0:1782759694.219659:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029760 00000100:00100000:3.0:1782759694.219661:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029760 00000100:00100000:3.0:1782759694.219673:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030272 00000100:00100000:3.0:1782759694.219675:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030272 00000100:00100000:3.0:1782759694.219689:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5330 00000100:00100000:3.0:1782759694.219696:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355233029376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219765:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3664:x1869355233029376:12345-0@lo:400:kworker.0 Request processed in 68us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.219771:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5330 00000100:00100000:3.0:1782759694.219790:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5331 00000100:00100000:3.0:1782759694.219796:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355233029120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219827:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1869355233029120:12345-0@lo:400:kworker.0 Request processed in 32us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.219833:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5331 00000100:00100000:3.0:1782759694.219845:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5332 00000100:00100000:3.0:1782759694.219851:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355233029632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219878:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1869355233029632:12345-0@lo:400:kworker.0 Request processed in 27us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.219883:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5332 00000100:00100000:3.0:1782759694.219894:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5333 00000100:00100000:3.0:1782759694.219900:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355233030144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219926:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1869355233030144:12345-0@lo:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.219932:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5333 00000100:00100000:3.0:1782759694.219943:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5334 00000100:00100000:3.0:1782759694.219948:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233029760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.219975:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233029760:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.219980:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5334 00000100:00100000:3.0:1782759694.219994:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5335 00000100:00100000:3.0:1782759694.219999:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233030272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.220045:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233030272:12345-0@lo:400:kworker.0 Request processed in 45us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.220051:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5335 00000100:00100000:3.0:1782759694.220070:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029248 00000100:00100000:3.0:1782759694.220074:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029248 00000100:00100000:3.0:1782759694.220114:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423 00000100:00100000:3.0:1782759694.220120:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233029248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.220152:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233029248:12345-0@lo:400:kworker.0 Request processed in 32us (690us total) trans 0 rc 0/0 00000100:00080000:0.0:1782759694.220283:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759694.220297:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759694.220659:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759694.220694:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233030400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759694.220716:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759694.220752:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233029376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759694.220771:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759694.220778:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233029504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759694.220799:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759694.220810:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233030016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759694.220824:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759694.220831:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233030528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759694.220842:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759694.221439:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029888 00000100:00100000:0.0:1782759694.221446:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029888 00000100:00100000:0.0:1782759694.221497:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030400 00000100:00100000:0.0:1782759694.221500:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030400 00000100:00100000:0.0:1782759694.221513:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030016 00000100:00100000:0.0:1782759694.221516:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030016 00000100:00100000:0.0:1782759694.221540:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030528 00000100:00100000:0.0:1782759694.221542:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030528 00000100:00100000:0.0:1782759694.221558:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3106 00000100:00100000:0.0:1782759694.221565:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233029888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221644:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233029888:12345-0@lo:400:kworker.0 Request processed in 78us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759694.221662:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3106 00000100:00100000:0.0:1782759694.221677:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3107 00000100:00100000:0.0:1782759694.221683:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233030400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221712:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233030400:12345-0@lo:400:kworker.0 Request processed in 30us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759694.221717:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3107 00000100:00100000:0.0:1782759694.221727:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3108 00000100:00100000:0.0:1782759694.221733:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233030016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221757:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233030016:12345-0@lo:400:kworker.0 Request processed in 25us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759694.221762:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3108 00000100:00100000:0.0:1782759694.221773:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3109 00000100:00100000:0.0:1782759694.221779:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233030528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221803:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233030528:12345-0@lo:400:kworker.0 Request processed in 25us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759694.221809:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3109 00000100:00100000:0.0:1782759694.221829:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233029504 00000100:00100000:0.0:1782759694.221832:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233029504 00000100:00100000:0.0:1782759694.221850:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3424 00000100:00100000:0.0:1782759694.221855:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233029504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221885:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233029504:12345-0@lo:400:kworker.0 Request processed in 29us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759694.221891:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3424 00000100:00100000:0.0:1782759694.221927:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233029504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221937:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233030016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221956:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233030528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221967:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233029888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759694.221976:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233030400:0@lo:400:kworker.0 00000100:00080000:1.0:1782759694.222259:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759694.222264:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759694.223148:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423 00000100:00100000:3.0:1782759694.223511:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233029248:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.223538:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233029760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.223551:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233030272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.223564:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233029120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.223574:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233029632:0@lo:400:kworker.0 00000100:00100000:3.0:1782759694.223607:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233030144:0@lo:400:kworker.0 00010000:00010000:2.0:1782759694.283460:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759694.730724:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759694.730746:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233030656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759694.730828:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759694.730874:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030656 00000100:00100000:3.0:1782759694.730882:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030656 00000100:00100000:3.0:1782759694.730939:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2756 00000100:00100000:3.0:1782759694.730958:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233030656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759694.730995:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759694.731053:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233030656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759694.731067:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2756 00000100:00100000:3.0:1782759694.731104:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759694.731110:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233030784:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759694.731356:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233030656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759694.731477:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759694.731690:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030784 00000100:00100000:2.0:1782759694.731694:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030784 00000100:00100000:2.0:1782759694.731733:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2757 00000100:00100000:2.0:1782759694.731742:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233030784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759694.731753:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:2.0:1782759694.731797:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233030784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759694.731803:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2757 00000100:00100000:3.0:1782759694.731834:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233030784:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759695.315996:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759695.754904:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759695.754940:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233030912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759695.755026:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759695.755302:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233031168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759695.755335:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759695.755367:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233030912 00000100:00100000:2.0:1782759695.755375:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233030912 00000100:00100000:2.0:1782759695.755423:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031168 00000100:00100000:2.0:1782759695.755427:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031168 00000100:00100000:2.0:1782759695.755452:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2758 00000100:00100000:2.0:1782759695.755462:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233030912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759695.755493:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759695.755535:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233030912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759695.755542:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2758 00000100:00100000:2.0:1782759695.755559:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2759 00000100:00100000:2.0:1782759695.755567:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233031168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759695.755593:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759695.755622:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233031168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759695.755637:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2759 00000100:00100000:1.0:1782759695.755958:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233030912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759695.755979:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233031040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759695.756007:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759695.756060:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031040 00000100:00100000:1.0:1782759695.756064:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031040 00000100:00100000:1.0:1782759695.757284:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3425 00000100:00100000:1.0:1782759695.757307:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233031040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759695.757342:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:1.0:1782759695.757408:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233031040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759695.757415:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3425 00000100:00100000:1.0:1782759695.757484:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233031040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759695.757674:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233031168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759696.097498:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759696.097544:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759696.097573:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759696.097617:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759696.097638:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759696.097662:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579072 00000100:00100000:3.0:1782759696.097671:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579072 00000100:00100000:3.0:1782759696.097723:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579200 00000100:00100000:3.0:1782759696.097726:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579200 00000100:00080000:1.0:1782759696.097750:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759696.097755:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759696.097764:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5336 00000100:00100000:3.0:1782759696.097775:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218579072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759696.097860:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218579072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 88us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.097868:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5336 00000100:00100000:3.0:1782759696.097885:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5337 00000100:00100000:3.0:1782759696.097891:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218579200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759696.097917:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218579200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.097923:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5337 00000100:00100000:3.0:1782759696.097952:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579328 00000100:00100000:3.0:1782759696.097970:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579328 00000100:00100000:3.0:1782759696.098003:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579456 00000100:00100000:3.0:1782759696.098006:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579456 00000100:00100000:3.0:1782759696.098040:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3110 00000100:00100000:3.0:1782759696.098046:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218579328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759696.098085:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218579328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.098092:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3110 00000100:00100000:3.0:1782759696.098103:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3111 00000100:00100000:3.0:1782759696.098108:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218579456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759696.098129:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218579456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.098135:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3111 00000100:00100000:3.0:1782759696.098150:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218578944 00000100:00100000:3.0:1782759696.098154:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218578944 00000100:00100000:3.0:1782759696.098175:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3316 00000100:00100000:3.0:1782759696.098179:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218578944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759696.098202:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218578944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.098207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3316 00000100:00080000:1.0:1782759696.098392:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759696.098396:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759696.337470:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759696.380326:0:156372:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6b8dd580 20000000:00000080:0.0:1782759696.380341:0:156372:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cddc48a4400 uarg=0000000000000000 20000000:01000000:0.0:1782759696.380379:0:156372:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782759696.380381:0:156372:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782759696.380384:0:156372:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=u' 20000000:01000000:0.0:1782759696.380389:0:156372:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.ost=u' 20000000:01000000:0.0:1782759696.380394:0:156372:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.ost=u' 20000000:01000000:0.0:1782759696.380471:0:156372:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1782759696.380474:0:156372:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 00000040:00080000:3.0:1782759696.398354:0:156373:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000040:00080000:0.0:1782759696.398629:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].59, 224 off18560 00000040:00080000:0.0:1782759696.398649:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].60, 88 off18648 00000040:00080000:0.0:1782759696.398657:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].61, 224 off18872 20000000:01000000:0.0:1782759696.398664:0:156372:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782759696.398666:0:156372:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 00000040:00080000:2.0:1782759696.399319:0:156374:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000040:00080000:0.0:1782759696.399495:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 224 off10728 00000040:00080000:0.0:1782759696.399514:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 88 off10816 00000040:00080000:0.0:1782759696.399546:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11040 20000000:01000000:0.0:1782759696.399557:0:156372:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782759696.399559:0:156372:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 00000040:00080000:2.0:1782759696.400305:0:156375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000040:00080000:0.0:1782759696.400459:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].59, 224 off18560 00000040:00080000:0.0:1782759696.400481:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].60, 88 off18648 00000040:00080000:0.0:1782759696.400498:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].61, 224 off18872 20000000:01000000:0.0:1782759696.400507:0:156372:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782759696.400509:0:156372:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 00000040:00080000:2.0:1782759696.401102:0:156376:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000040:00080000:0.0:1782759696.401257:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10200 00000040:00080000:0.0:1782759696.401278:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 88 off10288 00000040:00080000:0.0:1782759696.401304:0:156372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10512 10000000:01000000:0.0:1782759696.401320:0:156372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782759696.401338:0:156372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401357:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401364:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401372:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401380:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401387:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401393:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401400:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401406:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401412:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401430:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401437:0:156372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401446:0:156372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401485:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401500:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 23 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401514:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031296:0@lo:104: 00000100:00100000:0.0:1782759696.401626:0:156372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759696.401687:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401696:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 23 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401706:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031424:0@lo:104: 00010000:00010000:0.0:1782759696.401732:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401740:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 23 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401761:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031552:0@lo:104: 00010000:00010000:0.0:1782759696.401786:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401795:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 23 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401803:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031680:0@lo:104: 00010000:00010000:0.0:1782759696.401824:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401833:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 23 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401840:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031808:0@lo:104: 00010000:00010000:0.0:1782759696.401862:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401869:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 23 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401875:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031936:0@lo:104: 00010000:00010000:0.0:1782759696.401893:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.401899:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 23 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.401917:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032064:0@lo:104: 00010000:00010000:0.0:1782759696.402235:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.402244:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 23 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.402252:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032192:0@lo:104: 00010000:00010000:0.0:1782759696.402276:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.402283:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 23 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.402290:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032320:0@lo:104: 00010000:00010000:0.0:1782759696.402312:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.402322:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 9 pid: 6526 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.402330:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032448:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759696.402458:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759696.402483:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402504:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402518:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402543:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402551:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402567:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402590:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402599:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031296 00000100:00100000:3.0:1782759696.402605:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031296 00000100:00100000:3.0:1782759696.402641:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:3.0:1782759696.402652:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.402658:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031424 00000100:00100000:3.0:1782759696.402661:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031424 00000100:00100000:3.0:1782759696.402672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031552 00000100:00100000:3.0:1782759696.402674:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031552 00000100:00100000:3.0:1782759696.402682:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031680 00000100:00100000:3.0:1782759696.402684:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031680 00000100:00100000:3.0:1782759696.402692:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031808 00000100:00100000:3.0:1782759696.402694:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031808 00000100:00100000:3.0:1782759696.402701:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233031936 00000100:00100000:3.0:1782759696.402703:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233031936 00000100:00100000:3.0:1782759696.402713:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233032064 00000100:00100000:3.0:1782759696.402715:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233032064 00000100:00100000:3.0:1782759696.402722:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233032192 00000100:00100000:3.0:1782759696.402724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233032192 00000100:00100000:3.0:1782759696.402732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233032320 00000100:00100000:3.0:1782759696.402734:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233032320 00000100:00100000:3.0:1782759696.402745:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782759696.402767:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc5461050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+11:156372:x1869355233031296:12345-0@lo:104: 00010000:00010000:3.0:1782759696.402781:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.402830:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759696.402836:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc5461050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+11:156372:x1869355233031296:12345-0@lo:104: Request processed in 71us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.402842:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:3.0:1782759696.402880:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1782759696.402892:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+10:156372:x1869355233031424:12345-0@lo:104: 00010000:00010000:3.0:1782759696.402900:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.403161:0:156372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.403170:0:156372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.403191:0:156372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032576:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759696.403223:0:156372:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c5ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759696.403245:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031296:0@lo:104: 00000100:00100000:0.0:1782759696.403254:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031424:0@lo:104: 00010000:00010000:3.0:1782759696.403291:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759696.403298:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+10:156372:x1869355233031424:12345-0@lo:104: Request processed in 407us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403304:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:3.0:1782759696.403318:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1782759696.403324:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+9:156372:x1869355233031552:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403332:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403380:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782759696.403385:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+9:156372:x1869355233031552:12345-0@lo:104: Request processed in 62us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403391:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1782759696.403403:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1782759696.403409:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+8:156372:x1869355233031680:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403415:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403441:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782759696.403446:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+8:156372:x1869355233031680:12345-0@lo:104: Request processed in 38us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1782759696.403462:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1782759696.403474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+7:156372:x1869355233031808:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403481:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403509:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782759696.403514:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+7:156372:x1869355233031808:12345-0@lo:104: Request processed in 41us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1782759696.403535:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1782759696.403539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+6:156372:x1869355233031936:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403546:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403568:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1782759696.403573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+6:156372:x1869355233031936:12345-0@lo:104: Request processed in 34us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1782759696.403615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1782759696.403620:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+5:156372:x1869355233032064:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403627:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403651:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1782759696.403655:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+5:156372:x1869355233032064:12345-0@lo:104: Request processed in 36us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403661:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1782759696.403672:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1782759696.403684:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf628050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+4:156372:x1869355233032192:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403691:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403718:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1782759696.403722:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf628050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+4:156372:x1869355233032192:12345-0@lo:104: Request processed in 40us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403728:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1782759696.403751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1782759696.403757:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:156372:x1869355233032320:12345-0@lo:104: 00010000:00010000:3.0:1782759696.403770:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403794:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1782759696.403799:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:156372:x1869355233032320:12345-0@lo:104: Request processed in 43us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.403805:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00010000:00010000:3.0:1782759696.403834:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1782759696.403840:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403846:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.403850:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403857:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.403861:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.403870:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.403893:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403897:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.403912:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.403919:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428600/0xd5b45c7f5c60c381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c388 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405159:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1782759696.405166:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405173:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405175:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405182:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405186:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405189:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405209:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405212:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405237:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405241:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc600/0xd5b45c7f5c60c373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c37a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405250:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1782759696.405252:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405255:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405257:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405260:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405264:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405266:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405274:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405277:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405279:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405283:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60c365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c36c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405287:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1782759696.405293:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405296:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405298:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405302:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405305:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405308:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405314:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405317:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405321:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405324:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428400/0xd5b45c7f5c60c357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c35e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405328:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782759696.405330:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405334:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405335:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405346:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405350:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405352:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405359:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405362:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405364:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405367:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5e00/0xd5b45c7f5c60c349 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c350 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405373:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782759696.405375:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405378:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5429400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405379:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405383:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405388:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405397:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405409:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405414:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405419:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405425:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5429400/0xd5b45c7f5c60c33b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c342 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405433:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782759696.405436:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405442:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405444:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405449:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405453:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405456:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405464:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405467:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405476:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405480:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60c32d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c334 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405485:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759696.405487:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405490:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405492:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405495:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405499:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405501:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405507:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405510:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405512:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405515:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60c31f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c326 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405519:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759696.405525:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405528:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759696.405530:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405534:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759696.405537:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759696.405540:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759696.405546:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405549:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759696.405551:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405554:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5800/0xd5b45c7f5c60c311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60c318 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.405562:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759696.405563:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759696.405565:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759696.405585:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759696.405590:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759696.405612:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233032704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405653:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405678:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405690:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405698:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405709:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405723:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782759696.405726:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405736:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405744:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405754:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405770:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233032832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405784:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405792:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233033344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405803:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405809:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1782759696.405811:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233032960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405820:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405824:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233033472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759696.405833:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759696.405848:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233032704 00000100:00100000:3.0:1782759696.405853:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233032704 00010000:00010000:3.0:1782759696.405873:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 24 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.405885:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033216 00000100:00100000:3.0:1782759696.405886:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033216 00010000:00010000:3.0:1782759696.405891:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 25 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.405903:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033728 00000100:00100000:3.0:1782759696.405904:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033728 00010000:00010000:3.0:1782759696.405910:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 26 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.405915:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033088 00000100:00100000:3.0:1782759696.405917:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033088 00010000:00010000:3.0:1782759696.405924:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 27 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759696.406323:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031552:0@lo:104: 00000100:00100000:0.0:1782759696.406335:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031680:0@lo:104: 00000100:00100000:0.0:1782759696.406342:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031808:0@lo:104: 00000100:00100000:0.0:1782759696.406351:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233031936:0@lo:104: 00000100:00100000:0.0:1782759696.406358:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032064:0@lo:104: 00000100:00100000:0.0:1782759696.406365:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032192:0@lo:104: 00000100:00100000:0.0:1782759696.406372:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032320:0@lo:104: 00000100:00100000:3.0:1782759696.406469:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033600 00000100:00100000:3.0:1782759696.406473:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033600 00010000:00010000:3.0:1782759696.406492:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 28 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.406505:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233032832 00000100:00100000:3.0:1782759696.406508:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233032832 00010000:00010000:3.0:1782759696.406517:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 29 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.406538:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033344 00000100:00100000:3.0:1782759696.406541:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033344 00010000:00010000:3.0:1782759696.406550:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 30 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.406559:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233032960 00000100:00100000:3.0:1782759696.406562:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233032960 00010000:00010000:3.0:1782759696.406570:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 31 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.406860:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033472 00000100:00100000:3.0:1782759696.406872:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033472 00010000:00010000:3.0:1782759696.406887:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 32 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759696.406899:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1782759696.406907:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+32:3663:x1869355233032704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.406921:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.406926:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 32 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407013:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 32 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407032:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60c388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c381 expref: 32 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407045:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759696.407145:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+31:3663:x1869355233032704:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.407153:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1782759696.407169:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1782759696.407175:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+30:3663:x1869355233033216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.407184:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.407188:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 30 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407197:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 30 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407207:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60c350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c349 expref: 30 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407222:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759696.407245:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+29:3663:x1869355233033216:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.407251:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:3.0:1782759696.407263:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1782759696.407268:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+28:3663:x1869355233033728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.407275:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.407279:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 28 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407287:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 28 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407296:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd200/0xd5b45c7f5c60c318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c311 expref: 28 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407302:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759696.407322:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+27:3663:x1869355233033728:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.407327:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1782759696.407337:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1782759696.407342:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+26:3663:x1869355233033088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.407348:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.407352:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 26 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407360:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 26 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407376:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60c35e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c357 expref: 26 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407384:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759696.407408:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+25:3663:x1869355233033088:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.407414:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1782759696.407428:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1782759696.407433:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233033600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.407440:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.407445:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 24 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407452:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 24 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407461:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429600/0xd5b45c7f5c60c326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c31f expref: 24 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407470:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759696.407491:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233033600:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.407498:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:3.0:1782759696.407510:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1782759696.407515:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5716850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+22:3664:x1869355233032832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.407522:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.407538:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 22 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407553:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 22 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407563:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428200/0xd5b45c7f5c60c37a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c373 expref: 22 pid: 6525 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.407571:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759696.412915:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1782759696.412951:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+21:3664:x1869355233033344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759696.412976:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759696.412988:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 21 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.413002:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 21 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.413033:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60c342 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c33b expref: 21 pid: 6524 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.413051:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759696.413308:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5716850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+20:3664:x1869355233032832:12345-0@lo:103:ldlm_bl.0 Request processed in 5790us (7519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.413317:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:3.0:1782759696.413370:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:3.0:1782759696.413379:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+19:3664:x1869355233032960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759696.413387:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759696.413392:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 19 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.413402:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 19 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.413412:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd600/0xd5b45c7f5c60c36c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c365 expref: 19 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759696.413420:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759696.413519:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233032704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759696.413544:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759696.413553:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759696.413592:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759696.413603:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233033600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759696.414266:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+18:3664:x1869355233033344:12345-0@lo:103:ldlm_bl.0 Request processed in 1336us (8457us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759696.414275:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1782759696.414299:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:2.0:1782759696.414316:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+17:3664:x1869355233033472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759696.414327:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759696.414333:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 17 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.414344:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 17 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.414374:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc200/0xd5b45c7f5c60c334 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60c32d expref: 17 pid: 6526 timeout: 3886 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.414384:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759696.414413:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+16:3664:x1869355233033472:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (8577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759696.414419:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:3.0:1782759696.417118:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+15:3664:x1869355233032960:12345-0@lo:103:ldlm_bl.0 Request processed in 3731us (11286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759696.417131:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00100000:1.0:1782759696.417377:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233032832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759696.417393:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233033344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759696.417417:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233032960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759696.417426:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233033472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759696.417488:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032448:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759696.417498:0:156372:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156372:1869355233032576:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759696.417960:0:156372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759696.419983:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759696.420121:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579584 00000100:00100000:2.0:1782759696.420132:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579584 00010000:00010000:2.0:1782759696.420179:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 10 pid: 6526 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759696.420209:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 846 00000100:00100000:2.0:1782759696.420219:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218579584:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759696.420234:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759696.420239:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 10 pid: 6526 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.420249:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 10 pid: 6526 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.420266:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dc800/0xd5b45c7f5c60c30a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27281 expref: 10 pid: 6526 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.420294:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759696.420350:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2402:x1869355218579584:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 132us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759696.420357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 846 00000100:00100000:3.0:1782759696.421898:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759696.422034:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579712 00000100:00100000:2.0:1782759696.422041:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579712 00010000:00010000:2.0:1782759696.422076:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759696.422113:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 847 00000100:00100000:2.0:1782759696.422123:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2403:x1869355218579712:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759696.422136:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759696.422141:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422151:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422167:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60c303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2727a expref: 9 pid: 6525 timeout: 3836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422179:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422187:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422203:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422222:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422229:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422236:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422243:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759696.422247:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422256:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422273:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759696.422287:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759696.422338:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2403:x1869355218579712:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 216us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759696.422346:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 847 00010000:00010000:0.0:1782759696.422799:0:156372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.422809:0:156372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759696.422827:0:156372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d578 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.357484:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759697.630522:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759697.630614:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579840 00000100:00100000:1.0:1782759697.630624:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579840 00000100:00100000:1.0:1782759697.630674:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3317 00000100:00100000:1.0:1782759697.630685:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218579840:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759697.630703:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759697.630723:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275b4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.630761:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.630773:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.630782:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429200, rc 0) 00000100:00100000:1.0:1782759697.630841:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218579840:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 158us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.630849:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3317 00000100:00100000:0.0:1782759697.635212:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759697.635278:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218579968 00000100:00100000:1.0:1782759697.635289:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218579968 00000100:00100000:1.0:1782759697.635343:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3318 00000100:00100000:1.0:1782759697.635353:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218579968:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.635516:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218579968:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 164us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.635525:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3318 00000100:00100000:0.0:1782759697.644160:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759697.644236:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580096 00000100:00100000:3.0:1782759697.644248:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580096 00000100:00100000:3.0:1782759697.644305:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3319 00000100:00100000:3.0:1782759697.644315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218580096:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.644460:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218580096:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 144us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.644468:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3319 00000100:00100000:1.0:1782759697.655212:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759697.656713:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580224 00000100:00100000:0.0:1782759697.656725:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580224 00000100:00100000:0.0:1782759697.656910:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3320 00000100:00100000:0.0:1782759697.656930:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218580224:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759697.656947:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759697.656967:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275bb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.657011:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.657023:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.657032:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166c800, rc 0) 00000100:00100000:0.0:1782759697.657094:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218580224:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 175us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.657101:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3320 00000100:00100000:3.0:1782759697.660016:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759697.660133:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580352 00000100:00100000:1.0:1782759697.660143:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580352 00000100:00100000:1.0:1782759697.660194:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3321 00000100:00100000:1.0:1782759697.660203:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218580352:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.660315:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218580352:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 113us (328us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759697.660324:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3321 10000000:01000000:3.0:1782759697.738645:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759697.738652:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 64 10000000:01000000:3.0:1782759697.738658:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759697.738703:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.738715:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.738727:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759697.738751:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233033856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.738822:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.738936:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.741499:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033856 00000100:00100000:1.0:1782759697.741515:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033856 00000100:00100000:1.0:1782759697.741638:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3322 00000100:00100000:1.0:1782759697.741648:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355233033856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759697.741665:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759697.741682:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d58d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.741709:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.741720:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.741730:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428600, rc 0) 00000100:00100000:1.0:1782759697.741811:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233033856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (2989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.741819:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3322 00000100:00100000:3.0:1782759697.741903:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233033856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759697.741930:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.741941:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759697.742037:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233033984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.742078:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.742315:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.742464:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233033984 00000100:00100000:2.0:1782759697.742470:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233033984 00000100:00100000:2.0:1782759697.742506:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:2.0:1782759697.742514:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233033984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.742685:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233033984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.742703:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00000100:00100000:3.0:1782759697.742792:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233033984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.742826:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.742866:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.742890:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.743016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034112 00000100:00100000:2.0:1782759697.743021:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034112 00000100:00100000:2.0:1782759697.743043:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:2.0:1782759697.743050:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233034112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.743142:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233034112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.743148:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00000100:00100000:3.0:1782759697.743278:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782759697.744314:0:156443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1782759697.744532:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759697.744553:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759697.744564:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.744606:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759697.744617:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782759697.744620:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1782759697.744622:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782759697.744655:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.744664:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.744675:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.744695:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.744761:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.744792:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.744868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034240 00000100:00100000:3.0:1782759697.744874:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034240 00000100:00100000:3.0:1782759697.744904:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:3.0:1782759697.744914:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233034240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759697.745002:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759697.745019:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d59b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.745045:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.745056:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.745064:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5000, rc 0) 00000100:00100000:3.0:1782759697.745171:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233034240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.745184:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:2.0:1782759697.745262:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759697.745276:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.745285:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.745343:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.745440:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.745466:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.745509:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034368 00000100:00100000:3.0:1782759697.745513:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034368 00000100:00100000:3.0:1782759697.745531:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:3.0:1782759697.745537:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233034368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.745915:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233034368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.745932:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:3.0:1782759697.746076:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.746179:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.746220:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.746288:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.746316:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034496 00000100:00100000:1.0:1782759697.746321:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034496 00000100:00100000:1.0:1782759697.746389:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3327 00000100:00100000:1.0:1782759697.746397:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233034496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.746487:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233034496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.746494:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3327 00000100:00100000:3.0:1782759697.746554:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233034496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.746951:0:156444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156444:1869355233034624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759697.746988:0:156444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.747329:0:156444:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.747354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034624 00000100:00100000:2.0:1782759697.747359:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034624 00000100:00100000:0.0:1782759697.747468:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:0.0:1782759697.747479:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:156444:x1869355233034624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759697.747572:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:156444:x1869355233034624:12345-0@lo:502:llog_process_th.0 Request processed in 94us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.747623:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:3.0:1782759697.747770:0:156444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156444:1869355233034624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759697.747797:0:156444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759697.747807:0:156444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759697.747809:0:156444:0:(obd_config.c:1561:class_process_config()) marker 58 (0x1) lustre quota.ost 00000020:00000080:3.0:1782759697.747813:0:156444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00010000:00010000:1.0:1782759697.748280:0:156445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.748291:0:156445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759697.748319:0:156445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156445:1869355233034752:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:1.0:1782759697.748354:0:156445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.748449:0:156445:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.748611:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034752 00000100:00100000:0.0:1782759697.748615:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034752 00000100:00100000:0.0:1782759697.748685:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1782759697.748694:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:156445:x1869355233034752:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759697.748706:0:66654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759697.748719:0:66654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d5b0 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5a9 expref: -99 pid: 66654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782759697.756963:0:66654:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1001:0x0] (8/8) registered 00010000:00010000:0.0:1782759697.757203:0:66654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5a9 expref: 6 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.757219:0:66654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166da00/0xd5b45c7f5c60d5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5a9 expref: 6 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.757230:0:66654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166da00, rc 0) 00000100:00100000:0.0:1782759697.757326:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+6:156445:x1869355233034752:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 8631us (8969us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.757335:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1782759697.757615:0:156445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156445:1869355233034752:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:2.0:1782759697.757638:0:156445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.757648:0:156445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.758434:0:156445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156445:1869355233034880:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759697.758491:0:156445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.758559:0:156445:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00010000:00010000:3.0:1782759697.758696:0:156446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.758709:0:156446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759697.758724:0:156446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156446:1869355233035008:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759697.758756:0:156446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759697.759499:0:156447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.759510:0:156447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759697.759526:0:156447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:156447:1869355233035136:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:1.0:1782759697.759829:0:156448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.759838:0:156448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759697.759852:0:156448:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:156448:1869355233035264:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:1.0:1782759697.759877:0:156448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.759943:0:156444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156444:1869355233035392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759697.759992:0:156444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.760032:0:156444:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.760047:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035392 00000100:00100000:2.0:1782759697.760053:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035392 00000100:00100000:2.0:1782759697.760097:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1782759697.760117:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:156444:x1869355233035392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759697.760231:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:156444:x1869355233035392:12345-0@lo:502:llog_process_th.0 Request processed in 125us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.760239:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1782759697.760299:0:156444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156444:1869355233035392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759697.760324:0:156444:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759697.760330:0:156444:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759697.760333:0:156444:0:(obd_config.c:1561:class_process_config()) marker 58 (0x2) lustre quota.ost 00000040:00080000:2.0:1782759697.760338:0:156444:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 14 count 14 00000100:00100000:0.0:1782759697.760781:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233034880 00000100:00100000:0.0:1782759697.760786:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233034880 00000020:01000000:0.0:1782759697.760809:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-13 (rc=0) 10000000:01000000:0.0:1782759697.760844:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782759697.760853:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.760864:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759697.760881:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782759697.760884:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 64 10000000:01000000:0.0:1782759697.760887:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782759697.760907:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.760927:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.760936:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.760950:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.761276:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.761307:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.761324:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035520 00000100:00100000:0.0:1782759697.761327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035520 00000100:00100000:0.0:1782759697.761358:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:0.0:1782759697.761365:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233035520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759697.761376:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759697.761387:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5cc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.761407:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.761417:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.761436:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166c600, rc 0) 00000100:00100000:0.0:1782759697.761468:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233035520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.761474:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00100000:0.0:1782759697.761512:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759697.761525:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.761533:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.761604:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.761628:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.761646:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.761657:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035648 00000100:00100000:0.0:1782759697.761660:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035648 00000100:00100000:0.0:1782759697.761679:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:0.0:1782759697.761685:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233035648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.761784:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233035648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.761791:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00000100:00100000:0.0:1782759697.761819:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.761844:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.761880:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.761899:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.761911:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035776 00000100:00100000:0.0:1782759697.761914:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035776 00000100:00100000:0.0:1782759697.761946:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3332 00000100:00100000:0.0:1782759697.761953:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233035776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.762206:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233035776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.762214:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3332 00000100:00100000:0.0:1782759697.762254:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759697.763665:0:156449:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1782759697.763739:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1782759697.763759:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759697.763769:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.763779:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759697.763789:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1782759697.763792:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1782759697.763795:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1782759697.763826:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.763834:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.763843:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.763879:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.764246:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.764275:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.764298:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035904 00000100:00100000:0.0:1782759697.764304:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035904 00000100:00100000:0.0:1782759697.764336:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333 00000100:00100000:0.0:1782759697.764345:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233035904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759697.764356:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759697.764367:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5da expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.764389:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.764397:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.764404:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d000, rc 0) 00000100:00100000:0.0:1782759697.764438:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233035904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.764445:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333 00000100:00100000:0.0:1782759697.764485:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233035904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759697.764497:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.764506:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.764561:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.764606:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.764623:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.764634:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036032 00000100:00100000:0.0:1782759697.764637:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036032 00000100:00100000:0.0:1782759697.764656:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334 00000100:00100000:0.0:1782759697.764662:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233036032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.765177:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233036032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 513us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.765186:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334 00000100:00100000:0.0:1782759697.765223:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.765249:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.765291:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.765306:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccde40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.765319:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036160 00000100:00100000:0.0:1782759697.765323:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036160 00000100:00100000:0.0:1782759697.765345:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335 00000100:00100000:0.0:1782759697.765351:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233036160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.765429:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233036160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.765436:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335 00000100:00100000:0.0:1782759697.765479:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.765748:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035008 00000100:00100000:2.0:1782759697.765754:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035008 00000100:00100000:3.0:1782759697.765841:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035264 00000100:00100000:3.0:1782759697.765846:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035264 00000100:00100000:3.0:1782759697.765896:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782759697.765904:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+6:156445:x1869355233034880:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00080000:0.0:1782759697.768101:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759697.768362:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+6:156445:x1869355233034880:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 2454us (9866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.768374:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1782759697.768409:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782759697.768421:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:156446:x1869355233035008:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:3.0:1782759697.768439:0:66654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759697.768458:0:66654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5e00/0xd5b45c7f5c60d5e8 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5b7 expref: -99 pid: 66654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759697.769089:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1782759697.769101:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+5:156448:x1869355233035264:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:1.0:1782759697.769180:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759697.769191:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d5ef lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5c5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1782759697.769456:0:6535:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1003:0x0] (8/8) registered 00010000:00010000:1.0:1782759697.769492:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d5ef lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5c5 expref: 6 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.769510:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428000/0xd5b45c7f5c60d5ef lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5c5 expref: 6 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.769521:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428000, rc 0) 00000100:00100000:1.0:1782759697.769572:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+6:156448:x1869355233035264:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 474us (9694us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.769596:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1782759697.769644:0:156447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.769682:0:156447:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.769694:0:156448:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.769720:0:156448:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:156448:1869355233035264:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:1.0:1782759697.769739:0:156448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.769748:0:156448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.770274:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233035136 00000100:00100000:0.0:1782759697.770283:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233035136 00000100:00100000:0.0:1782759697.770341:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1782759697.770349:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9331850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+5:156447:x1869355233035136:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759697.770360:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759697.770371:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d5f6 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5be expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782759697.770697:0:6535:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1004:0x0] (8/8) registered 00010000:00010000:0.0:1782759697.770727:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d5f6 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5be expref: 6 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.770736:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166ce00/0xd5b45c7f5c60d5f6 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5be expref: 6 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.770744:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166ce00, rc 0) 00000100:00100000:0.0:1782759697.770797:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9331850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+6:156447:x1869355233035136:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 449us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.770804:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:0.0:1782759697.770825:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759697.771665:0:156447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:156447:1869355233035136:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759697.771688:0:156447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.771699:0:156447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1782759697.772248:0:66654:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1002:0x0] (8/8) registered 00010000:00010000:3.0:1782759697.772275:0:66654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5e00/0xd5b45c7f5c60d5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5b7 expref: 6 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.772288:0:66654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5e00/0xd5b45c7f5c60d5e8 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5b7 expref: 6 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.772297:0:66654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5e00, rc 0) 00000100:00100000:3.0:1782759697.772348:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+6:156446:x1869355233035008:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 3931us (13590us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.772356:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1782759697.772508:0:156450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156450:1869355233036288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759697.772562:0:156450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.772607:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036288 00000100:00100000:3.0:1782759697.772613:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036288 00000100:00100000:3.0:1782759697.772654:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:3.0:1782759697.772661:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:156450:x1869355233036288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759697.772754:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:156450:x1869355233036288:12345-0@lo:502:llog_process_th.0 Request processed in 93us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.772762:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:3.0:1782759697.772805:0:156450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.772819:0:156450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156450:1869355233036288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759697.772841:0:156450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759697.772850:0:156450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759697.772853:0:156450:0:(obd_config.c:1561:class_process_config()) marker 56 (0x1) lustre quota.ost 00000020:00000080:3.0:1782759697.772857:0:156450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759697.772878:0:156450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156450:1869355233036416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759697.772909:0:156450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.773284:0:156448:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:156448:1869355233036544:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759697.773360:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036416 00000100:00100000:0.0:1782759697.773370:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036416 00000100:00100000:0.0:1782759697.773399:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1782759697.773406:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:156450:x1869355233036416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759697.773539:0:156445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156445:1869355233034880:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759697.774793:0:156446:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1180 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.774821:0:156446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156446:1869355233035008:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:2.0:1782759697.774845:0:156446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.774857:0:156446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.775510:0:156446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156446:1869355233036672:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759697.775591:0:156450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.777619:0:156447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:156447:1869355233036800:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759697.777692:0:156447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.777732:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036800 00000100:00100000:3.0:1782759697.777739:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036800 00000100:00100000:3.0:1782759697.777791:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1782759697.777800:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:156447:x1869355233036800:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759697.780053:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:156450:x1869355233036416:12345-0@lo:502:llog_process_th.0 Request processed in 6502us (6998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.780069:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3337 00000100:00100000:0.0:1782759697.780501:0:156450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156450:1869355233036416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759697.780536:0:156450:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759697.780543:0:156450:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759697.780545:0:156450:0:(obd_config.c:1561:class_process_config()) marker 56 (0x2) lustre quota.ost 00000040:00080000:0.0:1782759697.780550:0:156450:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 17 count 17 00000100:00100000:2.0:1782759697.781267:0:156446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.781302:0:156446:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.782384:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+6:156447:x1869355233036800:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 4569us (4675us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.782397:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1782759697.782433:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036672 00000100:00100000:3.0:1782759697.782439:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036672 00000100:00100000:3.0:1782759697.782478:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1782759697.782485:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+6:156446:x1869355233036672:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:1.0:1782759697.783092:0:156448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.783114:0:156448:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.783539:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036544 00000100:00100000:0.0:1782759697.783545:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036544 00000100:00100000:0.0:1782759697.783572:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782759697.783602:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+6:156448:x1869355233036544:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759697.787469:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+6:156446:x1869355233036672:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 4974us (6196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.787484:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000020:01000000:3.0:1782759697.787524:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-16 (rc=0) 10000000:01000000:3.0:1782759697.787554:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759697.787566:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.787598:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759697.787609:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759697.787612:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 64 10000000:01000000:3.0:1782759697.787615:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759697.787651:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.787659:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.787669:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759697.787689:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233036928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.787729:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.787775:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.787811:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233036928 00000100:00100000:3.0:1782759697.787819:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233036928 00000100:00100000:3.0:1782759697.787856:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:3.0:1782759697.787865:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233036928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759697.787880:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759697.787892:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d5fd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.787916:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.787926:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.787936:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759697.787964:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233036928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.787970:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000100:00100000:3.0:1782759697.788024:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233036928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759697.788038:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.788047:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759697.788092:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.788119:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.788140:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.788151:0:156447:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.788167:0:156447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0000_UUID:156447:1869355233036800:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759697.789275:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+6:156448:x1869355233036544:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 5671us (6179us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.789286:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1782759697.789484:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037056 00000100:00100000:0.0:1782759697.789491:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037056 00000100:00100000:0.0:1782759697.789520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1782759697.789527:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233037056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.789692:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233037056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.789699:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1782759697.789735:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.789787:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.789829:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.789853:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.789868:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037184 00000100:00100000:0.0:1782759697.789871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037184 00000100:00100000:0.0:1782759697.789891:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00000100:00100000:0.0:1782759697.789897:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233037184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.789970:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233037184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.789977:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00010000:00010000:2.0:1782759697.790760:0:156445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.790771:0:156445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.791530:0:156446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156446:1869355233036672:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759697.794563:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759697.796775:0:156451:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000100:00100000:1.0:1782759697.797189:0:156448:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-OST0001_UUID:156448:1869355233036544:0@lo:403:qsd_reint_0.lus.0 00000020:01000000:2.0:1782759697.797540:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759697.797569:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759697.797608:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.797619:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759697.797629:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1782759697.797632:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 59 10000000:01000000:2.0:1782759697.797635:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1782759697.797666:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.797675:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.797684:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.797705:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.797773:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.797810:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.803648:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037312 00000100:00100000:2.0:1782759697.803661:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037312 00000100:00100000:2.0:1782759697.803733:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:2.0:1782759697.803744:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233037312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759697.803761:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759697.803780:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d60b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.803808:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.803819:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.803828:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766400, rc 0) 00000100:00100000:2.0:1782759697.803896:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233037312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (6122us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.803904:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:2.0:1782759697.803956:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759697.803973:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.804061:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.804144:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.804185:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.804214:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.804319:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037440 00000100:00100000:1.0:1782759697.804324:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037440 00000100:00100000:1.0:1782759697.804350:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3342 00000100:00100000:1.0:1782759697.804356:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233037440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.804556:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233037440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.804564:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3342 00000100:00100000:1.0:1782759697.804615:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.804641:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.804676:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.804689:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.804700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037568 00000100:00100000:1.0:1782759697.804703:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037568 00000100:00100000:1.0:1782759697.804723:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343 00000100:00100000:1.0:1782759697.804728:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233037568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759697.804800:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233037568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.804807:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343 00000100:00100000:1.0:1782759697.804843:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037568:0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1782759697.805267:0:156446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.805278:0:156446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759697.807814:0:156452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156452:1869355233037696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759697.807887:0:156452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759697.807968:0:156452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6600 going to sleep for 11 seconds 00010000:00010000:0.0:1782759697.809506:0:156447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.809521:0:156447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.811896:0:156448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.811913:0:156448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.814531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037696 00000100:00100000:2.0:1782759697.814543:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037696 00000100:00100000:2.0:1782759697.814619:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344 00000100:00100000:2.0:1782759697.814631:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:156452:x1869355233037696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759697.814798:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:156452:x1869355233037696:12345-0@lo:502:llog_process_th.0 Request processed in 169us (6910us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.814804:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344 00000100:00100000:0.0:1782759697.815967:0:156452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156452:1869355233037696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759697.816021:0:156452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759697.816032:0:156452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759697.816034:0:156452:0:(obd_config.c:1561:class_process_config()) marker 55 (0x1) lustre quota.ost 00000020:00000080:0.0:1782759697.816039:0:156452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782759697.816074:0:156452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156452:1869355233037824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759697.816129:0:156452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.816160:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037824 00000100:00100000:0.0:1782759697.816171:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037824 00000100:00100000:0.0:1782759697.816204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00000100:00100000:0.0:1782759697.816211:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:156452:x1869355233037824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759697.816293:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:156452:x1869355233037824:12345-0@lo:502:llog_process_th.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.816301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00000100:00100000:0.0:1782759697.816341:0:156452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.816354:0:156452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156452:1869355233037824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759697.816687:0:156452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759697.816707:0:156452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759697.816709:0:156452:0:(obd_config.c:1561:class_process_config()) marker 55 (0x2) lustre quota.ost 00000040:00080000:0.0:1782759697.816714:0:156452:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 62 count 61 00000020:01000000:2.0:1782759697.819839:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 59-61 (rc=0) 10000000:01000000:2.0:1782759697.819890:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782759697.819902:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.819914:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759697.820048:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759697.820052:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 64 10000000:01000000:2.0:1782759697.820055:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759697.820091:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.820111:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.820123:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.820147:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.820210:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.820283:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.820482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233037952 00000100:00100000:1.0:1782759697.820495:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233037952 00000100:00100000:1.0:1782759697.820603:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:1.0:1782759697.820613:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233037952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759697.820629:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759697.820640:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d619 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.820664:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.820674:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 22 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759697.820683:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759697.820725:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233037952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.820733:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:2.0:1782759697.820814:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233037952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759697.820829:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.820838:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.820894:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.820931:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.821924:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.822108:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038080 00000100:00100000:3.0:1782759697.822115:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038080 00000100:00100000:3.0:1782759697.822148:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3347 00000100:00100000:3.0:1782759697.822156:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233038080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.822299:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233038080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.822307:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3347 00000100:00100000:2.0:1782759697.822467:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.822503:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.822546:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.822560:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759697.822573:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038208 00000100:00100000:2.0:1782759697.822593:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038208 00000100:00100000:2.0:1782759697.822624:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:2.0:1782759697.822630:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233038208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.822702:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233038208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759697.822708:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00100000:2.0:1782759697.822743:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759697.824162:0:156453:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1782759697.824246:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759697.824270:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759697.824282:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.824294:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759697.824304:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782759697.824306:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 59 10000000:01000000:2.0:1782759697.824309:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759697.824341:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.824349:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.824361:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.825500:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.825618:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.825643:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.826144:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038336 00000100:00100000:3.0:1782759697.826153:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038336 00000100:00100000:3.0:1782759697.826194:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:3.0:1782759697.826203:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233038336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759697.826219:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759697.826234:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d627 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.826260:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.826271:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.826281:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:3.0:1782759697.826330:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233038336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.826338:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:2.0:1782759697.826623:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759697.826640:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759697.826650:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759697.826717:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.826748:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.826781:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.828331:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038464 00000100:00100000:3.0:1782759697.828340:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038464 00000100:00100000:3.0:1782759697.828387:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:3.0:1782759697.828397:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233038464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.828545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233038464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.828553:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00000100:00100000:2.0:1782759697.829101:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.829148:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.829199:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.829222:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.829681:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038592 00000100:00100000:3.0:1782759697.829687:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038592 00000100:00100000:3.0:1782759697.829724:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:3.0:1782759697.829731:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233038592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759697.829826:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233038592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.829834:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00100000:3.0:1782759697.829877:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759697.831563:0:156454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156454:1869355233038720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759697.831652:0:156454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759697.831687:0:156454:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdefc494840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759697.831746:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038720 00000100:00100000:1.0:1782759697.831752:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038720 00000100:00100000:1.0:1782759697.832221:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3352 00000100:00100000:1.0:1782759697.832232:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:156454:x1869355233038720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759697.832358:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:156454:x1869355233038720:12345-0@lo:502:llog_process_th.0 Request processed in 127us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759697.832366:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3352 00000100:00100000:3.0:1782759697.832445:0:156454:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156454:1869355233038720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759697.832470:0:156454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759697.832480:0:156454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759697.832482:0:156454:0:(obd_config.c:1561:class_process_config()) marker 57 (0x1) lustre quota.ost 00000020:00000080:3.0:1782759697.832487:0:156454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759697.832511:0:156454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156454:1869355233038848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759697.832544:0:156454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759697.834606:0:156454:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.834703:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038848 00000100:00100000:0.0:1782759697.834711:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038848 00000100:00100000:0.0:1782759697.834754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:0.0:1782759697.834762:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:156454:x1869355233038848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759697.834908:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:156454:x1869355233038848:12345-0@lo:502:llog_process_th.0 Request processed in 146us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759697.834916:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:3.0:1782759697.835068:0:156454:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156454:1869355233038848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759697.835097:0:156454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759697.835105:0:156454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759697.835113:0:156454:0:(obd_config.c:1561:class_process_config()) marker 57 (0x2) lustre quota.ost 00000040:00080000:3.0:1782759697.835117:0:156454:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 62 count 61 00000020:01000000:0.0:1782759697.835292:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 59-61 (rc=0) 10000000:01000000:0.0:1782759697.835318:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1782759697.835329:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.835340:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759697.835350:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1782759697.835358:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759697.835361:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782759697.835388:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.835397:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.835407:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.835425:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.835461:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.835489:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759697.835529:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233038976 00000100:00100000:3.0:1782759697.835534:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233038976 00000100:00100000:3.0:1782759697.835554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:3.0:1782759697.835560:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233038976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759697.835568:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759697.835607:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d635 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.835629:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.835639:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759697.835649:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759697.835690:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233038976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759697.835697:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:0.0:1782759697.835972:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233038976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759697.835984:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.836002:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759697.836050:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233039104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.836075:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759697.836094:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759697.836106:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039104 00000100:00100000:0.0:1782759697.836109:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039104 00000100:00100000:0.0:1782759697.836127:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:0.0:1782759697.836133:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233039104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759697.836197:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233039104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (120us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759697.836210:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000100:00100000:0.0:1782759697.836232:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233039104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1782759697.836251:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782759697.836257:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759697.836264:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759698.314792:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233039232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759698.314878:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759698.315019:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039232 00000100:00100000:2.0:1782759698.315028:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039232 00000100:00100000:2.0:1782759698.315095:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3426 00000100:00100000:2.0:1782759698.315114:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233039232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759698.315147:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445687296 avail 1299447808 00000100:00100000:2.0:1782759698.315196:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233039232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759698.315212:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3426 00000100:00100000:2.0:1782759698.315256:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233039232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759698.378801:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759699.340530:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233039360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340630:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340678:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233039872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340707:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340724:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233040384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340749:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340767:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233040896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340790:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340820:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782759699.340827:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233039744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340851:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340869:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233040256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340891:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340906:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233040768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.340925:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.340965:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233039488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341001:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.341018:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233040000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341037:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.341051:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233040512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341068:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.341083:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759699.341089:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233039616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341109:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.341127:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233040128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341147:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.341163:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233040640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341183:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759699.341217:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039360 00000100:00100000:0.0:1782759699.341224:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039360 00000100:00100000:0.0:1782759699.341273:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1782759699.341282:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233039360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341337:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233039360:12345-0@lo:400:kworker.0 Request processed in 56us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.341345:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1782759699.341376:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040384 00000100:00100000:0.0:1782759699.341380:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040384 00000100:00100000:0.0:1782759699.341414:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040896 00000100:00100000:0.0:1782759699.341417:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040896 00000100:00100000:0.0:1782759699.341429:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040256 00000100:00100000:0.0:1782759699.341431:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040256 00000100:00100000:0.0:1782759699.341442:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040768 00000100:00100000:0.0:1782759699.341451:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040768 00000100:00100000:0.0:1782759699.341470:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3112 00000100:00100000:0.0:1782759699.341476:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233040384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341511:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233040384:12345-0@lo:400:kworker.0 Request processed in 35us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.341517:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3112 00000100:00100000:0.0:1782759699.341530:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3113 00000100:00100000:0.0:1782759699.341537:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233040896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341564:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233040896:12345-0@lo:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.341570:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3113 00000100:00100000:0.0:1782759699.341754:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3114 00000100:00100000:0.0:1782759699.341761:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233040256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341791:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233040256:12345-0@lo:400:kworker.0 Request processed in 30us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.341796:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3114 00000100:00100000:0.0:1782759699.341808:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3115 00000100:00100000:0.0:1782759699.341814:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233040768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.341839:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233040768:12345-0@lo:400:kworker.0 Request processed in 26us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.341844:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3115 00000100:00100000:0.0:1782759699.341862:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039744 00000100:00100000:0.0:1782759699.341866:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039744 00000100:00100000:0.0:1782759699.341883:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039488 00000100:00100000:0.0:1782759699.341886:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039488 00000100:00100000:0.0:1782759699.341894:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040000 00000100:00100000:0.0:1782759699.341896:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040000 00000100:00100000:0.0:1782759699.341916:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040512 00000100:00100000:0.0:1782759699.341918:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040512 00000100:00100000:0.0:1782759699.341928:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040128 00000100:00100000:0.0:1782759699.341930:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040128 00000100:00100000:0.0:1782759699.341940:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233040640 00000100:00100000:0.0:1782759699.341942:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233040640 00000100:00100000:0.0:1782759699.341953:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5338 00000100:00100000:0.0:1782759699.341958:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+6:3665:x1869355233039744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342002:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+6:3665:x1869355233039744:12345-0@lo:400:kworker.0 Request processed in 43us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342008:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5338 00000100:00100000:0.0:1782759699.342020:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5339 00000100:00100000:0.0:1782759699.342025:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+6:3662:x1869355233039488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342058:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+6:3662:x1869355233039488:12345-0@lo:400:kworker.0 Request processed in 33us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342064:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5339 00000100:00100000:0.0:1782759699.342076:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5340 00000100:00100000:0.0:1782759699.342082:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233040000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342108:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233040000:12345-0@lo:400:kworker.0 Request processed in 27us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342113:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5340 00000100:00100000:0.0:1782759699.342125:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5341 00000100:00100000:0.0:1782759699.342131:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233040512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342157:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233040512:12345-0@lo:400:kworker.0 Request processed in 26us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342162:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5341 00000100:00100000:0.0:1782759699.342173:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5342 00000100:00100000:0.0:1782759699.342185:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233040128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342214:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233040128:12345-0@lo:400:kworker.0 Request processed in 30us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342220:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5342 00000100:00100000:0.0:1782759699.342233:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5343 00000100:00100000:0.0:1782759699.342240:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233040640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342266:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233040640:12345-0@lo:400:kworker.0 Request processed in 27us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342272:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5343 00000100:00100000:0.0:1782759699.342295:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039872 00000100:00100000:0.0:1782759699.342299:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039872 00000100:00100000:0.0:1782759699.342333:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233039616 00000100:00100000:0.0:1782759699.342337:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233039616 00000100:00100000:0.0:1782759699.342349:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3427 00000100:00100000:0.0:1782759699.342355:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233039872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342388:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233039872:12345-0@lo:400:kworker.0 Request processed in 33us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342394:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3427 00000100:00100000:0.0:1782759699.342405:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428 00000100:00100000:0.0:1782759699.342412:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233039616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342438:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233039616:12345-0@lo:400:kworker.0 Request processed in 27us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759699.342444:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428 00000100:00080000:0.0:1782759699.342460:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759699.342464:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759699.342466:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759699.342469:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759699.342508:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233039616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342522:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233040128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342530:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233040640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342541:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233039488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342551:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233040000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342559:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233040512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342626:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233039744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342637:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233040256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342648:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233040768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342658:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233039360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342668:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233039872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342679:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233040384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759699.342690:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233040896:0@lo:400:kworker.0 00010000:00010000:0.0:1782759699.414324:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759699.851084:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233041024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759699.851170:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759699.851282:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041024 00000100:00100000:3.0:1782759699.851290:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041024 00000100:00100000:3.0:1782759699.851341:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2760 00000100:00100000:3.0:1782759699.851350:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233041024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759699.851379:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759699.851434:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233041024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759699.851441:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2760 00000100:00100000:0.0:1782759699.851513:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233041024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759699.851729:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759699.851749:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233041152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759699.851776:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759699.852713:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041152 00000100:00100000:3.0:1782759699.852733:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041152 00000100:00100000:3.0:1782759699.852778:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2761 00000100:00100000:3.0:1782759699.852787:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233041152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759699.852805:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759699.852863:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233041152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759699.852870:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2761 00000100:00100000:1.0:1782759699.852959:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233041152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759700.430249:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759700.876562:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233041280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759700.876659:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759700.876720:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759700.876727:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233041408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759700.876751:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759700.876779:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233041536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759700.876798:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759700.876827:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041280 00000100:00100000:1.0:1782759700.876834:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041280 00000100:00100000:1.0:1782759700.876872:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041536 00000100:00100000:1.0:1782759700.876875:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041536 00000100:00100000:1.0:1782759700.876905:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2762 00000100:00100000:1.0:1782759700.876913:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233041280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759700.876943:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759700.877075:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233041280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 162us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759700.877083:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2762 00000100:00100000:1.0:1782759700.877100:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2763 00000100:00100000:1.0:1782759700.877106:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233041536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759700.877115:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759700.877140:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233041536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759700.877154:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2763 00000100:00100000:1.0:1782759700.877171:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041408 00000100:00100000:1.0:1782759700.877175:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041408 00000100:00100000:1.0:1782759700.877212:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3429 00000100:00100000:1.0:1782759700.877217:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233041408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759700.877240:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:1.0:1782759700.877271:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233041408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759700.877276:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3429 00000100:00100000:1.0:1782759700.877321:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233041408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759700.877335:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233041280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759700.879065:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233041536:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1782759701.032678:0:156629:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcba49bf60 20000000:00000080:0.0:1782759701.032697:0:156629:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cdedf628800 uarg=0000000000000000 20000000:01000000:0.0:1782759701.032742:0:156629:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782759701.032744:0:156629:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782759701.032747:0:156629:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.mdt=u' 20000000:01000000:0.0:1782759701.032752:0:156629:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.mdt=u' 20000000:01000000:0.0:1782759701.032763:0:156629:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.mdt=u' 20000000:01000000:0.0:1782759701.032824:0:156629:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1782759701.032827:0:156629:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/quota.mdt fl=4 00000040:00080000:2.0:1782759701.033386:0:156630:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 62 count 61 00000040:00080000:0.0:1782759701.033927:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].62, 224 off19096 00000040:00080000:0.0:1782759701.033980:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].63, 88 off19184 00000040:00080000:0.0:1782759701.033999:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].64, 224 off19408 20000000:01000000:0.0:1782759701.034008:0:156629:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782759701.034010:0:156629:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.mdt fl=4 00000040:00080000:2.0:1782759701.034376:0:156631:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 17 count 17 00000040:00080000:0.0:1782759701.034559:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11264 00000040:00080000:0.0:1782759701.034614:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 88 off11352 00000040:00080000:0.0:1782759701.034635:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11576 20000000:01000000:0.0:1782759701.034646:0:156629:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782759701.034647:0:156629:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.mdt fl=4 00000040:00080000:3.0:1782759701.035416:0:156632:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 62 count 61 00000040:00080000:0.0:1782759701.035735:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].62, 224 off19096 00000040:00080000:0.0:1782759701.035763:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].63, 88 off19184 00000040:00080000:0.0:1782759701.035779:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].64, 224 off19408 20000000:01000000:0.0:1782759701.035788:0:156629:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1782759701.035790:0:156629:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.mdt fl=4 00000040:00080000:3.0:1782759701.036132:0:156633:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 14 count 14 00000040:00080000:0.0:1782759701.036262:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 224 off10736 00000040:00080000:0.0:1782759701.036282:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 88 off10824 00000040:00080000:0.0:1782759701.036299:0:156629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11048 10000000:01000000:0.0:1782759701.036313:0:156629:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782759701.036333:0:156629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036351:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036359:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036368:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036393:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036401:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036408:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036415:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036423:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036429:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036435:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036442:0:156629:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036450:0:156629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036494:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036706:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 23 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.036726:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233041664:0@lo:104: 00000100:00100000:0.0:1782759701.036807:0:156629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759701.036915:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.036924:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 23 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.036933:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233041792:0@lo:104: 00000100:00100000:0.0:1782759701.036973:0:156629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759701.037232:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.037240:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 23 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.037248:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233041920:0@lo:104: 00000100:00100000:0.0:1782759701.037270:0:156629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.037319:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041664 00000100:00100000:3.0:1782759701.037326:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041664 00000100:00100000:3.0:1782759701.037410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041792 00000100:00100000:3.0:1782759701.037413:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041792 00010000:00010000:0.0:1782759701.037528:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.037537:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 23 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.037544:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233042048:0@lo:104: 00000100:00100000:0.0:1782759701.037658:0:156629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759701.037689:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233041920 00000100:00100000:2.0:1782759701.037693:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233041920 00000100:00100000:2.0:1782759701.037725:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1782759701.037735:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+5:156629:x1869355233041664:12345-0@lo:104: 00010000:00010000:2.0:1782759701.037747:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.037795:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759701.037801:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+5:156629:x1869355233041664:12345-0@lo:104: Request processed in 69us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.037807:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:2.0:1782759701.037823:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1782759701.037829:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+4:156629:x1869355233041792:12345-0@lo:104: 00010000:00010000:2.0:1782759701.037836:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.037865:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759701.037869:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+4:156629:x1869355233041792:12345-0@lo:104: Request processed in 42us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.037875:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1782759701.037885:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1782759701.037912:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:156629:x1869355233041920:12345-0@lo:104: 00010000:00010000:2.0:1782759701.037920:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.037961:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782759701.037965:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:156629:x1869355233041920:12345-0@lo:104: Request processed in 56us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.037979:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00010000:00010000:2.0:1782759701.037996:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782759701.038001:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038008:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759701.038011:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038018:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759701.038024:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759701.038030:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759701.038055:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038061:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759701.038078:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038095:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc200/0xd5b45c7f5c60d635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d63c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038106:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759701.038109:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038114:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759701.038117:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038124:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759701.038130:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759701.038134:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759701.038147:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038152:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759701.038167:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038172:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d62e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038180:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759701.038187:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038193:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759701.038195:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038202:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759701.038207:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759701.038211:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759701.038222:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038228:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759701.038233:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038239:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb767600/0xd5b45c7f5c60d619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d620 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.038247:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759701.038249:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759701.038250:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759701.038257:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759701.038262:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759701.038620:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233042176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759701.038657:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759701.038705:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233042432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759701.038730:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759701.038749:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759701.038755:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233042304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759701.038772:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759701.038794:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042176 00000100:00100000:1.0:1782759701.038798:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042176 00010000:00010000:1.0:1782759701.038818:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 24 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759701.038837:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042432 00000100:00100000:1.0:1782759701.038846:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042432 00010000:00010000:1.0:1782759701.038857:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 25 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759701.038870:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042304 00000100:00100000:1.0:1782759701.038872:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042304 00010000:00010000:1.0:1782759701.038879:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 26 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759701.038908:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1782759701.038914:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+26:3663:x1869355233042176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759701.038925:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759701.038930:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 26 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.038939:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 26 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.039060:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759701.039090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+26:3663:x1869355233042176:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759701.039097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1782759701.039111:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1782759701.039116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5716c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355233042432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759701.039123:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759701.039127:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 25 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.039135:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 25 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.039154:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759701.039179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5716c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355233042432:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759701.039186:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1782759701.039221:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1782759701.039227:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233042304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759701.039234:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759701.039238:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 24 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.039246:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 24 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.039253:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759701.039272:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233042304:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759701.039276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:1.0:1782759701.039311:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233042176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759701.039332:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233042304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759701.039338:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233042432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759701.041615:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.041634:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 23 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.041649:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233042560:0@lo:104: 00000100:00100000:0.0:1782759701.041700:0:156629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759701.042640:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.042652:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 23 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.042662:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233042688:0@lo:104: 00000100:00100000:0.0:1782759701.042708:0:156629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759701.042856:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042048 00000100:00100000:2.0:1782759701.042864:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042048 00000100:00100000:2.0:1782759701.043081:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042560 00000100:00100000:2.0:1782759701.043085:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042560 00000100:00100000:3.0:1782759701.046470:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1782759701.046496:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+4:156629:x1869355233042048:12345-0@lo:104: 00010000:00010000:3.0:1782759701.046525:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046630:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759701.046636:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+4:156629:x1869355233042048:12345-0@lo:104: Request processed in 153us (9060us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.046642:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1782759701.046669:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1782759701.046674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:156629:x1869355233042560:12345-0@lo:104: 00010000:00010000:3.0:1782759701.046682:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046712:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759701.046731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:156629:x1869355233042560:12345-0@lo:104: Request processed in 58us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.046737:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00010000:00010000:3.0:1782759701.046761:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759701.046767:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046774:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759701.046779:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046787:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759701.046794:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759701.046800:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759701.046835:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046841:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759701.046862:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046868:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766200/0xd5b45c7f5c60d60b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d612 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.046882:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759701.046885:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047071:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759701.047074:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047081:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759701.047087:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759701.047092:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759701.047106:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047111:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759701.047117:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047124:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d5fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d604 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047133:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759701.047135:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759701.047136:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759701.047150:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233042816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.047186:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.047219:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759701.047224:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233042944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.047254:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.047282:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042816 00000100:00100000:3.0:1782759701.047288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042816 00010000:00010000:3.0:1782759701.047313:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 24 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759701.047335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042944 00000100:00100000:3.0:1782759701.047338:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042944 00010000:00010000:3.0:1782759701.047349:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 25 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759701.047367:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1782759701.047373:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+25:3662:x1869355233042816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.047384:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759701.047388:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 25 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047398:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 25 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047415:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759701.047442:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+25:3662:x1869355233042816:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.047448:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1782759701.047461:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1782759701.047467:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233042944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.047474:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759701.047479:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 24 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047498:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 24 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.047507:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759701.047528:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233042944:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.047534:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1782759701.047599:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233042944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.047610:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233042816:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.047629:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759701.047736:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.047747:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 23 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.047755:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043072:0@lo:104: 00010000:00010000:0.0:1782759701.047784:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.047791:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 23 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.047809:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043200:0@lo:104: 00010000:00010000:0.0:1782759701.047832:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.047839:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 23 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.047846:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043328:0@lo:104: 00010000:00010000:0.0:1782759701.047876:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.047885:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 9 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.047910:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043456:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759701.048008:0:156629:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759701.048017:0:156629:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.048025:0:156629:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043584:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759701.048048:0:156629:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00010000:00010000:0.0:1782759701.048063:0:156629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4200/0xd5b45c7f5c60d63c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d635 expref: 23 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.048073:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233041664:0@lo:104: 00010000:00010000:0.0:1782759701.048092:0:156629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60d62e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d627 expref: 22 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.048101:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233041792:0@lo:104: 00010000:00010000:0.0:1782759701.048109:0:156629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429c00/0xd5b45c7f5c60d620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d619 expref: 21 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.048118:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233041920:0@lo:104: 00010000:00010000:0.0:1782759701.048127:0:156629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb766400/0xd5b45c7f5c60d612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d60b expref: 20 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.048134:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233042048:0@lo:104: 00010000:00010000:0.0:1782759701.048142:0:156629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5fd expref: 19 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759701.048148:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233042560:0@lo:104: 00000100:00100000:3.0:1782759701.048261:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759701.048281:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.048307:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.048316:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.048323:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233042688 00000100:00100000:3.0:1782759701.048327:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233042688 00000100:00100000:3.0:1782759701.048348:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233043072 00000100:00100000:3.0:1782759701.048350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233043072 00000100:00100000:3.0:1782759701.048359:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233043200 00000100:00100000:3.0:1782759701.048360:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233043200 00000100:00100000:3.0:1782759701.048369:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233043328 00000100:00100000:3.0:1782759701.048371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233043328 00000100:00100000:3.0:1782759701.048382:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1782759701.048388:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf628c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:156629:x1869355233042688:12345-0@lo:104: 00010000:00010000:3.0:1782759701.048397:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048435:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759701.048446:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf628c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:156629:x1869355233042688:12345-0@lo:104: Request processed in 59us (5739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.048453:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1782759701.048486:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1782759701.048493:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:156629:x1869355233043072:12345-0@lo:104: 00010000:00010000:3.0:1782759701.048501:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048531:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782759701.048536:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:156629:x1869355233043072:12345-0@lo:104: Request processed in 45us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.048542:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1782759701.048553:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1782759701.048558:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:156629:x1869355233043200:12345-0@lo:104: 00010000:00010000:3.0:1782759701.048565:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048617:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782759701.048622:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:156629:x1869355233043200:12345-0@lo:104: Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.048628:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1782759701.048640:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1782759701.048647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:156629:x1869355233043328:12345-0@lo:104: 00010000:00010000:3.0:1782759701.048654:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048679:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782759701.048689:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:156629:x1869355233043328:12345-0@lo:104: Request processed in 44us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.048695:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00010000:00010000:3.0:1782759701.048711:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782759701.048716:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048723:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759701.048726:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048734:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759701.048741:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759701.048748:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759701.048773:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048779:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759701.048798:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048804:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166d800/0xd5b45c7f5c60d5da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5e1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048816:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782759701.048819:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048837:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759701.048840:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048847:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759701.048852:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759701.048857:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759701.048870:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048876:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759701.048881:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048888:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166c400/0xd5b45c7f5c60d5cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5d3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048898:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782759701.048901:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048906:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759701.048909:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.048926:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759701.048932:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759701.048937:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759701.049541:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049549:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759701.049566:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049573:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766600/0xd5b45c7f5c60d59b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d5a2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049604:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759701.049607:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049613:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759701.049616:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049622:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759701.049629:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759701.049641:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782759701.049656:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049661:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759701.049667:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049674:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d58d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d594 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.049687:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759701.049689:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759701.049691:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759701.049705:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233043712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.049749:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.049776:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759701.049782:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233043840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.049801:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.049831:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233043712 00000100:00100000:3.0:1782759701.049836:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233043712 00010000:00010000:3.0:1782759701.049857:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 19 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759701.049879:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233043840 00000100:00100000:3.0:1782759701.049881:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233043840 00000100:00100000:0.0:1782759701.050056:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233042688:0@lo:104: 00000100:00100000:0.0:1782759701.050068:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043072:0@lo:104: 00000100:00100000:0.0:1782759701.050076:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043200:0@lo:104: 00000100:00100000:0.0:1782759701.050084:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043328:0@lo:104: 00010000:00010000:3.0:1782759701.052138:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 20 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759701.052217:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1782759701.052232:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+20:3664:x1869355233043712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.052248:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759701.052254:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 20 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052267:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 20 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052285:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166d000/0xd5b45c7f5c60d5e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5da expref: 20 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052300:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759701.052373:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+19:3664:x1869355233043712:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.052380:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1782759701.052398:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1782759701.052405:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+18:3664:x1869355233043840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.052413:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759701.052418:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 18 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052426:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 18 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052435:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c600/0xd5b45c7f5c60d5d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d5cc expref: 18 pid: 6526 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052455:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759701.052479:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+17:3664:x1869355233043840:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.052486:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1782759701.052523:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233044096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.052558:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.052606:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759701.052613:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233043968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.052637:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759701.052661:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044096 00000100:00100000:3.0:1782759701.052668:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044096 00010000:00010000:3.0:1782759701.052685:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 17 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759701.052703:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233043968 00000100:00100000:3.0:1782759701.052706:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233043968 00010000:00010000:3.0:1782759701.052716:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 18 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759701.052730:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1782759701.052735:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+18:3663:x1869355233044096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.052742:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759701.052746:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 18 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052754:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 18 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052776:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428600/0xd5b45c7f5c60d594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d58d expref: 18 pid: 6525 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052784:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759701.052810:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+17:3663:x1869355233044096:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.052816:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1782759701.052829:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1782759701.052835:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5714050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+16:3663:x1869355233043968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759701.052842:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759701.052846:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 16 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052854:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 16 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052863:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de5000/0xd5b45c7f5c60d5a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d59b expref: 16 pid: 6524 timeout: 3891 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759701.052872:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759701.054786:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5714050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+15:3663:x1869355233043968:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759701.054807:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00010000:00010000:3.0:1782759701.054878:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759701.054938:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233043840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759701.055134:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759701.055169:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233043712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.055200:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233043968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759701.055224:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233044096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759701.064635:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759701.065115:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043456:192.168.202.31@tcp:104: 00000100:00100000:2.0:1782759701.065129:0:156629:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156629:1869355233043584:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759701.065196:0:156629:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759701.065247:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759701.065318:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580480 00000100:00100000:2.0:1782759701.065326:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580480 00010000:00010000:2.0:1782759701.065369:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 10 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759701.065402:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580608 00000100:00100000:2.0:1782759701.065406:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580608 00010000:00010000:2.0:1782759701.065419:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 11 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759701.065442:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 857 00000100:00100000:2.0:1782759701.065452:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+11:2402:x1869355218580480:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759701.065465:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759701.065471:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 11 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065482:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 11 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065501:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdec166c800/0xd5b45c7f5c60d586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275bb expref: 11 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065535:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759701.065604:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218580480:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 153us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.065613:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 857 00000100:00100000:2.0:1782759701.065630:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 858 00000100:00100000:2.0:1782759701.065638:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2402:x1869355218580608:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759701.065646:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759701.065650:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065659:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065669:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429200/0xd5b45c7f5c60d57f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275b4 expref: 9 pid: 6525 timeout: 3841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065679:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065687:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065701:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065708:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065724:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065731:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065738:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759701.065742:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065751:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065765:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759701.065775:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759701.065796:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2402:x1869355218580608:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 159us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.065802:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 858 00010000:00010000:1.0:1782759701.066649:0:156629:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.066659:0:156629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759701.066674:0:156629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dd400/0xd5b45c7f5c60d643 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759701.223656:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759701.225376:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759701.225407:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759701.232333:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759701.232370:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580992 00000100:00100000:2.0:1782759701.232381:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580992 00000100:00100000:2.0:1782759701.232440:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581120 00000100:00100000:2.0:1782759701.232443:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581120 00000100:00100000:2.0:1782759701.232468:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3116 00000100:00100000:2.0:1782759701.232494:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218580992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759701.232570:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218580992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (7200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.232602:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3116 00000100:00100000:2.0:1782759701.232619:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3117 00000100:00100000:2.0:1782759701.232627:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218581120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759701.232652:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218581120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759701.232658:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3117 00000100:00100000:1.0:1782759701.237268:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580736 00000100:00100000:1.0:1782759701.237283:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580736 00000100:00100000:1.0:1782759701.237369:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218580864 00000100:00100000:1.0:1782759701.237372:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218580864 00000100:00100000:1.0:1782759701.237406:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5344 00000100:00100000:1.0:1782759701.237418:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218580736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759701.237492:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218580736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (13842us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759701.237500:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5344 00000100:00100000:1.0:1782759701.237517:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5345 00000100:00100000:1.0:1782759701.237525:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218580864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759701.237549:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218580864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (12141us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759701.237555:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5345 00000100:00080000:2.0:1782759701.238446:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759701.238453:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759701.238456:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759701.238459:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759701.459735:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759702.289231:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759702.289239:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 64 10000000:01000000:1.0:1782759702.289245:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759702.289292:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.289305:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.289318:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759702.289681:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.289749:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759702.289862:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.292434:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044224 00000100:00100000:3.0:1782759702.292448:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044224 00000100:00100000:1.0:1782759702.297525:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3357 00000100:00100000:1.0:1782759702.297541:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355233044224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759702.297562:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759702.297596:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d64a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.297626:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.297637:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.297647:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429400, rc 0) 00000100:00100000:1.0:1782759702.297721:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233044224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (7971us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.297727:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3357 00000100:00100000:1.0:1782759702.297785:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759702.297803:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.297812:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759702.297894:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.297927:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759702.297952:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.298229:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044352 00000100:00100000:3.0:1782759702.298237:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044352 00000100:00100000:3.0:1782759702.298272:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:3.0:1782759702.298279:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233044352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.298403:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233044352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.298410:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:1.0:1782759702.299251:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.299293:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.299417:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759702.299441:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4777300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.299518:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044480 00000100:00100000:3.0:1782759702.299523:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044480 00000100:00100000:3.0:1782759702.299558:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:3.0:1782759702.299566:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233044480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.299670:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233044480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.299678:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000100:00100000:1.0:1782759702.299821:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759702.302472:0:156694:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1782759702.303770:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1782759702.303803:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759702.303821:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.303836:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759702.303849:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1782759702.303861:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 14 10000000:01000000:3.0:1782759702.303865:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759702.303908:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.303917:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.303930:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.303973:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.304221:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.304270:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.304395:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044608 00000100:00100000:1.0:1782759702.304405:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044608 00000100:00100000:1.0:1782759702.304461:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:1.0:1782759702.304472:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233044608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759702.304486:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759702.304500:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d658 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.305451:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.305463:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 17 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.305471:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428400, rc 0) 00000100:00100000:1.0:1782759702.306265:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233044608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1791us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.306287:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:3.0:1782759702.306603:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.306625:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.306635:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.306716:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.306757:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.306788:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.306853:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044736 00000100:00100000:1.0:1782759702.306859:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044736 00000100:00100000:1.0:1782759702.306898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:1.0:1782759702.306906:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233044736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.310201:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233044736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3285us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.310217:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:0.0:1782759702.310392:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.310453:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.310639:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759702.310673:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.310731:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044864 00000100:00100000:1.0:1782759702.310738:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044864 00000100:00100000:1.0:1782759702.310786:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3362 00000100:00100000:1.0:1782759702.310795:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233044864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.310992:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233044864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.310999:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3362 00000100:00100000:2.0:1782759702.311412:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233044864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.312049:0:156695:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156695:1869355233044992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.312109:0:156695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.312279:0:156695:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.312338:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233044992 00000100:00100000:1.0:1782759702.312344:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233044992 00000100:00100000:1.0:1782759702.312382:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:1.0:1782759702.312390:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:156695:x1869355233044992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759702.312600:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:156695:x1869355233044992:12345-0@lo:502:llog_process_th.0 Request processed in 210us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.312607:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00000100:00100000:3.0:1782759702.312948:0:156695:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156695:1869355233044992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759702.312986:0:156695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759702.312996:0:156695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759702.312998:0:156695:0:(obd_config.c:1561:class_process_config()) marker 62 (0x1) lustre quota.mdt 00000020:00000080:3.0:1782759702.313003:0:156695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00010000:00010000:0.0:1782759702.320630:0:156696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.320664:0:156696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759702.320698:0:156696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156696:1869355233045120:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:0.0:1782759702.320775:0:156696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759702.320821:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045120 00000100:00100000:0.0:1782759702.320829:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045120 00000100:00100000:0.0:1782759702.320887:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1782759702.320897:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+6:156696:x1869355233045120:12345-0@lo:101:qsd_reint_0.lus.0 00010000:00010000:0.0:1782759702.320918:0:66654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759702.320935:0:66654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60d66d lrc: 2/0,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d666 expref: -99 pid: 66654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.323700:0:156696:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd180 going to sleep for 11 seconds 00010000:00010000:3.0:1782759702.324310:0:156698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.324387:0:156698:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000001000 ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.324417:0:156698:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156698:1869355233045248:0@lo:101:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759702.324479:0:156698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.324643:0:156695:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156695:1869355233045376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.324693:0:156695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.324723:0:156695:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.324741:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045376 00000100:00100000:2.0:1782759702.324747:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045376 00000100:00100000:2.0:1782759702.324808:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:2.0:1782759702.324819:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:156695:x1869355233045376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.324942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:156695:x1869355233045376:12345-0@lo:502:llog_process_th.0 Request processed in 125us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.324949:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1782759702.325419:0:156698:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37480 going to sleep for 11 seconds 00080000:10000000:0.0:1782759702.326200:0:66654:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1005:0x0] (8/8) registered 00010000:00010000:0.0:1782759702.326251:0:66654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60d66d lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d666 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.326266:0:66654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd200/0xd5b45c7f5c60d66d lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d666 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.326278:0:66654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd200, rc 0) 00000100:00100000:2.0:1782759702.326430:0:156695:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156695:1869355233045376:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759702.326469:0:156695:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759702.326476:0:156695:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759702.326478:0:156695:0:(obd_config.c:1561:class_process_config()) marker 62 (0x2) lustre quota.mdt 00000040:00080000:2.0:1782759702.326483:0:156695:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 17 count 17 00000100:00100000:3.0:1782759702.326684:0:156696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156696:1869355233045120:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:3.0:1782759702.326701:0:156696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.326711:0:156696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1782759702.327317:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 14-16 (rc=0) 00000100:00100000:0.0:1782759702.327408:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:156696:x1869355233045120:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 6510us (6630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.327418:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1782759702.327444:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045248 00000100:00100000:0.0:1782759702.327450:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045248 00000100:00100000:0.0:1782759702.327491:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1782759702.327498:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9330450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+6:156698:x1869355233045248:12345-0@lo:101:qsd_reint_0.lus.0 10000000:01000000:2.0:1782759702.327651:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782759702.327660:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.327669:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759702.327678:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759702.327681:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 64 10000000:01000000:2.0:1782759702.327684:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759702.327713:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.327719:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.327727:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.327744:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233045504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.327801:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.327829:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.327859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045504 00000100:00100000:2.0:1782759702.327862:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045504 00000100:00100000:2.0:1782759702.327892:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:2.0:1782759702.327899:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233045504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759702.327911:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759702.327926:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d67b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.327946:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.327966:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.327973:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767400, rc 0) 00000100:00100000:2.0:1782759702.328003:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233045504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.328009:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00010000:00010000:0.0:1782759702.328222:0:66654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759702.328233:0:66654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd600/0xd5b45c7f5c60d689 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d674 expref: -99 pid: 66654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1782759702.329009:0:66654:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1006:0x0] (8/8) registered 00000100:00100000:3.0:1782759702.330646:0:156696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156696:1869355233045632:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759702.330720:0:156696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.330743:0:156696:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f370c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.330861:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233045504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759702.330884:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.330897:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.330975:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233045760:0@lo:501:ll_cfg_requeue.0 00010000:00010000:0.0:1782759702.331227:0:66654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd600/0xd5b45c7f5c60d689 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d674 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.331240:0:66654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd600/0xd5b45c7f5c60d689 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d674 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.331251:0:66654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd600, rc 0) 00000100:00100000:0.0:1782759702.331295:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9330450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:156698:x1869355233045248:12345-0@lo:101:qsd_reint_0.lus.0 Request processed in 3796us (6815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.331304:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1782759702.331391:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.331426:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.331447:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045760 00000100:00100000:2.0:1782759702.331453:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045760 00000100:00100000:2.0:1782759702.331505:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:2.0:1782759702.331514:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233045760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.331655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233045760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.331662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:2.0:1782759702.331797:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233045760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.331879:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233045888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.331987:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.332004:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.332104:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045888 00000100:00100000:2.0:1782759702.332124:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045888 00000100:00100000:2.0:1782759702.332153:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3367 00000100:00100000:2.0:1782759702.332161:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233045888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.332249:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233045888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.332257:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3367 00000100:00100000:3.0:1782759702.332686:0:156698:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156698:1869355233045248:0@lo:101:qsd_reint_0.lus.0 00010000:00010000:3.0:1782759702.332730:0:156698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.332743:0:156698:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.333688:0:156698:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156698:1869355233046016:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:3.0:1782759702.333792:0:156698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.333855:0:156698:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759702.334255:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233045632 00000100:00100000:0.0:1782759702.334264:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233045632 00000100:00100000:0.0:1782759702.334310:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046016 00000100:00100000:0.0:1782759702.334314:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046016 00000100:00100000:0.0:1782759702.334328:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1782759702.334336:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:156696:x1869355233045632:12345-0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759702.338312:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233045888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759702.341236:0:156700:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000100:00100000:0.0:1782759702.341852:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:156696:x1869355233045632:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 7510us (11126us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.341865:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1782759702.341899:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1782759702.341911:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:156698:x1869355233046016:12345-0@lo:403:qsd_reint_0.lus.0 00000020:01000000:2.0:1782759702.342124:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759702.342155:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759702.342167:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342184:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759702.342195:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759702.342198:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 17 10000000:01000000:2.0:1782759702.342201:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759702.342233:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342242:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342251:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.342273:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.342321:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.342490:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.342521:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046144 00000100:00100000:2.0:1782759702.342528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046144 00000100:00100000:2.0:1782759702.342570:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:2.0:1782759702.342599:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233046144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759702.342610:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759702.342623:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d690 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342646:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342668:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342677:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767600, rc 0) 00000100:00100000:2.0:1782759702.342709:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233046144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.342716:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:2.0:1782759702.342765:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759702.342781:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.342790:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.342853:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.342879:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.342894:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.342907:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046272 00000100:00100000:2.0:1782759702.342910:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046272 00000100:00100000:2.0:1782759702.342934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:2.0:1782759702.342940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233046272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.343422:0:156696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0000_UUID:156696:1869355233045632:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759702.345298:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233046272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2350us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.345310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:3.0:1782759702.350736:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.350807:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.350934:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.350984:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759702.351733:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:156698:x1869355233046016:12345-0@lo:403:qsd_reint_0.lus.0 Request processed in 9821us (17937us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.351746:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1782759702.351815:0:156698:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job qsd_reint_0.lus:lustre-MDT0000-lwp-MDT0001_UUID:156698:1869355233046016:0@lo:403:qsd_reint_0.lus.0 00000100:00100000:2.0:1782759702.354245:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046400 00000100:00100000:2.0:1782759702.354260:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046400 00000100:00100000:2.0:1782759702.354946:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:2.0:1782759702.354972:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233046400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.355152:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233046400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.355213:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046400:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.355994:0:156696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.356008:0:156696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.356286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:3.0:1782759702.358413:0:156702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156702:1869355233046528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759702.358498:0:156702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.358543:0:156702:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.358673:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046528 00000100:00100000:2.0:1782759702.358679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046528 00000100:00100000:2.0:1782759702.358726:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:2.0:1782759702.358735:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:156702:x1869355233046528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.358855:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:156702:x1869355233046528:12345-0@lo:502:llog_process_th.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.358863:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:3.0:1782759702.359030:0:156702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156702:1869355233046528:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759702.359059:0:156702:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759702.359069:0:156702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759702.359071:0:156702:0:(obd_config.c:1561:class_process_config()) marker 60 (0x1) lustre quota.mdt 00000020:00000080:3.0:1782759702.359076:0:156702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759702.359214:0:156702:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156702:1869355233046656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759702.359249:0:156702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.359276:0:156702:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.359317:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046656 00000100:00100000:2.0:1782759702.359385:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046656 00000100:00100000:2.0:1782759702.359422:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:2.0:1782759702.359430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:156702:x1869355233046656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.359500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:156702:x1869355233046656:12345-0@lo:502:llog_process_th.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.359507:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00000100:00100000:3.0:1782759702.359601:0:156702:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156702:1869355233046656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759702.359628:0:156702:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759702.359633:0:156702:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759702.359635:0:156702:0:(obd_config.c:1561:class_process_config()) marker 60 (0x2) lustre quota.mdt 00000040:00080000:3.0:1782759702.359638:0:156702:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 20 count 20 00000020:01000000:2.0:1782759702.359812:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 17-19 (rc=0) 10000000:01000000:2.0:1782759702.359848:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782759702.359858:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.359869:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759702.359898:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759702.359901:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 64 10000000:01000000:2.0:1782759702.359904:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759702.359929:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.359938:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.359948:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.359971:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.360003:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.360225:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.360430:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046784 00000100:00100000:3.0:1782759702.360436:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046784 00000100:00100000:3.0:1782759702.360472:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:3.0:1782759702.360480:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233046784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.360491:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759702.360505:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d69e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.360527:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.360537:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.360546:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:3.0:1782759702.360604:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233046784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.360611:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00000100:00100000:2.0:1782759702.360803:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759702.360817:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.360825:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.360877:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.360983:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.361158:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78180 going to sleep for 11 seconds 00010000:00010000:2.0:1782759702.361396:0:156698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.361417:0:156698:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.361520:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233046912 00000100:00100000:3.0:1782759702.361525:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233046912 00000100:00100000:3.0:1782759702.361629:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:3.0:1782759702.361637:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233046912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.361745:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233046912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.361761:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1782759702.361837:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233046912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.361873:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.361924:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759702.362221:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.362248:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047040 00000100:00100000:2.0:1782759702.362253:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047040 00000100:00100000:2.0:1782759702.362282:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375 00000100:00100000:2.0:1782759702.362288:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233047040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.362368:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233047040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.362374:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375 00000100:00100000:0.0:1782759702.362696:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782759702.366228:0:156703:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1782759702.366500:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1782759702.366542:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759702.366555:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.366567:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759702.366591:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1782759702.366595:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 62 10000000:01000000:0.0:1782759702.366597:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1782759702.366640:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.366649:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.366676:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759702.366704:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.366774:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759702.366812:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759702.366836:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047168 00000100:00100000:0.0:1782759702.366842:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047168 00000100:00100000:0.0:1782759702.367177:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:0.0:1782759702.367188:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233047168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759702.367201:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759702.367212:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d6ac expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.367235:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.367245:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759702.367255:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dce00, rc 0) 00000100:00100000:0.0:1782759702.367299:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233047168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.367305:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1782759702.367442:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.367456:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.367465:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.367520:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.367546:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.367570:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded237c240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759702.367627:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047296 00000100:00100000:0.0:1782759702.367631:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047296 00000100:00100000:0.0:1782759702.367658:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3377 00000100:00100000:0.0:1782759702.367664:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233047296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.367774:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233047296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.367780:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3377 00000100:00100000:0.0:1782759702.367808:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.367838:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.367874:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.367964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047424 00000100:00100000:3.0:1782759702.367968:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047424 00000100:00100000:3.0:1782759702.367990:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:3.0:1782759702.367995:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233047424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.368233:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233047424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.368240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000100:00100000:0.0:1782759702.368304:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdecb3c63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759702.368316:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.368748:0:156704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156704:1869355233047552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759702.368785:0:156704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759702.368810:0:156704:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.370158:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047552 00000100:00100000:1.0:1782759702.370169:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047552 00000100:00100000:1.0:1782759702.370226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:1.0:1782759702.370235:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:156704:x1869355233047552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759702.370392:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:156704:x1869355233047552:12345-0@lo:502:llog_process_th.0 Request processed in 158us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.370399:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00000100:00100000:3.0:1782759702.370427:0:156704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156704:1869355233047552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759702.370458:0:156704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759702.370467:0:156704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759702.370470:0:156704:0:(obd_config.c:1561:class_process_config()) marker 59 (0x1) lustre quota.mdt 00000020:00000080:3.0:1782759702.370474:0:156704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759702.370504:0:156704:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156704:1869355233047680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759702.370548:0:156704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.370640:0:156704:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded314b540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.370704:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047680 00000100:00100000:2.0:1782759702.370708:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047680 00000100:00100000:2.0:1782759702.371607:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:2.0:1782759702.371627:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:156704:x1869355233047680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.371762:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:156704:x1869355233047680:12345-0@lo:502:llog_process_th.0 Request processed in 144us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.371769:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:3.0:1782759702.374179:0:156704:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156704:1869355233047680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759702.374221:0:156704:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759702.374229:0:156704:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759702.374232:0:156704:0:(obd_config.c:1561:class_process_config()) marker 59 (0x2) lustre quota.mdt 00000040:00080000:3.0:1782759702.374237:0:156704:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 65 count 64 00000020:01000000:3.0:1782759702.374307:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 62-64 (rc=0) 10000000:01000000:3.0:1782759702.375246:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1782759702.375260:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375272:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759702.375283:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759702.375285:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 64 10000000:01000000:3.0:1782759702.375289:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759702.375336:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375346:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375356:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.375379:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.375441:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.375478:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.375503:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047808 00000100:00100000:3.0:1782759702.375516:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047808 00000100:00100000:3.0:1782759702.375554:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:3.0:1782759702.375562:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233047808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.375589:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759702.375601:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d6ba expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375623:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375634:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375642:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:3.0:1782759702.375675:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233047808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.375682:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00000100:00100000:3.0:1782759702.375722:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.375735:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.375744:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.375794:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.375820:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.375834:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.375846:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233047936 00000100:00100000:3.0:1782759702.375855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233047936 00000100:00100000:3.0:1782759702.375874:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3382 00000100:00100000:3.0:1782759702.375879:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233047936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.376009:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233047936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.376249:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3382 00000100:00100000:3.0:1782759702.376284:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233047936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.376315:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.376363:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.376377:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.376390:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048064 00000100:00100000:3.0:1782759702.376393:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048064 00000100:00100000:3.0:1782759702.376409:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383 00000100:00100000:3.0:1782759702.376415:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233048064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.376485:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233048064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.376491:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383 00000100:00100000:3.0:1782759702.376526:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759702.379083:0:156706:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1782759702.379416:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1782759702.379443:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759702.379454:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.379465:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759702.379486:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782759702.379489:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 62 10000000:01000000:3.0:1782759702.379491:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782759702.379524:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.379532:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.379543:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.379566:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.381260:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.381305:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.381409:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048192 00000100:00100000:3.0:1782759702.381417:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048192 00000100:00100000:3.0:1782759702.381473:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:3.0:1782759702.381482:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233048192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.381498:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759702.381514:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d6c8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.381697:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.381709:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.381718:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:3.0:1782759702.382630:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233048192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1145us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.382640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:2.0:1782759702.386530:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759702.386688:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759702.386702:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.386806:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.386872:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759702.386954:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78180 going to sleep for 11 seconds 00000100:00100000:3.0:1782759702.388985:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048320 00000100:00100000:3.0:1782759702.388998:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048320 00000100:00100000:2.0:1782759702.389250:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:2.0:1782759702.389262:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233048320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759702.389504:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233048320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (2631us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.389522:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000100:00100000:3.0:1782759702.391112:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.391187:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.391267:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.391315:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.391524:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048448 00000100:00100000:1.0:1782759702.391531:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048448 00000100:00100000:1.0:1782759702.391600:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:1.0:1782759702.391609:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233048448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.391741:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233048448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.391749:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000100:00100000:3.0:1782759702.391986:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.392321:0:156707:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156707:1869355233048576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759702.392374:0:156707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.392403:0:156707:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759702.392541:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048576 00000100:00100000:2.0:1782759702.392546:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048576 00000100:00100000:2.0:1782759702.392612:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3387 00000100:00100000:2.0:1782759702.392621:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:156707:x1869355233048576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759702.392709:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:156707:x1869355233048576:12345-0@lo:502:llog_process_th.0 Request processed in 90us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759702.392715:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3387 00000100:00100000:3.0:1782759702.392899:0:156707:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156707:1869355233048576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759702.392920:0:156707:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782759702.392929:0:156707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759702.392931:0:156707:0:(obd_config.c:1561:class_process_config()) marker 61 (0x1) lustre quota.mdt 00000020:00000080:3.0:1782759702.392936:0:156707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1782759702.392965:0:156707:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156707:1869355233048704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759702.392995:0:156707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.393048:0:156707:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.393125:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048704 00000100:00100000:1.0:1782759702.393130:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048704 00000100:00100000:1.0:1782759702.393158:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:1.0:1782759702.393164:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:156707:x1869355233048704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759702.393273:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:156707:x1869355233048704:12345-0@lo:502:llog_process_th.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.393279:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:3.0:1782759702.394210:0:156707:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:156707:1869355233048704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759702.398449:0:156707:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759702.398463:0:156707:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759702.398466:0:156707:0:(obd_config.c:1561:class_process_config()) marker 61 (0x2) lustre quota.mdt 00000040:00080000:2.0:1782759702.398472:0:156707:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 65 count 64 00000020:01000000:3.0:1782759702.400068:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 62-64 (rc=0) 10000000:01000000:3.0:1782759702.400122:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782759702.400134:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.400154:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759702.400165:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782759702.400168:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759702.400171:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782759702.400204:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.400212:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.400223:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.400248:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.400335:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.400376:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.400565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048832 00000100:00100000:1.0:1782759702.400600:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048832 00000100:00100000:1.0:1782759702.400651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00000100:00100000:1.0:1782759702.400660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233048832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759702.400674:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759702.400687:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d6d6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.400710:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.400730:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.400738:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428e00, rc 0) 00000100:00100000:1.0:1782759702.400776:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233048832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759702.400782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00000100:00100000:3.0:1782759702.400995:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.401010:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.401018:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759702.401074:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.401100:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759702.401138:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759702.401187:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233048960 00000100:00100000:1.0:1782759702.401192:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233048960 00000100:00100000:1.0:1782759702.401223:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:1.0:1782759702.401229:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233048960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759702.401299:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233048960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (197us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759702.401305:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:3.0:1782759702.401524:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233048960:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759702.401562:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759702.401569:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.401605:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759702.441966:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759702.442128:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581248 00000100:00100000:1.0:1782759702.442138:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581248 00000100:00100000:1.0:1782759702.442201:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3391 00000100:00100000:1.0:1782759702.442211:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218581248:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759702.442227:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759702.442245:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275c2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.442275:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.442286:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759702.442311:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428800, rc 0) 00000100:00100000:0.0:1782759702.445709:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218581248:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 3489us (3752us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.445721:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3391 00000100:00100000:2.0:1782759702.449743:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759702.449832:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581376 00000100:00100000:3.0:1782759702.449844:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581376 00000100:00100000:3.0:1782759702.449991:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3392 00000100:00100000:3.0:1782759702.450002:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218581376:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759702.450616:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218581376:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 576us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.450626:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3392 00000100:00100000:2.0:1782759702.453458:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759702.453615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581504 00000100:00100000:0.0:1782759702.453625:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581504 00000100:00100000:0.0:1782759702.453733:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3393 00000100:00100000:0.0:1782759702.453744:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218581504:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.453917:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218581504:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 175us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759702.453925:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3393 00000100:00100000:2.0:1782759702.461808:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759702.462286:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581632 00000100:00100000:3.0:1782759702.462298:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581632 00000100:00100000:3.0:1782759702.462360:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3394 00000100:00100000:3.0:1782759702.462379:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218581632:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759702.462397:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759702.462418:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275c9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.462453:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.462465:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759702.462491:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4e00, rc 0) 00000100:00100000:3.0:1782759702.462550:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218581632:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 173us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759702.462557:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3394 00000100:00100000:2.0:1782759702.465495:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759702.465651:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581760 00000100:00100000:0.0:1782759702.465662:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581760 00000100:00100000:0.0:1782759702.465775:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3395 00000100:00100000:0.0:1782759702.465786:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218581760:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759702.465927:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218581760:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 142us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759702.465935:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3395 00010000:00010000:3.0:1782759702.478645:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759703.436248:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233049088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759703.436320:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759703.436398:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049088 00000100:00100000:2.0:1782759703.436412:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049088 00000100:00100000:2.0:1782759703.436489:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3430 00000100:00100000:2.0:1782759703.436501:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233049088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759703.436536:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759703.436608:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233049088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759703.436616:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3430 00000100:00100000:1.0:1782759703.436656:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233049088:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759703.498964:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759704.458915:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759704.458947:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233049344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.459012:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.459204:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049344 00000100:00100000:1.0:1782759704.459212:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049344 00000100:00100000:1.0:1782759704.459377:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5346 00000100:00100000:1.0:1782759704.459387:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.459441:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233049344:12345-0@lo:400:kworker.0 Request processed in 55us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.459448:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5346 00000100:00100000:1.0:1782759704.459489:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233049344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.459522:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233049472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.459547:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.459610:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049472 00000100:00100000:1.0:1782759704.459613:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049472 00000100:00100000:1.0:1782759704.459653:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1782759704.459659:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233049472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.459691:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233049472:12345-0@lo:400:kworker.0 Request processed in 32us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759704.459806:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233049216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.459842:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.460034:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1782759704.460070:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049216 00000100:00100000:1.0:1782759704.460074:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049216 00000100:00100000:1.0:1782759704.460108:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1782759704.460115:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233049216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462186:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233049216:12345-0@lo:400:kworker.0 Request processed in 2062us (2334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.462199:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1782759704.462281:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233049472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462379:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233049856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462415:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.462449:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049856 00000100:00100000:1.0:1782759704.462454:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049856 00000100:00100000:1.0:1782759704.462496:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5347 00000100:00100000:1.0:1782759704.462504:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233049856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462544:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233049856:12345-0@lo:400:kworker.0 Request processed in 41us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.462551:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5347 00000100:00100000:1.0:1782759704.462595:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233049856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462632:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759704.462638:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233049984:0@lo:400:kworker.0 00000100:00080000:2.0:1782759704.462653:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759704.462660:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759704.462666:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233049728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462682:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049984 00000100:00100000:1.0:1782759704.462686:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049984 00000100:00100000:2.0:1782759704.462696:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.462716:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5348 00000100:00100000:1.0:1782759704.462722:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233049984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462756:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233049984:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.462769:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5348 00000100:00080000:1.0:1782759704.462783:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759704.462802:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233049216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462802:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233049984:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.462815:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759704.462819:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233049600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.462841:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.462841:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233050368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.462860:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233050240:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462862:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.462884:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049600 00000100:00100000:1.0:1782759704.462887:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049600 00000100:00100000:1.0:1782759704.462907:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050368 00000100:00100000:1.0:1782759704.462909:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050368 00000100:00100000:1.0:1782759704.462931:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5349 00000100:00100000:1.0:1782759704.462937:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.462979:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233049600:12345-0@lo:400:kworker.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.462986:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5349 00000100:00100000:1.0:1782759704.462997:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5350 00000100:00100000:1.0:1782759704.463003:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233050368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.463019:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759704.463039:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233050368:12345-0@lo:400:kworker.0 Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759704.463043:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233049600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.463044:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5350 00000100:00080000:1.0:1782759704.463060:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759704.463366:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233050112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759704.463392:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233050368:0@lo:400:kworker.0 00000100:00100000:0.0:1782759704.463397:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759704.463405:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759704.463410:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233050496:0@lo:400:kworker.0 00000100:00100000:0.0:1782759704.463414:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233050624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759704.463431:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759704.463432:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759704.463447:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759704.463452:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050496 00000100:00100000:0.0:1782759704.463452:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233050752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759704.463455:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050496 00000100:00100000:0.0:1782759704.463472:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759704.463482:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5351 00000100:00100000:3.0:1782759704.463488:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233050496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759704.463534:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233050496:12345-0@lo:400:kworker.0 Request processed in 47us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759704.463541:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5351 00000100:00100000:0.0:1782759704.463550:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233050496:0@lo:400:kworker.0 00000100:00080000:3.0:1782759704.463557:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759704.463618:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050240 00000100:00100000:2.0:1782759704.463623:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050240 00000100:00100000:2.0:1782759704.463653:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050112 00000100:00100000:0.0:1782759704.463654:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050624 00000100:00100000:2.0:1782759704.463655:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050112 00000100:00100000:0.0:1782759704.463656:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050624 00000100:00100000:2.0:1782759704.463675:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050752 00000100:00100000:2.0:1782759704.463677:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050752 00000100:00100000:2.0:1782759704.463769:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3118 00000100:00100000:2.0:1782759704.463776:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233050240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.463810:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233050240:12345-0@lo:400:kworker.0 Request processed in 36us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759704.463815:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3118 00000100:00100000:2.0:1782759704.463826:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3119 00000100:00100000:2.0:1782759704.463832:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233050112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.463862:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233050112:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00080000:3.0:1782759704.463975:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759704.463978:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759704.464628:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233049728 00000100:00100000:1.0:1782759704.464636:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233049728 00000100:00100000:1.0:1782759704.464684:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3432 00000100:00100000:1.0:1782759704.464692:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233049728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759704.464741:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233049728:12345-0@lo:400:kworker.0 Request processed in 50us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759704.464755:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3432 00000100:00100000:0.0:1782759704.464862:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3120 00000100:00100000:0.0:1782759704.464871:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233050752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759704.464905:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233050752:12345-0@lo:400:kworker.0 Request processed in 37us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759704.464911:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3120 00000100:00100000:0.0:1782759704.464924:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3121 00000100:00100000:0.0:1782759704.464931:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233050624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759704.464969:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233050624:12345-0@lo:400:kworker.0 Request processed in 38us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759704.464975:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3121 00000100:00100000:2.0:1782759704.466362:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3119 00000100:00100000:2.0:1782759704.466434:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233050752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.466447:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233050112:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.466457:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233050624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.466502:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233050240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759704.466513:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233049728:0@lo:400:kworker.0 00010000:00010000:3.0:1782759704.522812:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759704.970890:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233050880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759704.970975:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759704.971324:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233050880 00000100:00100000:3.0:1782759704.971333:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233050880 00000100:00100000:3.0:1782759704.971391:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2764 00000100:00100000:3.0:1782759704.971400:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233050880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759704.971431:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:3.0:1782759704.971504:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233050880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759704.971511:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2764 00000100:00100000:2.0:1782759704.971622:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233050880:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759704.983984:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759704.984007:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233051008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759704.984091:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759704.984170:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051008 00000100:00100000:0.0:1782759704.984178:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051008 00000100:00100000:0.0:1782759704.984446:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2765 00000100:00100000:0.0:1782759704.984458:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233051008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759704.984483:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922784256 avail 3691261952 00000100:00100000:0.0:1782759704.984531:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233051008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759704.984538:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2765 00000100:00100000:0.0:1782759704.984612:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233051008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759705.562820:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759705.996051:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233051264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759705.996135:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759705.996193:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051264 00000100:00100000:3.0:1782759705.996195:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759705.996201:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233051136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759705.996211:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051264 00000100:00100000:3.0:1782759705.996226:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759705.996251:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759705.996252:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051136 00000100:00100000:2.0:1782759705.996255:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051136 00000100:00100000:3.0:1782759705.996258:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233051392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759705.996276:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2766 00000100:00100000:3.0:1782759705.996283:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759705.996286:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233051264:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759705.996308:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051392 00000100:00100000:3.0:1782759705.996311:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051392 00002000:00000024:2.0:1782759705.996315:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759705.996353:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3433 00000100:00100000:3.0:1782759705.996359:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233051392:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759705.996359:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233051264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759705.996377:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2766 00000004:00000024:3.0:1782759705.996382:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:2.0:1782759705.996393:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2767 00000100:00100000:2.0:1782759705.996400:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233051136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759705.996411:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759705.996414:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233051392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759705.996420:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3433 00000100:00100000:2.0:1782759705.996433:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233051136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759705.996439:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2767 00000100:00100000:3.0:1782759705.996460:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233051392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759705.996461:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233051136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759705.996472:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233051264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759706.337727:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759706.338222:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759706.338254:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759706.338270:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759706.338308:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759706.338313:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582144 00000100:00100000:1.0:1782759706.338323:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582144 00000100:00100000:2.0:1782759706.338327:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582400 00000100:00100000:2.0:1782759706.338329:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582400 00000100:00100000:2.0:1782759706.338375:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3122 00000100:00100000:1.0:1782759706.338375:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582016 00000100:00100000:1.0:1782759706.338378:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582016 00000100:00100000:2.0:1782759706.338385:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218582400:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759706.338396:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5352 00000100:00100000:1.0:1782759706.338402:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218582144:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759706.338457:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218582400:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.338464:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3122 00000100:00100000:2.0:1782759706.338488:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582272 00000100:00100000:2.0:1782759706.338492:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582272 00000100:00100000:2.0:1782759706.338515:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3123 00000100:00100000:2.0:1782759706.338523:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218582272:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759706.338772:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5353 00000100:00100000:0.0:1782759706.338781:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218582016:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759706.338838:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218581888 00000100:00100000:3.0:1782759706.338843:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218581888 00000100:00100000:1.0:1782759706.338850:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218582144:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 447us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759706.338857:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5352 00000100:00080000:1.0:1782759706.338875:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759706.338880:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3397 00000100:00080000:1.0:1782759706.338880:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759706.338882:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759706.338884:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759706.338887:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218581888:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759706.338911:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218581888:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759706.338936:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3397 00000100:00100000:2.0:1782759706.339355:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218582272:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 775us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.339364:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3123 00000100:00100000:0.0:1782759706.343950:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218582016:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 4246us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759706.343966:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5353 00010000:00010000:2.0:1782759706.573176:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759706.842427:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759706.845679:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582528 00000100:00100000:1.0:1782759706.845693:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582528 00000100:00100000:1.0:1782759706.845750:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3023 00000100:00100000:1.0:1782759706.845759:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112906:x1869355218582528:12345-192.168.202.31@tcp:48:lfs.0 00000100:00100000:1.0:1782759706.848238:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051520:0@lo:106: 00000100:00100000:1.0:1782759706.848314:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759706.848373:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051648:0@lo:106: 00000100:00100000:1.0:1782759706.848392:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759706.848457:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759706.853969:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051520 00000100:00100000:2.0:1782759706.853983:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051520 00000100:00100000:2.0:1782759706.854060:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051648 00000100:00100000:2.0:1782759706.854064:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051648 00000100:00100000:2.0:1782759706.854090:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1782759706.854099:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233051520:12345-0@lo:106: 00010000:00010000:2.0:1782759706.854115:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.854126:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.854215:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233051520:12345-0@lo:106: Request processed in 118us (5902us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.854223:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:2.0:1782759706.854238:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1782759706.854245:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233051648:12345-0@lo:106: 00010000:00010000:2.0:1782759706.854253:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.854260:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.854308:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233051648:12345-0@lo:106: Request processed in 64us (5915us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.854314:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1782759706.854567:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051520:0@lo:106: 00000100:00100000:2.0:1782759706.854597:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051648:0@lo:106: 00000100:00100000:1.0:1782759706.856318:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051776:0@lo:106: 00000100:00100000:1.0:1782759706.856378:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759706.856476:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051904:0@lo:106: 00000100:00100000:1.0:1782759706.856496:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759706.856635:0:140593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759706.856653:0:140593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759706.856696:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051776 00000100:00100000:2.0:1782759706.856702:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051776 00000100:00100000:2.0:1782759706.856741:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233051904 00000100:00100000:2.0:1782759706.856744:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233051904 00000100:00100000:2.0:1782759706.856758:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1782759706.856766:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233051776:12345-0@lo:106: 00010000:00010000:2.0:1782759706.856777:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.856787:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.856830:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233051776:12345-0@lo:106: Request processed in 66us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.856837:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1782759706.856877:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1782759706.856884:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233051904:12345-0@lo:106: 00010000:00010000:2.0:1782759706.856890:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.856906:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.856949:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233051904:12345-0@lo:106: Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.856955:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1782759706.857138:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051776:0@lo:106: 00000100:00100000:2.0:1782759706.857146:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233051904:0@lo:106: 00000100:00100000:2.0:1782759706.858661:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052032:0@lo:106: 00000100:00100000:2.0:1782759706.858715:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759706.858758:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052160:0@lo:106: 00000100:00100000:2.0:1782759706.858780:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759706.858804:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052288:0@lo:106: 00000100:00100000:2.0:1782759706.858823:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759706.858839:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052416:0@lo:106: 00000100:00100000:2.0:1782759706.858930:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759706.858943:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded2ab2300 going to sleep for 11 seconds 00000100:00100000:2.0:1782759706.858967:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052032 00000100:00100000:2.0:1782759706.858972:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052032 00000100:00100000:2.0:1782759706.859005:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052160 00000100:00100000:2.0:1782759706.859008:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052160 00000100:00100000:2.0:1782759706.859019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052288 00000100:00100000:2.0:1782759706.859021:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052288 00000100:00100000:0.0:1782759706.859092:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052416 00000100:00100000:0.0:1782759706.859098:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052416 00000100:00100000:2.0:1782759706.859106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1782759706.859117:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233052032:12345-0@lo:106: 00010000:00010000:2.0:1782759706.859129:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.859149:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.859204:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233052032:12345-0@lo:106: Request processed in 90us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.859211:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:2.0:1782759706.859227:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1782759706.859234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:6531:x1869355233052160:12345-0@lo:106: 00010000:00010000:2.0:1782759706.859336:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.859346:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759706.859362:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1782759706.859373:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:6531:x1869355233052288:12345-0@lo:106: 00010000:00010000:0.0:1782759706.859383:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.859390:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:6531:x1869355233052160:12345-0@lo:106: Request processed in 155us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.859398:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00010000:00010000:0.0:1782759706.859410:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.859414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1782759706.859426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233052416:12345-0@lo:106: 00010000:00010000:2.0:1782759706.859434:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.859443:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759706.859484:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233052416:12345-0@lo:106: Request processed in 61us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.859497:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1782759706.860096:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052032:0@lo:106: 00000100:00100000:2.0:1782759706.860114:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052160:0@lo:106: 00000100:00100000:2.0:1782759706.860129:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052416:0@lo:106: 00000100:00100000:1.0:1782759706.860701:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:6531:x1869355233052288:12345-0@lo:106: Request processed in 1327us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759706.860712:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1782759706.860797:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052288:0@lo:106: 00000100:00100000:3.0:1782759706.875218:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052544:0@lo:106: 00000100:00100000:3.0:1782759706.875296:0:6531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759706.875351:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052672:0@lo:106: 00000100:00100000:3.0:1782759706.875379:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052800:0@lo:106: 00000100:00100000:3.0:1782759706.875403:0:6531:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052928:0@lo:106: 00000100:00100000:3.0:1782759706.875418:0:6531:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759706.876197:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759706.876225:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759706.876251:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759706.876272:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759706.876288:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052544 00000100:00100000:0.0:1782759706.876295:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052544 00000100:00100000:0.0:1782759706.876332:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052672 00000100:00100000:0.0:1782759706.876335:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052672 00000100:00100000:0.0:1782759706.876348:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052800 00000100:00100000:0.0:1782759706.876350:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052800 00000100:00100000:0.0:1782759706.876360:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233052928 00000100:00100000:0.0:1782759706.876363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233052928 00000100:00100000:0.0:1782759706.876377:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1782759706.876386:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233052544:12345-0@lo:106: 00000100:00100000:1.0:1782759706.876398:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00010000:00010000:0.0:1782759706.876400:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759706.876411:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:6531:x1869355233052672:12345-0@lo:106: 00010000:00010000:0.0:1782759706.876413:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759706.876423:0:18645:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759706.876434:0:18645:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759706.876483:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:6531:x1869355233052544:12345-0@lo:106: Request processed in 96us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759706.876491:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:6531:x1869355233052672:12345-0@lo:106: Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759706.876492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1782759706.876503:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1782759706.876526:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1782759706.876533:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:6531:x1869355233052800:12345-0@lo:106: 00000100:00100000:0.0:1782759706.876539:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00010000:00010000:1.0:1782759706.876543:0:18645:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759706.876551:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233052928:12345-0@lo:106: 00010000:00010000:1.0:1782759706.876556:0:18645:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.876598:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.876607:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759706.876623:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:6531:x1869355233052800:12345-0@lo:106: Request processed in 89us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759706.876631:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:0.0:1782759706.876657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0000+7:6531:x1869355233052928:12345-0@lo:106: Request processed in 108us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759706.876664:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1782759706.877029:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759706.877041:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233053056:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759706.877070:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759706.877114:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053056 00000100:00100000:1.0:1782759706.877125:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053056 00000100:00100000:1.0:1782759706.877159:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1782759706.877165:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233053056:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1782759706.877332:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233053056:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 166us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759706.877339:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1782759706.878123:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233053056:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759706.878231:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052544:0@lo:106: 00000100:00100000:3.0:1782759706.878242:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052672:0@lo:106: 00000100:00100000:3.0:1782759706.878251:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052800:0@lo:106: 00000100:00100000:3.0:1782759706.878260:0:6531:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6531:1869355233052928:0@lo:106: 00000100:00100000:3.0:1782759706.878352:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112906:x1869355218582528:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 32591us (35934us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759706.878361:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3023 00000100:00100000:1.0:1782759706.898258:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759706.898323:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582656 00000100:00100000:3.0:1782759706.898334:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582656 00000100:00100000:3.0:1782759706.898397:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3024 00000100:00100000:3.0:1782759706.898407:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112907:x1869355218582656:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1782759706.898429:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759706.898469:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d6f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275d0 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759706.898504:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d6f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759706.898527:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759706.898540:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d6f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759706.898682:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d6f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275d0 expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759706.898703:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d6f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275d0 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759706.898713:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759706.898716:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759706.898720:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:3.0:1782759706.899751:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112907:x1869355218582656:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1338us (1836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759706.899762:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3024 00000100:00100000:3.0:1782759706.904165:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759706.904349:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582784 00000100:00100000:2.0:1782759706.904360:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582784 00000100:00100000:2.0:1782759706.904428:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 369 00000100:00100000:2.0:1782759706.904441:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112907:x1869355218582784:12345-192.168.202.31@tcp:37:ls.0 00000100:00100000:1.0:1782759706.918107:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112907:x1869355218582784:12345-192.168.202.31@tcp:37:ls.0 Request processed in 13659us (13948us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759706.918122:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 369 00000100:00100000:1.0:1782759706.934184:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759706.934245:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218582912 00000100:00100000:0.0:1782759706.934256:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218582912 00000100:00100000:0.0:1782759706.936529:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3025 00000100:00100000:0.0:1782759706.936550:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112907:x1869355218582912:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759706.936691:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759706.936713:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275d7 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.936792:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.936807:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.936819:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.936867:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.936876:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759706.936882:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956274:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d715 lrc: 3/1,0 mode: --/PR res: [0x200000415:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956307:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d715 lrc: 3/1,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956320:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d715 lrc: 3/1,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759706.956392:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000415:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759706.956396:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759706.956424:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d715 lrc: 3/1,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956440:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956447:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956471:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956478:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956484:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dd400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759706.956488:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956495:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956508:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759706.956510:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759706.956515:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956522:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956536:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956542:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956548:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956553:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759706.956562:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956569:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956595:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7a524b64 (ffff8cddc24d2d00) 00010000:00010000:2.0:1782759706.956598:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759706.956601:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956607:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d70e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7a524b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956658:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275d7 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956672:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d715 lrc: 3/0,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275d7 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.956679:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000415:0x1:0x0].0x0 (ffff8cddc24d2000) 00010000:00010000:2.0:1782759706.956681:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759706.956683:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766a00, rc 0) 00000100:00100000:2.0:1782759706.956769:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:112907:x1869355218582912:12345-192.168.202.31@tcp:101:ls.0 Request processed in 20225us (22594us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.956778:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3025 00000100:00100000:1.0:1782759706.981111:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759706.986641:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583040 00000100:00100000:3.0:1782759706.986656:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583040 00000100:00100000:2.0:1782759706.986824:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3026 00000100:00100000:2.0:1782759706.986837:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:112907:x1869355218583040:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759706.986857:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759706.986889:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d71c lrc: 2/0,0 mode: --/PR res: [0x200000415:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275de expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.986938:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d723 lrc: 3/1,0 mode: --/PR res: [0x200000415:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.986951:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d723 lrc: 3/1,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.986962:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d723 lrc: 3/1,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.987079:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d71c lrc: 0/0,0 mode: --/PR res: [0x200000415:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275de expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.987097:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d723 lrc: 3/0,0 mode: PR/PR res: [0x200000415:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275de expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759706.987106:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000415:0x1:0x0].0x0 (ffff8cddc24d2000) 00010000:00010000:2.0:1782759706.987109:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759706.987112:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767000, rc 0) 00000100:00100000:2.0:1782759706.987350:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:112907:x1869355218583040:12345-192.168.202.31@tcp:101:ls.0 Request processed in 516us (6251us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759706.987367:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3026 00000100:00100000:1.0:1782759707.001065:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.001514:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583168 00000100:00100000:0.0:1782759707.001526:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583168 00000100:00100000:0.0:1782759707.001644:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3027 00000100:00100000:0.0:1782759707.001656:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:112907:x1869355218583168:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.001682:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.001710:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d72a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275e5 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.001798:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.001814:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.001827:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.001875:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.001884:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.001913:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002007:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60d73f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002017:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60d73f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002024:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60d73f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759707.002052:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60d73f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002069:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002076:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002083:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002091:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002098:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.002102:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002111:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002130:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759707.002134:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.002140:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002147:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002164:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002410:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002417:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002423:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.002426:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002432:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002440:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff8cddc24d2800) 00010000:00010000:0.0:1782759707.002443:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.002446:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002452:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002503:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d72a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275e5 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002516:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60d73f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275e5 expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.002522:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x13:0x0].0x0 (ffff8cddc24d2200) 00010000:00010000:0.0:1782759707.002524:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759707.002526:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dc000, rc 0) 00000100:00100000:0.0:1782759707.002628:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:112907:x1869355218583168:12345-192.168.202.31@tcp:101:ls.0 Request processed in 975us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.002635:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3027 00000100:00100000:0.0:1782759707.015070:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.015414:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583296 00000100:00100000:1.0:1782759707.015424:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583296 00000100:00100000:1.0:1782759707.015490:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3028 00000100:00100000:1.0:1782759707.015502:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:112907:x1869355218583296:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.015527:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.015626:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d746 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275ec expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.015709:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d74d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.015726:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d74d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.015752:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d74d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.015838:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x13:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.015842:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759707.015887:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d746 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275ec expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.015906:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d74d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275ec expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.015915:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x13:0x0].0x0 (ffff8cddc34f5500) 00010000:00010000:1.0:1782759707.015929:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759707.015932:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429c00, rc 0) 00000100:00100000:1.0:1782759707.016010:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112907:x1869355218583296:12345-192.168.202.31@tcp:101:ls.0 Request processed in 511us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.016017:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3028 00000100:00100000:1.0:1782759707.020364:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.020443:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583424 00000100:00100000:2.0:1782759707.020454:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583424 00000100:00100000:2.0:1782759707.020522:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3029 00000100:00100000:2.0:1782759707.020533:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:112907:x1869355218583424:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.020552:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.020624:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d754 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275f3 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.020664:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60d75b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.020679:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60d75b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.020690:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60d75b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.020818:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d754 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275f3 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.020836:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60d75b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275f3 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.020845:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x13:0x0].0x0 (ffff8cddc34f5500) 00010000:00010000:2.0:1782759707.020848:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759707.020851:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767e00, rc 0) 00000100:00100000:2.0:1782759707.020897:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:112907:x1869355218583424:12345-192.168.202.31@tcp:101:ls.0 Request processed in 367us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.020905:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3029 00000100:00100000:0.0:1782759707.027867:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759707.028021:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583552 00000100:00100000:3.0:1782759707.028030:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583552 00000100:00100000:3.0:1782759707.028090:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3030 00000100:00100000:3.0:1782759707.028101:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:112907:x1869355218583552:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1782759707.028122:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759707.028139:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb275fa expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.030103:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.030125:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.030138:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.030154:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.030160:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.030166:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031028:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d777 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031042:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d777 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031050:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d777 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759707.031094:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d777 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031108:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031114:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031121:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031128:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031133:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.031138:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031145:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031158:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759707.031161:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.031166:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031295:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031312:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031323:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031328:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031333:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.031336:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031342:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031349:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff8cded3a3b500) 00010000:00010000:2.0:1782759707.031351:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.031353:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031358:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d770 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031396:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275fa expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031409:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d777 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275fa expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.031416:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759707.031419:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759707.031427:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767a00, rc 0) 00000100:00100000:2.0:1782759707.031549:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:112907:x1869355218583552:12345-192.168.202.31@tcp:101:ls.0 Request processed in 3449us (3691us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.031558:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3030 00000100:00100000:0.0:1782759707.043996:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.044140:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583680 00000100:00100000:1.0:1782759707.044151:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583680 00000100:00100000:1.0:1782759707.044217:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3031 00000100:00100000:1.0:1782759707.044228:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:112907:x1869355218583680:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.044250:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.044292:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60d77e lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27601 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.044355:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60d785 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.044379:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60d785 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.044406:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60d785 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.044458:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.044462:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759707.044504:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60d77e lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27601 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.044523:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60d785 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27601 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.044533:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f5400) 00010000:00010000:1.0:1782759707.044537:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759707.044540:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429200, rc 0) 00000100:00100000:1.0:1782759707.044647:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:112907:x1869355218583680:12345-192.168.202.31@tcp:101:ls.0 Request processed in 420us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.044656:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3031 00000100:00100000:1.0:1782759707.044765:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759707.045443:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583808 00000100:00100000:3.0:1782759707.045450:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583808 00000100:00100000:3.0:1782759707.045501:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 410 00000100:00100000:3.0:1782759707.045510:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2402:x1869355218583808:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759707.045522:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759707.045541:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d777 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275fa expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.045556:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:3.0:1782759707.045565:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759707.045640:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218583808:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 131us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759707.045647:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 410 00000100:00100000:1.0:1782759707.054466:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.054565:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218583936 00000100:00100000:2.0:1782759707.054608:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218583936 00000100:00100000:2.0:1782759707.054682:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3032 00000100:00100000:2.0:1782759707.054695:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:112907:x1869355218583936:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.054718:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.054752:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d78c lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27608 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.054790:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60d793 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.054805:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60d793 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.054816:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60d793 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.054956:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d78c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27608 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.054975:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60d793 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27608 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.054993:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f5400) 00010000:00010000:2.0:1782759707.054997:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759707.055007:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766600, rc 0) 00000100:00100000:2.0:1782759707.055061:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:112907:x1869355218583936:12345-192.168.202.31@tcp:101:ls.0 Request processed in 371us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.055069:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3032 00000100:00100000:2.0:1782759707.066980:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.068409:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584064 00000100:00100000:0.0:1782759707.068424:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584064 00000100:00100000:0.0:1782759707.068498:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3033 00000100:00100000:0.0:1782759707.068509:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:112907:x1869355218584064:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.068529:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.068549:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60d79a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2760f expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068675:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068691:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068717:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068778:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068787:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068795:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068876:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 3/1,0 mode: --/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068884:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 3/1,0 mode: PR/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068891:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 3/1,0 mode: PR/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.068943:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000040f:0x2:0x0]: returning size 524288 00000004:00200000:0.0:1782759707.068948:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.068969:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 3/1,0 mode: PR/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068989:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 3/1,0 mode: PR/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.068999:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069014:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069019:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069025:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069030:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4ddc00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.069035:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069042:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069052:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759707.069055:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.069058:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069064:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069077:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069083:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069089:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069099:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dde00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.069102:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069108:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069114:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8c087947 (ffff8cddc24d2800) 00010000:00010000:0.0:1782759707.069117:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.069119:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069124:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8c087947 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069156:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60d79a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2760f expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069168:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 3/0,0 mode: PR/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2760f expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.069175:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000040f:0x2:0x0].0x0 (ffff8cddc24d2c00) 00010000:00010000:0.0:1782759707.069177:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759707.069179:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd800, rc 0) 00000100:00100000:0.0:1782759707.069243:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:112907:x1869355218584064:12345-192.168.202.31@tcp:101:ls.0 Request processed in 735us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.069251:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3033 00000100:00100000:0.0:1782759707.074503:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.075088:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584192 00000100:00100000:1.0:1782759707.075100:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584192 00000100:00100000:1.0:1782759707.075163:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1107 00000100:00100000:1.0:1782759707.075362:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2403:x1869355218584192:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.075380:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.075403:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057d7444f/0xd5b45c7f5c60d7b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27616 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759707.075445:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 524288, mtime: 0x6a42bece, atime: 0x0, ctime: 0x6a42bece, blocks: 0x400 00010000:00010000:1.0:1782759707.075466:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=3747s v=(0 0) 00010000:00010000:1.0:1782759707.075471:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759707.075482:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d7444f/0xd5b45c7f5c60d7b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27616 expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.075500:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057d7444f/0xd5b45c7f5c60d7b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27616 expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.075513:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5429600, rc 0) 00000100:00100000:1.0:1782759707.075640:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218584192:12345-192.168.202.31@tcp:101:ls.0 Request processed in 283us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.075647:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1107 00000100:00100000:1.0:1782759707.083685:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.083793:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584320 00000100:00100000:0.0:1782759707.083805:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584320 00000100:00100000:0.0:1782759707.083868:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3034 00000100:00100000:0.0:1782759707.083878:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:112907:x1869355218584320:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.083899:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.083952:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60d7bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2761d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.084158:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7c4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.084185:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.084198:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.084250:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x16:0x0]: returning size 4096 00000004:00200000:0.0:1782759707.084254:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.084277:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7c4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.084381:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60d7bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2761d expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.084410:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7c4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2761d expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.084419:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc24d2100) 00010000:00010000:0.0:1782759707.084422:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759707.084439:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dde00, rc 0) 00000100:00100000:0.0:1782759707.084508:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:112907:x1869355218584320:12345-192.168.202.31@tcp:101:ls.0 Request processed in 630us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.084516:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3034 00000100:00100000:2.0:1782759707.087830:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.088094:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584448 00000100:00100000:1.0:1782759707.088104:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584448 00000100:00100000:1.0:1782759707.088279:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3035 00000100:00100000:1.0:1782759707.088301:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:112907:x1869355218584448:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.088324:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.088343:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d7cb lrc: 2/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27624 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.088378:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d7d2 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.088410:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d7d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.088423:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d7d2 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.088535:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d7cb lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27624 expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.088554:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d7d2 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27624 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.088563:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc24d2100) 00010000:00010000:1.0:1782759707.088566:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759707.088570:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428c00, rc 0) 00000100:00100000:1.0:1782759707.088963:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:112907:x1869355218584448:12345-192.168.202.31@tcp:101:ls.0 Request processed in 673us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.090156:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3035 00000100:00100000:1.0:1782759707.093204:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.093484:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584576 00000100:00100000:0.0:1782759707.093493:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584576 00000100:00100000:0.0:1782759707.093549:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3036 00000100:00100000:0.0:1782759707.093560:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:112907:x1869355218584576:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.093617:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.093639:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2762b expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093703:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093717:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093729:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093756:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093764:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093771:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093849:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d7ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093870:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d7ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.093879:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d7ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.094153:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000404:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759707.094157:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.094262:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d7ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094277:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094285:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094366:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094374:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094380:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.094385:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094392:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094405:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759707.094417:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.094422:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094429:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc200/0xd5b45c7f5c60d7e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094446:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094452:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094458:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094464:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.094467:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094473:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094481:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x61f65a1e (ffff8cddc24d2900) 00010000:00010000:0.0:1782759707.094484:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.094487:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094492:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc400/0xd5b45c7f5c60d7e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x61f65a1e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094531:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4ddc00/0xd5b45c7f5c60d7d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2762b expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094556:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d7ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2762b expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.094563:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759707.094565:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759707.094567:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd400, rc 0) 00000100:00100000:0.0:1782759707.094664:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:112907:x1869355218584576:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1105us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.094672:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3036 00000100:00100000:2.0:1782759707.097977:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.099327:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584704 00000100:00100000:0.0:1782759707.099341:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584704 00000100:00100000:0.0:1782759707.099403:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3037 00000100:00100000:0.0:1782759707.099413:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:112907:x1869355218584704:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.099434:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.099455:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60d7f5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27632 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.099494:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60d7fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.099510:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.099521:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60d7fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.099683:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dcc00/0xd5b45c7f5c60d7f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27632 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.099711:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60d7fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27632 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.099719:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:0.0:1782759707.099722:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759707.099725:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd4dd000, rc 0) 00000100:00100000:0.0:1782759707.099801:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:112907:x1869355218584704:12345-192.168.202.31@tcp:101:ls.0 Request processed in 389us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.099808:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3037 00000100:00100000:3.0:1782759707.103341:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.103480:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584832 00000100:00100000:0.0:1782759707.103491:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584832 00000100:00100000:0.0:1782759707.103635:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3038 00000100:00100000:0.0:1782759707.103646:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:112907:x1869355218584832:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.103669:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.103691:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60d803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27639 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103761:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103775:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103785:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103830:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103852:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103858:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103955:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60d818 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103964:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60d818 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.103970:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60d818 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.104470:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000403:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759707.104475:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.104500:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60d818 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104518:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104525:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104531:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104538:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104554:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.104559:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104567:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104605:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759707.104608:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.104612:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104619:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d80a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104634:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104640:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104646:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104651:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759707.104654:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104660:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104679:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6cb9a5d (ffff8cddc24d2800) 00010000:00010000:0.0:1782759707.104681:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759707.104684:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104691:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d811 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.104728:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dda00/0xd5b45c7f5c60d803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27639 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.105060:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60d818 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27639 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.105069:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759707.105071:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759707.105073:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803a00, rc 0) 00000100:00100000:0.0:1782759707.105139:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:112907:x1869355218584832:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1494us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.105147:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3038 00000100:00100000:1.0:1782759707.112055:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.112209:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218584960 00000100:00100000:0.0:1782759707.112220:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218584960 00000100:00100000:0.0:1782759707.112282:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3039 00000100:00100000:0.0:1782759707.112303:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:112907:x1869355218584960:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.112324:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.112343:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d81f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27640 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.112410:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60d826 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.112423:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60d826 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.112435:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60d826 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.112549:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d81f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27640 expref: 15 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.112566:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60d826 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27640 expref: 14 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.112607:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759707.112611:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759707.112614:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803600, rc 0) 00000100:00100000:0.0:1782759707.112672:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:112907:x1869355218584960:12345-192.168.202.31@tcp:101:ls.0 Request processed in 381us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.112679:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3039 00000100:00100000:2.0:1782759707.120320:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.120528:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585088 00000100:00100000:0.0:1782759707.120538:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585088 00000100:00100000:0.0:1782759707.120625:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3040 00000100:00100000:0.0:1782759707.120635:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:112907:x1869355218585088:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.120655:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.120678:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d82d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27647 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.120767:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d834 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.120780:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d834 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.120790:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d834 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.120837:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759707.120840:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.120859:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d834 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.120881:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d82d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27647 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.120906:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d834 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27647 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.120914:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1:0x0].0x0 (ffff8cddc24d2800) 00010000:00010000:0.0:1782759707.120927:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759707.120930:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803000, rc 0) 00000100:00100000:0.0:1782759707.120994:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:112907:x1869355218585088:12345-192.168.202.31@tcp:101:ls.0 Request processed in 360us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.121001:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3040 00000100:00100000:3.0:1782759707.129680:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.129949:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585216 00000100:00100000:1.0:1782759707.129960:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585216 00000100:00100000:1.0:1782759707.130041:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3041 00000100:00100000:1.0:1782759707.130052:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:112907:x1869355218585216:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.130076:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.130097:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60d83b lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2764e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.130156:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d842 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.130181:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d842 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.130193:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d842 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.130328:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60d83b lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2764e expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.130345:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d842 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2764e expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.130354:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1:0x0].0x0 (ffff8cddc24d2800) 00010000:00010000:1.0:1782759707.130357:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759707.130361:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5428200, rc 0) 00000100:00100000:1.0:1782759707.130437:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:112907:x1869355218585216:12345-192.168.202.31@tcp:101:ls.0 Request processed in 387us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.130444:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3041 00000100:00100000:1.0:1782759707.136689:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.136768:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585344 00000100:00100000:0.0:1782759707.136778:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585344 00000100:00100000:0.0:1782759707.136853:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3042 00000100:00100000:0.0:1782759707.136863:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:112907:x1869355218585344:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.136884:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.136908:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27655 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.137027:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d850 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.137042:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d850 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.137054:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d850 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.137102:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1d:0x0]: returning size 4096 00000004:00200000:0.0:1782759707.137105:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.137127:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d850 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.137150:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27655 expref: 13 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.137175:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d850 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27655 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.137184:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759707.137186:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759707.137190:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802000, rc 0) 00000100:00100000:0.0:1782759707.137253:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:112907:x1869355218585344:12345-192.168.202.31@tcp:101:ls.0 Request processed in 391us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.137267:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3042 00000100:00100000:3.0:1782759707.143972:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.144311:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585472 00000100:00100000:0.0:1782759707.144322:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585472 00000100:00100000:0.0:1782759707.144393:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3043 00000100:00100000:0.0:1782759707.144404:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:112907:x1869355218585472:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.144429:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.144452:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d857 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2765c expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.147196:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60d85e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.147234:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60d85e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.147249:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60d85e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759707.147321:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x17:0x0]: returning size 4096 00000004:00200000:0.0:1782759707.147326:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759707.147350:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60d85e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.147390:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60d857 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2765c expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.147413:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60d85e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2765c expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.147452:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759707.147455:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759707.147459:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803800, rc 0) 00000100:00100000:2.0:1782759707.147896:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:112907:x1869355218585472:12345-192.168.202.31@tcp:101:ls.0 Request processed in 3492us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.147908:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3043 00000100:00100000:3.0:1782759707.153410:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.153559:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585600 00000100:00100000:1.0:1782759707.153569:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585600 00000100:00100000:1.0:1782759707.153654:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3044 00000100:00100000:1.0:1782759707.153665:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:112907:x1869355218585600:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.153687:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.153726:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60d865 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27663 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.153791:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60d86c lrc: 3/1,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.153807:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60d86c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.153819:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60d86c lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.153948:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428600/0xd5b45c7f5c60d865 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27663 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.153966:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60d86c lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x17:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27663 expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.153976:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:1.0:1782759707.153988:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759707.153992:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759707.154058:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:112907:x1869355218585600:12345-192.168.202.31@tcp:101:ls.0 Request processed in 394us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.154066:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3044 00000100:00100000:1.0:1782759707.166655:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.166774:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585728 00000100:00100000:2.0:1782759707.166784:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585728 00000100:00100000:2.0:1782759707.166847:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3045 00000100:00100000:2.0:1782759707.166859:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:112907:x1869355218585728:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.166877:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.166898:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2766a expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.166984:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167000:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167011:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167026:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167049:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167056:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167116:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d888 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167125:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167132:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759707.167156:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167358:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167366:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167371:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167378:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167384:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.167389:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167403:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167416:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759707.167419:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.167424:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167430:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d87a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167446:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167452:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167458:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167463:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.167465:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167471:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167479:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759707.167481:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.167484:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167501:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167533:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2766a expref: 20 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167547:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d888 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2766a expref: 19 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.167554:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:2.0:1782759707.167556:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759707.167558:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:2.0:1782759707.167677:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:112907:x1869355218585728:12345-192.168.202.31@tcp:101:ls.0 Request processed in 820us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.167685:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3045 00000100:00100000:2.0:1782759707.180605:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.180714:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585856 00000100:00100000:1.0:1782759707.180724:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585856 00000100:00100000:1.0:1782759707.181028:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3046 00000100:00100000:1.0:1782759707.181041:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:112907:x1869355218585856:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.181086:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.181157:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60d88f lrc: 2/0,0 mode: --/CR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27671 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.181289:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60d896 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.181361:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60d896 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.181421:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60d896 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.181479:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0xd:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.181483:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759707.181523:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60d88f lrc: 0/0,0 mode: --/CR res: [0x240000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27671 expref: 14 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.181542:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60d896 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27671 expref: 13 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.181551:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff8cddc34f5e00) 00010000:00010000:1.0:1782759707.181555:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759707.181558:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413a00, rc 0) 00000100:00100000:1.0:1782759707.181865:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:112907:x1869355218585856:12345-192.168.202.31@tcp:101:ls.0 Request processed in 827us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.181874:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3046 00000100:00100000:1.0:1782759707.186372:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759707.186661:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218585984 00000100:00100000:0.0:1782759707.186673:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218585984 00000100:00100000:0.0:1782759707.186734:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3047 00000100:00100000:0.0:1782759707.186754:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:112907:x1869355218585984:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.186777:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.186797:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60d89d lrc: 2/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27678 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.186832:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60d8a4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.187096:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60d8a4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.187110:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60d8a4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.187239:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60d89d lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27678 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.187257:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60d8a4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27678 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.187266:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff8cddc34f5e00) 00010000:00010000:0.0:1782759707.187275:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759707.187279:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803e00, rc 0) 00000100:00100000:0.0:1782759707.188250:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:112907:x1869355218585984:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1490us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.188260:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3047 00000100:00100000:0.0:1782759707.203856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.206837:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586112 00000100:00100000:2.0:1782759707.206864:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586112 00000100:00100000:2.0:1782759707.206950:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3048 00000100:00100000:2.0:1782759707.206973:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+19:112907:x1869355218586112:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.207000:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.207021:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d8ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2767f expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207088:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207122:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207134:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207152:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207160:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207167:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207225:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60d8c0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207233:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60d8c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207239:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60d8c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759707.207262:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60d8c0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207277:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207282:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207310:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207316:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207321:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.207325:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207333:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207346:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759707.207349:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.207354:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.207372:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767a00/0xd5b45c7f5c60d8b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208062:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208071:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208079:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208084:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.208097:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208105:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208116:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759707.208118:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.208122:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208128:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766400/0xd5b45c7f5c60d8b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208166:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766200/0xd5b45c7f5c60d8ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2767f expref: 21 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208180:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60d8c0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2767f expref: 20 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.208187:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff8cddc34ff500) 00010000:00010000:2.0:1782759707.208189:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759707.208191:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759707.208397:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:112907:x1869355218586112:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1435us (4549us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.208405:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3048 00000100:00100000:2.0:1782759707.219973:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.220210:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586240 00000100:00100000:1.0:1782759707.220233:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586240 00000100:00100000:1.0:1782759707.220304:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3049 00000100:00100000:1.0:1782759707.220316:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:112907:x1869355218586240:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.220338:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.220363:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60d8c7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27686 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.220778:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60d8ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.220793:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60d8ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.220804:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60d8ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.220863:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000402:0x25:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.220867:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759707.220905:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60d8c7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27686 expref: 16 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.220935:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60d8ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27686 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.220943:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff8cddc34f5b00) 00010000:00010000:1.0:1782759707.220947:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759707.220950:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759707.221348:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:112907:x1869355218586240:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1032us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.221368:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3049 00000100:00100000:1.0:1782759707.245554:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759707.245981:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586368 00000100:00100000:3.0:1782759707.245992:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586368 00000100:00100000:3.0:1782759707.246058:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3050 00000100:00100000:3.0:1782759707.246068:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:112907:x1869355218586368:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1782759707.246089:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759707.246109:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d8d5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2768d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.246144:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d8dc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.246157:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d8dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.246169:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d8dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.246283:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d8d5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2768d expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.246312:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d8dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2768d expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.246334:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff8cddc34f5b00) 00010000:00010000:3.0:1782759707.246337:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782759707.246340:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166c400, rc 0) 00000100:00100000:3.0:1782759707.246418:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:112907:x1869355218586368:12345-192.168.202.31@tcp:101:ls.0 Request processed in 351us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759707.246424:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3050 00000100:00100000:0.0:1782759707.255248:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.255415:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586496 00000100:00100000:1.0:1782759707.255426:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586496 00000100:00100000:1.0:1782759707.255490:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3051 00000100:00100000:1.0:1782759707.255500:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+20:112907:x1869355218586496:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.255522:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.255546:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60d8e3 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27694 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.255619:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60d8ea lrc: 3/1,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.255633:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.255644:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60d8ea lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.255754:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60d8e3 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27694 expref: 22 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.255773:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60d8ea lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27694 expref: 21 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.255781:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34f5600) 00010000:00010000:1.0:1782759707.255784:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759707.255788:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412600, rc 0) 00000100:00100000:1.0:1782759707.255868:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+21:112907:x1869355218586496:12345-192.168.202.31@tcp:101:ls.0 Request processed in 369us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.255877:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3051 00000100:00100000:1.0:1782759707.258480:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.258599:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586624 00000100:00100000:2.0:1782759707.258608:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586624 00000100:00100000:2.0:1782759707.258667:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3052 00000100:00100000:2.0:1782759707.258693:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+21:112907:x1869355218586624:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.258714:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.258729:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60d8f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2769b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258779:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258791:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258800:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258809:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258813:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258817:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258879:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60d906 lrc: 3/1,0 mode: --/PR res: [0x200000413:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258883:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60d906 lrc: 3/1,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.258887:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60d906 lrc: 3/1,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759707.258954:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000413:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759707.259027:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759707.259246:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60d906 lrc: 3/1,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259257:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259262:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259266:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259270:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259273:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.259276:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259281:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259354:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759707.259357:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.259362:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259369:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d8f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259394:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259400:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259405:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259411:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759707.259414:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259420:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259427:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x256cbcf9 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759707.259429:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759707.259431:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259435:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d8ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x256cbcf9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259460:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60d8f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2769b expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259471:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60d906 lrc: 3/0,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2769b expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.259486:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000413:0x1:0x0].0x0 (ffff8cddc34ff900) 00010000:00010000:2.0:1782759707.259488:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759707.259490:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648200, rc 0) 00000100:00100000:2.0:1782759707.259732:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+22:112907:x1869355218586624:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1042us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.259738:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3052 00000100:00100000:3.0:1782759707.264262:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.264523:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586752 00000100:00100000:1.0:1782759707.264534:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586752 00000100:00100000:0.0:1782759707.264686:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3053 00000100:00100000:0.0:1782759707.264701:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+22:112907:x1869355218586752:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759707.264722:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759707.264741:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60d90d lrc: 2/0,0 mode: --/PR res: [0x200000413:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276a2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.264774:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60d914 lrc: 3/1,0 mode: --/PR res: [0x200000413:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.264786:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60d914 lrc: 3/1,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.264796:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60d914 lrc: 3/1,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.265185:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60d90d lrc: 0/0,0 mode: --/PR res: [0x200000413:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276a2 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.265207:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60d914 lrc: 3/0,0 mode: PR/PR res: [0x200000413:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276a2 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759707.265215:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000413:0x1:0x0].0x0 (ffff8cddc34ff900) 00010000:00010000:0.0:1782759707.265224:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759707.265228:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802400, rc 0) 00000100:00100000:0.0:1782759707.265293:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+23:112907:x1869355218586752:12345-192.168.202.31@tcp:101:ls.0 Request processed in 596us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759707.265300:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3053 00000100:00100000:0.0:1782759707.269287:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.269813:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218586880 00000100:00100000:1.0:1782759707.269825:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218586880 00000100:00100000:1.0:1782759707.270010:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3054 00000100:00100000:1.0:1782759707.270162:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+23:112907:x1869355218586880:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.270185:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.270205:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60d91b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276a9 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270262:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270277:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270289:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270301:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270307:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270314:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270411:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60d930 lrc: 3/1,0 mode: --/PR res: [0x200000421:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270420:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60d930 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270427:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60d930 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.270468:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000421:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.270472:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759707.270491:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60d930 lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270504:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270512:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270518:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270524:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270530:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759707.270535:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270543:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270562:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759707.270565:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759707.270569:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270684:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d922 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270698:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270705:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270711:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270716:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759707.270719:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270725:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270732:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3f98a5d6 (ffff8cddc34f5f00) 00010000:00010000:1.0:1782759707.270735:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759707.270738:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270744:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d929 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3f98a5d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270782:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60d91b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276a9 expref: 25 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270795:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60d930 lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276a9 expref: 24 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.270803:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x16:0x0].0x0 (ffff8cddc34f5d00) 00010000:00010000:1.0:1782759707.270805:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759707.270808:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413400, rc 0) 00000100:00100000:1.0:1782759707.271102:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+24:112907:x1869355218586880:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1019us (1761us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.271111:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3054 00000100:00100000:1.0:1782759707.274882:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.275133:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587008 00000100:00100000:2.0:1782759707.275143:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587008 00000100:00100000:2.0:1782759707.275211:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3055 00000100:00100000:2.0:1782759707.275220:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+24:112907:x1869355218587008:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.275239:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.275259:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60d937 lrc: 2/0,0 mode: --/PR res: [0x200000421:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276b0 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.275289:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d93e lrc: 3/1,0 mode: --/PR res: [0x200000421:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.275302:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d93e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.275313:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d93e lrc: 3/1,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.275422:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60d937 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276b0 expref: 26 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.275438:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d93e lrc: 3/0,0 mode: PR/PR res: [0x200000421:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276b0 expref: 25 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.275453:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x16:0x0].0x0 (ffff8cddc34f5d00) 00010000:00010000:2.0:1782759707.275455:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759707.275459:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649a00, rc 0) 00000100:00100000:2.0:1782759707.275506:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+25:112907:x1869355218587008:12345-192.168.202.31@tcp:101:ls.0 Request processed in 287us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.275512:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3055 00000100:00100000:3.0:1782759707.280925:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.281174:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587136 00000100:00100000:1.0:1782759707.281185:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587136 00000100:00100000:1.0:1782759707.281253:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3056 00000100:00100000:1.0:1782759707.281263:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+25:112907:x1869355218587136:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.281284:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.281305:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60d945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276b7 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281367:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281381:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281409:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281424:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281431:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281438:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281519:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60d95a lrc: 3/1,0 mode: --/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281527:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60d95a lrc: 3/1,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281535:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60d95a lrc: 3/1,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.281610:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000041e:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.281614:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759707.281642:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60d95a lrc: 3/1,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281657:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281664:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281679:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281686:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281691:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759707.281696:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281702:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281715:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759707.281719:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759707.281723:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281729:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d94c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281742:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281747:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281752:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281756:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759707.281765:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281770:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281777:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc3c02e81 (ffff8cddc34f5f00) 00010000:00010000:1.0:1782759707.281779:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759707.281782:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281787:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d953 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc3c02e81 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281816:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60d945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276b7 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281828:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60d95a lrc: 3/0,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276b7 expref: 26 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.281835:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041e:0x1:0x0].0x0 (ffff8cddc34f5a00) 00010000:00010000:1.0:1782759707.281837:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759707.281839:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413600, rc 0) 00000100:00100000:1.0:1782759707.281906:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+26:112907:x1869355218587136:12345-192.168.202.31@tcp:101:ls.0 Request processed in 644us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.281923:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3056 00000100:00100000:0.0:1782759707.285690:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759707.285766:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587264 00000100:00100000:2.0:1782759707.285776:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587264 00000100:00100000:2.0:1782759707.285882:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3057 00000100:00100000:2.0:1782759707.285894:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+26:112907:x1869355218587264:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:2.0:1782759707.285930:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759707.285952:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d961 lrc: 2/0,0 mode: --/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276be expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.285988:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d968 lrc: 3/1,0 mode: --/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.286002:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d968 lrc: 3/1,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.286014:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d968 lrc: 3/1,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.286139:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649000/0xd5b45c7f5c60d961 lrc: 0/0,0 mode: --/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276be expref: 28 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.286158:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d968 lrc: 3/0,0 mode: PR/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276be expref: 27 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759707.286174:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041e:0x1:0x0].0x0 (ffff8cddc34f5a00) 00010000:00010000:2.0:1782759707.286177:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759707.286180:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759707.286243:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+27:112907:x1869355218587264:12345-192.168.202.31@tcp:101:ls.0 Request processed in 352us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759707.286251:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3057 00000100:00100000:1.0:1782759707.289924:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759707.290074:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587392 00000100:00100000:3.0:1782759707.290085:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587392 00000100:00100000:3.0:1782759707.290144:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3058 00000100:00100000:3.0:1782759707.290154:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:112907:x1869355218587392:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:3.0:1782759707.290177:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759707.290201:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d96f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276c5 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.290264:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d976 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.290277:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d976 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.290288:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d976 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759707.290331:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759707.290335:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759707.290371:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d976 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.290395:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d96f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276c5 expref: 18 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.290418:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d976 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276c5 expref: 17 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759707.290427:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3b800) 00010000:00010000:3.0:1782759707.290430:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759707.290434:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d000, rc 0) 00000100:00100000:3.0:1782759707.290486:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:112907:x1869355218587392:12345-192.168.202.31@tcp:101:ls.0 Request processed in 333us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759707.290494:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3058 00000100:00100000:3.0:1782759707.293706:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.293801:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587520 00000100:00100000:1.0:1782759707.293812:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587520 00000100:00100000:1.0:1782759707.293885:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3059 00000100:00100000:1.0:1782759707.293927:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+17:112907:x1869355218587520:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.293952:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.293972:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60d97d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276cc expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.294005:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60d984 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.294020:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60d984 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.294288:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60d984 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.294395:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60d97d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276cc expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.294414:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60d984 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276cc expref: 18 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.294422:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3b800) 00010000:00010000:1.0:1782759707.294425:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759707.294429:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412000, rc 0) 00000100:00100000:1.0:1782759707.294496:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:112907:x1869355218587520:12345-192.168.202.31@tcp:101:ls.0 Request processed in 579us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.294504:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3059 00000100:00100000:0.0:1782759707.298342:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.298428:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587648 00000100:00100000:1.0:1782759707.298436:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587648 00000100:00100000:1.0:1782759707.298511:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3060 00000100:00100000:1.0:1782759707.298531:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+27:112907:x1869355218587648:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.298551:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.298569:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60d98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276d3 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298662:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298674:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298684:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298694:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298698:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298702:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298773:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412200/0xd5b45c7f5c60d9a0 lrc: 3/1,0 mode: --/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298779:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412200/0xd5b45c7f5c60d9a0 lrc: 3/1,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298783:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412200/0xd5b45c7f5c60d9a0 lrc: 3/1,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759707.298823:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000041f:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759707.298826:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759707.298853:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412200/0xd5b45c7f5c60d9a0 lrc: 3/1,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298863:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298869:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298874:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298878:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298882:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759707.298885:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298889:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298898:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759707.298901:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759707.298905:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298911:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60d992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298943:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298949:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298955:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298960:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759707.298963:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298970:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298978:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3695317f (ffff8cddc34f5f00) 00010000:00010000:1.0:1782759707.298980:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759707.298982:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.298988:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60d999 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3695317f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.299016:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60d98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276d3 expref: 29 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.299185:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412200/0xd5b45c7f5c60d9a0 lrc: 3/0,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276d3 expref: 28 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.299199:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041f:0x1:0x0].0x0 (ffff8cddc34f5100) 00010000:00010000:1.0:1782759707.299200:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759707.299202:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412200, rc 0) 00000100:00100000:1.0:1782759707.299321:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+28:112907:x1869355218587648:12345-192.168.202.31@tcp:101:ls.0 Request processed in 790us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.299326:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3060 00000100:00100000:3.0:1782759707.302904:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759707.303150:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587776 00000100:00100000:1.0:1782759707.303159:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587776 00000100:00100000:1.0:1782759707.303254:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3061 00000100:00100000:1.0:1782759707.303264:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+28:112907:x1869355218587776:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:1.0:1782759707.303285:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759707.303305:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60d9a7 lrc: 2/0,0 mode: --/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276da expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.303338:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60d9ae lrc: 3/1,0 mode: --/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.303351:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60d9ae lrc: 3/1,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.303362:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60d9ae lrc: 3/1,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.303470:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60d9a7 lrc: 0/0,0 mode: --/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276da expref: 30 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.303487:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60d9ae lrc: 3/0,0 mode: PR/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276da expref: 29 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759707.303502:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041f:0x1:0x0].0x0 (ffff8cddc34f5100) 00010000:00010000:1.0:1782759707.303505:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759707.303508:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412e00, rc 0) 00000100:00100000:1.0:1782759707.303568:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+29:112907:x1869355218587776:12345-192.168.202.31@tcp:101:ls.0 Request processed in 305us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759707.303615:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3061 00010000:00010000:3.0:1782759707.598101:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759708.052949:0:156932:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb974a400 20000000:00000080:1.0:1782759708.052966:0:156932:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc5462c00 uarg=0000000000000000 00010000:00010000:1.0:1782759708.053468:0:156932:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 24. 00010000:00010000:1.0:1782759708.053501:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000413:0x1:0x0].0x0 (ffff8cddc34ff900) 00010000:00010000:1.0:1782759708.053504:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053515:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60d914 lrc: 0/0,0 mode: --/PR res: [0x200000413:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276a2 expref: 28 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053533:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:1.0:1782759708.053536:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053540:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd000/0xd5b45c7f5c60d7fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27632 expref: 27 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053553:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1e:0x0].0x0 (ffff8cddc34f5600) 00010000:00010000:1.0:1782759708.053555:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053559:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60d8ea lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27694 expref: 26 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053734:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041f:0x1:0x0].0x0 (ffff8cddc34f5100) 00010000:00010000:1.0:1782759708.053738:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.053753:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412200/0xd5b45c7f5c60d9a0 lrc: 0/0,0 mode: --/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276d3 expref: 25 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053769:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x13:0x0].0x0 (ffff8cddc24d2200) 00010000:00010000:1.0:1782759708.053772:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759708.053776:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dc000/0xd5b45c7f5c60d73f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275e5 expref: 24 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053796:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:1.0:1782759708.053799:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053803:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60d86c lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27663 expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053815:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000415:0x1:0x0].0x0 (ffff8cddc24d2000) 00010000:00010000:1.0:1782759708.053818:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053822:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767000/0xd5b45c7f5c60d723 lrc: 0/0,0 mode: --/PR res: [0x200000415:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275de expref: 22 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053834:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x16:0x0].0x0 (ffff8cddc34f5d00) 00010000:00010000:1.0:1782759708.053836:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053840:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649a00/0xd5b45c7f5c60d93e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276b0 expref: 21 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053852:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:1.0:1782759708.053854:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053857:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60d826 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27640 expref: 20 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053868:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff8cddc34ff500) 00010000:00010000:1.0:1782759708.053875:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759708.053880:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60d8c0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2767f expref: 19 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053896:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041e:0x1:0x0].0x0 (ffff8cddc34f5a00) 00010000:00010000:1.0:1782759708.053899:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053903:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649c00/0xd5b45c7f5c60d968 lrc: 0/0,0 mode: --/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276be expref: 18 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053924:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759708.053926:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053930:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60d6f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275d0 expref: 17 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053942:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000040f:0x2:0x0].0x0 (ffff8cddc24d2c00) 00010000:00010000:1.0:1782759708.053945:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759708.053948:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd800/0xd5b45c7f5c60d7af lrc: 0/0,0 mode: --/PR res: [0x20000040f:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2760f expref: 16 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053964:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1:0x0].0x0 (ffff8cddc24d2800) 00010000:00010000:1.0:1782759708.053967:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.053971:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5428200/0xd5b45c7f5c60d842 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2764e expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.053982:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x17:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:1.0:1782759708.053985:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.053988:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60d85e lrc: 0/0,0 mode: --/PR res: [0x200000421:0x17:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2765c expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054013:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000413:0x1:0x0].0x0 (ffff8cddc34ff900) 00010000:00010000:1.0:1782759708.054016:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054080:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60d906 lrc: 0/0,0 mode: --/PR res: [0x200000413:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2769b expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054097:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041f:0x1:0x0].0x0 (ffff8cddc34f5100) 00010000:00010000:1.0:1782759708.054099:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.054102:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60d9ae lrc: 0/0,0 mode: --/PR res: [0x20000041f:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276da expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054114:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1:0x0].0x0 (ffff8cddc24d2700) 00010000:00010000:1.0:1782759708.054116:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054120:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd4dd400/0xd5b45c7f5c60d7ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2762b expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054133:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:1.0:1782759708.054135:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759708.054139:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60d888 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2766a expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054151:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x16:0x0].0x0 (ffff8cddc34f5d00) 00010000:00010000:1.0:1782759708.054153:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054157:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60d930 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x16:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276a9 expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054169:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x1:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:1.0:1782759708.054175:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054180:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60d818 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27639 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054194:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000041e:0x1:0x0].0x0 (ffff8cddc34f5a00) 00010000:00010000:1.0:1782759708.054197:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054200:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60d95a lrc: 0/0,0 mode: --/PR res: [0x20000041e:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276b7 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054402:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000421:0x1:0x0].0x0 (ffff8cddc24d2800) 00010000:00010000:1.0:1782759708.054406:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054410:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60d834 lrc: 0/0,0 mode: --/PR res: [0x200000421:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27647 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054425:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000415:0x1:0x0].0x0 (ffff8cddc24d2000) 00010000:00010000:1.0:1782759708.054427:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759708.054431:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766a00/0xd5b45c7f5c60d715 lrc: 0/0,0 mode: --/PR res: [0x200000415:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275d7 expref: 5 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054443:0:156932:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 24 locks, left on hash table 0. 00010000:00010000:1.0:1782759708.054485:0:156932:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1782759708.054503:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x13:0x0].0x0 (ffff8cddc34f5500) 00010000:00010000:1.0:1782759708.054505:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.054510:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60d75b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275f3 expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054522:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff8cddc34f5e00) 00010000:00010000:1.0:1782759708.054524:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.054535:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60d896 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27671 expref: 16 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054548:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f5400) 00010000:00010000:1.0:1782759708.054549:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.054552:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429200/0xd5b45c7f5c60d785 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27601 expref: 15 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.054562:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc24d2100) 00010000:00010000:1.0:1782759708.054564:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.054567:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5428c00/0xd5b45c7f5c60d7d2 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27624 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055110:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3b800) 00010000:00010000:1.0:1782759708.055115:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.055121:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60d984 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276cc expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055135:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x16:0x0].0x0 (ffff8cddc24d2100) 00010000:00010000:1.0:1782759708.055137:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.055141:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd4dde00/0xd5b45c7f5c60d7c4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x16:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2761d expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055158:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff8cddc34f5b00) 00010000:00010000:1.0:1782759708.055160:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.055164:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60d8dc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2768d expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055176:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x13:0x0].0x0 (ffff8cddc34f5500) 00010000:00010000:1.0:1782759708.055184:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.055189:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5429c00/0xd5b45c7f5c60d74d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x13:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275ec expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055286:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f5400) 00010000:00010000:1.0:1782759708.055290:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.055294:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60d793 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27608 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055309:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x25:0x0].0x0 (ffff8cddc34f5b00) 00010000:00010000:1.0:1782759708.055312:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.055315:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60d8ce lrc: 0/0,0 mode: --/PR res: [0x240000402:0x25:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27686 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055327:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1:0x0].0x0 (ffff8cded3a3b800) 00010000:00010000:1.0:1782759708.055330:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.055333:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d976 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276c5 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055349:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x1d:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:1.0:1782759708.055352:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759708.055355:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60d850 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x1d:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27655 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055368:0:156932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xd:0x0].0x0 (ffff8cddc34f5e00) 00010000:00010000:1.0:1782759708.055371:0:156932:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759708.055374:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60d8a4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27678 expref: 5 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055398:0:156932:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 13 locks, left on hash table 0. 10000000:01000000:1.0:1782759708.055428:0:156932:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759708.055442:0:156932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055455:0:156932:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055464:0:156932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055501:0:156932:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.055515:0:156932:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 23 pid: 6524 timeout: 3898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759708.055529:0:156932:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156932:1869355233053184:0@lo:104: 00000100:00100000:1.0:1782759708.056370:0:156932:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759708.056504:0:156932:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec3932480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759708.058873:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053184 00000100:00100000:2.0:1782759708.058887:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053184 00000100:00100000:2.0:1782759708.058995:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1782759708.059008:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:156932:x1869355233053184:12345-0@lo:104: 00010000:00010000:2.0:1782759708.059158:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.059421:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759708.059428:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:156932:x1869355233053184:12345-0@lo:104: Request processed in 424us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759708.059435:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00010000:00010000:3.0:1782759708.059504:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759708.059511:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759708.059519:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ca00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759708.059523:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759708.059532:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759708.059540:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759708.059560:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759708.059626:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759708.059632:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759708.059659:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759708.059666:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d56a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d571 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759708.059699:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759708.059701:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759708.059703:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759708.059710:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759708.059720:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233053312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759708.059759:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759708.060987:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053312 00000100:00100000:2.0:1782759708.060997:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053312 00010000:00010000:2.0:1782759708.061059:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 24 pid: 6524 timeout: 3898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759708.061096:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:2.0:1782759708.061107:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233053312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759708.061123:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759708.061129:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 24 pid: 6524 timeout: 3898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061152:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 24 pid: 6524 timeout: 3898 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061173:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061181:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061196:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061202:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061221:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061226:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061231:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759708.061236:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061244:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061252:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759708.061274:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759708.061395:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233053312:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759708.061403:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00010000:00010000:1.0:1782759708.061968:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429e00/0xd5b45c7f5c60d571 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d56a expref: 23 pid: 6524 timeout: 3898 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759708.061982:0:156932:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:156932:1869355233053184:0@lo:104: 00010000:00010000:1.0:1782759708.062000:0:156932:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.062009:0:156932:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.062077:0:156932:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759708.062083:0:156932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60d9b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 156932 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759708.062304:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233053312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759708.554820:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759708.554847:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233053440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759708.558727:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759708.558832:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053440 00000100:00100000:0.0:1782759708.558840:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053440 00000100:00100000:0.0:1782759708.558894:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434 00000100:00100000:0.0:1782759708.558913:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233053440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759708.558951:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:0.0:1782759708.559019:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233053440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759708.559026:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434 00000100:00100000:1.0:1782759708.559126:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233053440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759708.623059:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759709.578821:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233053824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.578893:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759709.578952:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233054336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.578976:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759709.578997:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233054848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579013:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759709.579033:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782759709.579038:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233053952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579055:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759709.579066:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233054464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579083:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759709.579096:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233054976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579111:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759709.579137:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054336 00000100:00100000:2.0:1782759709.579143:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054336 00000100:00100000:2.0:1782759709.579188:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054848 00000100:00100000:2.0:1782759709.579190:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054848 00000100:00100000:2.0:1782759709.579222:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053952 00000100:00100000:2.0:1782759709.579224:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053952 00000100:00100000:2.0:1782759709.579242:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5354 00000100:00100000:2.0:1782759709.579249:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579314:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233054336:12345-0@lo:400:kworker.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.579321:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5354 00000100:00100000:2.0:1782759709.579336:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5355 00000100:00100000:2.0:1782759709.579352:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579374:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233054848:12345-0@lo:400:kworker.0 Request processed in 24us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.579388:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5355 00000100:00100000:2.0:1782759709.579397:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5356 00000100:00100000:2.0:1782759709.579403:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233053952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579423:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233053952:12345-0@lo:400:kworker.0 Request processed in 21us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.579428:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5356 00000100:00100000:2.0:1782759709.579442:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054464 00000100:00100000:2.0:1782759709.579445:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054464 00000100:00100000:2.0:1782759709.579466:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054976 00000100:00100000:2.0:1782759709.579468:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054976 00000100:00100000:2.0:1782759709.579479:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1782759709.579485:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233054464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579510:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233054464:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.579516:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3124 00000100:00100000:2.0:1782759709.579525:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3125 00000100:00100000:2.0:1782759709.579531:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233054976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579552:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233054976:12345-0@lo:400:kworker.0 Request processed in 22us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.579565:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3125 00000100:00080000:2.0:1782759709.579635:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759709.579639:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759709.579642:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759709.579678:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233053952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579687:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233054464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579695:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233054976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579702:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233054336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.579710:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233054848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580130:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233053568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580168:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580207:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233054080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580226:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580242:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233054592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580259:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580281:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233055104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580298:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580313:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759709.580326:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233053696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580347:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580360:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233054208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580376:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580400:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233054720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580417:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759709.580438:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053824 00000100:00100000:3.0:1782759709.580441:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053824 00000100:00100000:3.0:1782759709.580478:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054080 00000100:00100000:3.0:1782759709.580480:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054080 00000100:00100000:3.0:1782759709.580491:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3435 00000100:00100000:3.0:1782759709.580496:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233053824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580530:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233053824:12345-0@lo:400:kworker.0 Request processed in 33us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.580536:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3435 00000100:00100000:3.0:1782759709.580547:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3436 00000100:00100000:3.0:1782759709.580552:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233054080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580600:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233054080:12345-0@lo:400:kworker.0 Request processed in 23us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.580606:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3436 00000100:00100000:3.0:1782759709.580620:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053696 00000100:00100000:3.0:1782759709.580623:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053696 00000100:00100000:3.0:1782759709.580638:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054208 00000100:00100000:3.0:1782759709.580640:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054208 00000100:00100000:3.0:1782759709.580651:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054720 00000100:00100000:3.0:1782759709.580653:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054720 00000100:00100000:3.0:1782759709.580665:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5357 00000100:00100000:3.0:1782759709.580669:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233053696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580699:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233053696:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.580705:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5357 00000100:00100000:3.0:1782759709.580714:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5358 00000100:00100000:3.0:1782759709.580719:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233054208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580738:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233054208:12345-0@lo:400:kworker.0 Request processed in 18us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.580743:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5358 00000100:00100000:3.0:1782759709.580750:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5359 00000100:00100000:3.0:1782759709.580755:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233054720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.580773:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233054720:12345-0@lo:400:kworker.0 Request processed in 18us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.580778:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5359 00000100:00100000:3.0:1782759709.581330:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233054592 00000100:00100000:3.0:1782759709.581335:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233054592 00000100:00100000:3.0:1782759709.581367:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055104 00000100:00100000:3.0:1782759709.581370:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055104 00000100:00100000:3.0:1782759709.581394:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1782759709.581400:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233054592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581434:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233054592:12345-0@lo:400:kworker.0 Request processed in 35us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.581440:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3126 00000100:00100000:3.0:1782759709.581450:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3127 00000100:00100000:3.0:1782759709.581454:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233055104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581475:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233055104:12345-0@lo:400:kworker.0 Request processed in 21us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759709.581490:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3127 00000100:00100000:3.0:1782759709.581545:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233053696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581556:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233054208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581564:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233054720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581573:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233054080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581604:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233054592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581613:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233055104:0@lo:400:kworker.0 00000100:00100000:3.0:1782759709.581647:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233053824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.582503:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233053568 00000100:00100000:2.0:1782759709.582511:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233053568 00000100:00100000:2.0:1782759709.582547:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:2.0:1782759709.582554:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233053568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759709.582634:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233053568:12345-0@lo:400:kworker.0 Request processed in 80us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759709.582640:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00080000:2.0:1782759709.582672:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759709.582676:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759709.582679:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759709.582756:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233053568:0@lo:400:kworker.0 00010000:00010000:3.0:1782759709.642829:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759709.642912:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759709.642916:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759709.642921:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759709.642968:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759709.642986:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759709.643006:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759709.643049:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233055232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759709.643121:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759709.643226:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759709.645046:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055232 00000100:00100000:3.0:1782759709.645061:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055232 00000100:00100000:0.0:1782759709.645906:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:0.0:1782759709.645917:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233055232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759709.645934:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759709.645953:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d9bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759709.645983:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759709.646004:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759709.646014:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803e00, rc 0) 00000100:00100000:0.0:1782759709.646107:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233055232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759709.646114:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:3.0:1782759709.646476:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233055232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759709.646496:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759709.646506:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759709.646527:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759709.646533:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759709.646541:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759710.093326:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233055360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759710.093504:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759710.094346:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055360 00000100:00100000:2.0:1782759710.094426:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055360 00000100:00100000:2.0:1782759710.094480:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2768 00000100:00100000:2.0:1782759710.094489:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233055360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759710.094518:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922780160 avail 3691257856 00000100:00100000:2.0:1782759710.094602:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233055360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759710.094617:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2768 00000100:00100000:1.0:1782759710.094801:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233055360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759710.095083:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759710.105971:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233055488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759710.106054:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759710.109646:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055488 00000100:00100000:2.0:1782759710.109661:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055488 00000100:00100000:2.0:1782759710.109729:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2769 00000100:00100000:2.0:1782759710.109741:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233055488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759710.109772:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922780160 avail 3691257856 00000100:00100000:2.0:1782759710.109862:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233055488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759710.109868:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2769 00000100:00100000:1.0:1782759710.110115:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233055488:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759710.667764:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759711.114752:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759711.114779:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233055616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759711.114862:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759711.114941:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055616 00000100:00100000:3.0:1782759711.114949:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055616 00000100:00100000:3.0:1782759711.115010:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3437 00000100:00100000:3.0:1782759711.115019:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233055616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759711.115053:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446121472 avail 1299881984 00000100:00100000:3.0:1782759711.115098:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233055616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759711.115104:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3437 00000100:00100000:3.0:1782759711.115148:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233055616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759711.118659:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233055872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759711.118725:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759711.118775:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759711.118783:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233055744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759711.118820:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759711.118849:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055872 00000100:00100000:0.0:1782759711.118855:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055872 00000100:00100000:0.0:1782759711.118907:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233055744 00000100:00100000:0.0:1782759711.118910:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233055744 00000100:00100000:0.0:1782759711.118945:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1782759711.118953:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233055872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759711.118983:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759711.119026:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233055872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759711.119034:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2770 00000100:00100000:0.0:1782759711.119048:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2771 00000100:00100000:0.0:1782759711.119054:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233055744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759711.119064:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759711.119084:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233055744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759711.119090:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2771 00000100:00080000:0.0:1782759711.119103:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759711.119134:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233055744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759711.119145:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233055872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759711.460210:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759711.460244:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759711.460267:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759711.460288:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759711.460308:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759711.460332:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218587904 00000100:00100000:3.0:1782759711.460340:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218587904 00000100:00100000:3.0:1782759711.460387:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3400 00000100:00100000:3.0:1782759711.460397:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218587904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759711.461946:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218587904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1540us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759711.461959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3400 00000100:00100000:3.0:1782759711.462021:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588160 00000100:00100000:3.0:1782759711.462028:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588160 00000100:00100000:3.0:1782759711.462073:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588032 00000100:00100000:3.0:1782759711.462076:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588032 00000100:00100000:3.0:1782759711.462095:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5360 00000100:00100000:3.0:1782759711.462102:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218588160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759711.462133:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218588160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759711.462139:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5360 00000100:00100000:3.0:1782759711.462150:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5361 00000100:00100000:3.0:1782759711.462155:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218588032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759711.462174:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218588032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 19us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759711.462179:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5361 00000100:00100000:3.0:1782759711.462194:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588416 00000100:00100000:3.0:1782759711.462198:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588416 00000100:00100000:3.0:1782759711.462231:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588288 00000100:00100000:3.0:1782759711.462234:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588288 00000100:00100000:3.0:1782759711.462252:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3128 00000100:00100000:3.0:1782759711.462257:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218588416:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759711.462280:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218588416:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759711.462285:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3128 00000100:00100000:3.0:1782759711.462294:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3129 00000100:00100000:3.0:1782759711.462300:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218588288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759711.462319:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218588288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759711.462331:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3129 00000100:00080000:3.0:1782759711.462458:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759711.462462:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759711.462465:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759711.462467:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782759711.693697:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759712.124457:0:157127:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc471b6230 20000000:00000080:2.0:1782759712.124476:0:157127:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedb718c00 uarg=0000000000000000 00010000:00010000:2.0:1782759712.124998:0:157127:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759712.125017:0:157127:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759712.125042:0:157127:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759712.125054:0:157127:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759712.125070:0:157127:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759712.125088:0:157127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759712.125105:0:157127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759712.125113:0:157127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759712.125164:0:157127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759712.125186:0:157127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 23 pid: 6524 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759712.125203:0:157127:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:157127:1869355233056000:0@lo:104: 00000100:00100000:2.0:1782759712.125269:0:157127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759712.125325:0:157127:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759712.125459:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056000 00000100:00100000:0.0:1782759712.125467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056000 00000100:00100000:0.0:1782759712.125520:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:0.0:1782759712.125529:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:157127:x1869355233056000:12345-0@lo:104: 00010000:00010000:0.0:1782759712.125552:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759712.125652:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759712.125659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:157127:x1869355233056000:12345-0@lo:104: Request processed in 132us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759712.125666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00010000:00010000:0.0:1782759712.125686:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759712.125692:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759712.125698:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759712.125702:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759712.125710:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759712.125717:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759712.125723:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759712.125748:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759712.125754:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759712.125774:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759712.125781:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60d9bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d9c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759712.125996:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759712.125998:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759712.126000:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759712.126012:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233056128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759712.126042:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759712.126146:0:157127:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:157127:1869355233056000:0@lo:104: 00010000:00010000:2.0:1782759712.126169:0:157127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759712.128460:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056128 00000100:00100000:3.0:1782759712.128473:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056128 00010000:00010000:3.0:1782759712.128514:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 24 pid: 6524 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759712.128858:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1782759712.128869:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233056128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759712.128895:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759712.128902:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 24 pid: 6524 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128915:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 24 pid: 6524 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128932:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803e00/0xd5b45c7f5c60d9c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9bc expref: 24 pid: 6524 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128947:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128955:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128970:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128989:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.128996:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.129003:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.129009:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759712.129014:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.129023:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759712.129217:0:157127:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759712.129226:0:157127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.130229:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.130245:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60d9ca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759712.130267:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759712.130749:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233056128:12345-0@lo:103:ldlm_bl.0 Request processed in 1881us (4704us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759712.130757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:0.0:1782759712.130972:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233056128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759712.714900:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759713.674809:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233056256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759713.674934:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759713.674981:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056256 00000100:00100000:3.0:1782759713.674989:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056256 00000100:00100000:3.0:1782759713.675057:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3438 00000100:00100000:3.0:1782759713.675067:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233056256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759713.680757:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:3.0:1782759713.680885:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233056256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5815us (5946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759713.680897:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3438 00000100:00100000:3.0:1782759713.681036:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233056256:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759713.741511:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759713.930638:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759713.930647:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759713.930651:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759713.930701:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759713.930714:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759713.930725:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759713.930765:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233056384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759713.931019:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759713.931080:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759713.931206:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056384 00000100:00100000:2.0:1782759713.931214:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056384 00000100:00100000:2.0:1782759713.931284:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:2.0:1782759713.931295:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233056384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759713.931309:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759713.931323:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60d9d1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759713.931461:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759713.931486:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759713.931494:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648400, rc 0) 00000100:00100000:2.0:1782759713.931540:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233056384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 247us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759713.931546:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000100:00100000:1.0:1782759713.931872:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233056384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759713.931888:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759713.931897:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759713.931917:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759713.931922:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759713.931936:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759714.698873:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233056640:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.698888:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233056896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.698962:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233056512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.699027:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233056768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.699072:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759714.699077:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759714.699141:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759714.699404:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056640 00000100:00100000:0.0:1782759714.699412:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056640 00000100:00100000:0.0:1782759714.699646:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056896 00000100:00100000:0.0:1782759714.699651:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056896 00000100:00100000:3.0:1782759714.699685:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233057280:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.699694:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3439 00000100:00100000:1.0:1782759714.699706:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233056640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.699724:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759714.699748:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233057792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.699902:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233056640:12345-0@lo:400:kworker.0 Request processed in 197us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759714.699910:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3439 00000100:00100000:1.0:1782759714.699931:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3440 00000100:00100000:1.0:1782759714.699937:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233056896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.700057:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233056896:12345-0@lo:400:kworker.0 Request processed in 119us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759714.700064:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3440 00000100:00100000:1.0:1782759714.700109:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233056896:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.700117:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233057408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.700374:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759714.700447:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233057920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.700472:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759714.700690:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057280 00000100:00100000:0.0:1782759714.700696:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057280 00000100:00100000:0.0:1782759714.700736:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057408 00000100:00100000:0.0:1782759714.700739:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057408 00000100:00100000:0.0:1782759714.700764:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057920 00000100:00100000:0.0:1782759714.700767:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057920 00000100:00100000:0.0:1782759714.700792:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3130 00000100:00100000:0.0:1782759714.700799:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233057280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.700840:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233057280:12345-0@lo:400:kworker.0 Request processed in 42us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759714.700846:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3130 00000100:00100000:0.0:1782759714.700871:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3131 00000100:00100000:0.0:1782759714.700892:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233057408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.700930:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233057408:12345-0@lo:400:kworker.0 Request processed in 39us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759714.700936:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3131 00000100:00100000:0.0:1782759714.700948:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3132 00000100:00100000:0.0:1782759714.700954:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.700993:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233057920:12345-0@lo:400:kworker.0 Request processed in 39us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759714.700999:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3132 00000100:00100000:1.0:1782759714.701433:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233057408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.701444:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233057920:0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.707300:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759714.707375:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233057024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.707394:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056768 00000100:00100000:0.0:1782759714.707404:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056768 00000100:00100000:2.0:1782759714.707421:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759714.707452:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233057536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.707466:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233056512 00000100:00100000:0.0:1782759714.707471:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233056512 00000100:00100000:2.0:1782759714.707481:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759714.707514:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057024 00000100:00100000:0.0:1782759714.707518:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057024 00000100:00100000:2.0:1782759714.707529:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057536 00000100:00100000:2.0:1782759714.707535:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057536 00000100:00100000:0.0:1782759714.707546:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5362 00000100:00100000:0.0:1782759714.707557:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233056768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.707574:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5363 00000100:00100000:2.0:1782759714.707605:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233056512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.707663:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233056512:12345-0@lo:400:kworker.0 Request processed in 59us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759714.707669:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233056768:12345-0@lo:400:kworker.0 Request processed in 111us (8597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759714.707674:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5363 00000100:00100000:0.0:1782759714.707683:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5362 00000100:00100000:2.0:1782759714.707700:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5364 00000100:00100000:0.0:1782759714.707706:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5365 00000100:00100000:2.0:1782759714.707712:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233057024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.707720:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233057536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.707747:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233057024:12345-0@lo:400:kworker.0 Request processed in 40us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759714.707775:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5364 00000100:00100000:2.0:1782759714.707817:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233056512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.707827:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233057024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.707835:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233057536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.708375:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233057536:12345-0@lo:400:kworker.0 Request processed in 55us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759714.708387:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5365 00000100:00080000:3.0:1782759714.709434:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759714.709455:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759714.709458:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759714.709511:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233056640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.709524:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233057152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.709574:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759714.709639:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233057664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.709662:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759714.709713:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759714.709757:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233056768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759714.709772:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233057280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.709885:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057152 00000100:00100000:2.0:1782759714.709892:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057152 00000100:00100000:0.0:1782759714.709935:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057664 00000100:00100000:0.0:1782759714.709941:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057664 00000100:00100000:2.0:1782759714.709951:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5366 00000100:00080000:3.0:1782759714.709993:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759714.710065:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5367 00000100:00100000:1.0:1782759714.710111:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233057792 00000100:00100000:1.0:1782759714.710121:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233057792 00000100:00100000:1.0:1782759714.710170:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3133 00000100:00100000:1.0:1782759714.710178:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233057792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759714.710231:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233057792:12345-0@lo:400:kworker.0 Request processed in 54us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759714.710238:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3133 00000100:00100000:1.0:1782759714.710283:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233057792:0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.719250:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233057152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759714.719387:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233057152:12345-0@lo:400:kworker.0 Request processed in 9426us (9812us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759714.719398:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5366 00000100:00100000:1.0:1782759714.719718:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233057152:0@lo:400:kworker.0 00000100:00080000:3.0:1782759714.728097:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759714.729633:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233057664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759714.729738:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233057664:12345-0@lo:400:kworker.0 Request processed in 19665us (20073us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759714.729749:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5367 00000100:00100000:3.0:1782759714.733064:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233057664:0@lo:400:kworker.0 00010000:00010000:3.0:1782759714.767365:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759715.224363:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233058048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759715.224435:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759715.225695:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058048 00000100:00100000:3.0:1782759715.225707:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058048 00000100:00100000:3.0:1782759715.225781:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2772 00000100:00100000:3.0:1782759715.225793:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233058048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759715.225825:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922780160 avail 3691257856 00000100:00100000:3.0:1782759715.225901:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233058048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759715.225908:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2772 00000100:00100000:3.0:1782759715.225965:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233058048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759715.230908:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759715.230977:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.231086:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058176 00000100:00100000:0.0:1782759715.231094:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058176 00000100:00100000:0.0:1782759715.231146:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2773 00000100:00100000:0.0:1782759715.231155:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233058176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759715.231184:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922780160 avail 3691257856 00000100:00100000:0.0:1782759715.231244:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233058176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759715.231252:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2773 00000100:00100000:3.0:1782759715.233066:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233058176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759715.544623:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759715.544752:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588672 00000100:00100000:3.0:1782759715.544763:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588672 00000100:00100000:3.0:1782759715.544837:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3062 00000100:00100000:3.0:1782759715.544860:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:113055:x1869355218588672:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1782759715.544883:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759715.544886:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782759715.544889:0:6533:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60d785) 00010000:00010000:3.0:1782759715.544891:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759715.544911:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d9df lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276e1 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.545013:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.545027:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.545038:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.545094:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.545102:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.545128:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759715.545267:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355233058304:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759715.545332:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759715.545382:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759715.545409:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058304 00000100:00100000:3.0:1782759715.545413:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058304 00000100:00100000:3.0:1782759715.545456:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3441 00000100:00100000:3.0:1782759715.545463:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6533:x1869355233058304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782759715.545525:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6533:x1869355233058304:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759715.545532:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3441 00000100:00100000:3.0:1782759715.545571:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:6533:1869355233058304:0@lo:1000:mdt00_002.0 00000004:00080000:3.0:1782759715.545997:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x17:0x0], index 1: 0 00010000:00010000:3.0:1782759715.546143:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d9f4 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546154:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546162:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d9f4 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546190:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546197:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546208:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546215:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546220:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759715.546224:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546232:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546243:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cded3a3be00) 00010000:00010000:3.0:1782759715.546246:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759715.546250:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546256:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60d9e6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759715.546271:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000309699ef reply state 00000000939c5bd5 transno 4294967732 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546281:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546287:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:3.0:1782759715.546290:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759715.546292:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759715.546323:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60d9df lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276e1 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546350:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276e1 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.546358:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x27:0x0].0x0 (ffff8cded3a3b300) 00010000:00010000:3.0:1782759715.546360:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759715.546362:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdec166d000, rc 0) 00000100:00100000:3.0:1782759715.546412:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:113055:x1869355218588672:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1566us (1842us total) trans 4294967732 rc 0/0 00000100:00100000:3.0:1782759715.546419:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3062 00000100:00080000:0.0:1782759715.546837:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759715.570792:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759715.574682:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588800 00000100:00100000:3.0:1782759715.574698:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588800 00000100:00100000:3.0:1782759715.574800:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 48 00000100:00100000:3.0:1782759715.574810:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218588800:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759715.574871:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782759715.574881:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.574898:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3755s v=(0 0) 00010000:00010000:3.0:1782759715.574902:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759715.574909:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.574924:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759715.575530:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759715.612416:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.612436:0:125830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.612463:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233058432:0@lo:101:ll_ost_io00_003.0 00000100:00100000:0.0:1782759715.612526:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.612619:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759715.612644:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058432 00000100:00100000:0.0:1782759715.612650:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058432 00000100:00100000:0.0:1782759715.612712:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782759715.612720:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+6:125830:x1869355233058432:12345-0@lo:101:ll_ost_io00_003.0 00010000:00010000:0.0:1782759715.612735:0:66654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759715.612748:0:66654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60da09 expref: -99 pid: 66654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.612983:0:66654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.612995:0:66654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.613009:0:66654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802600, rc 0) 00000100:00100000:0.0:1782759715.613054:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233058432:12345-0@lo:101:ll_ost_io00_003.0 Request processed in 334us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759715.613061:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1782759715.613124:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233058432:0@lo:101:ll_ost_io00_003.0 00010000:00010000:0.0:1782759715.613140:0:125830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.613149:0:125830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.613170:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.613180:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000001:00080000:3.0:1782759715.622715:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967418 is committed 00002000:00010000:0.0:1782759715.623624:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1782759715.623630:0:125830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb mtime from disk: 0 -> 1782759716 00002000:00010000:0.0:1782759715.623633:0:125830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb ctime from disk: 0 -> 1782759716 00002000:00010000:0.0:1782759715.623639:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:0.0:1782759715.623654:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.623668:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.623681:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.623689:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759715.623694:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.623704:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.623727:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.623735:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da02 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.623838:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218588800:12345-192.168.202.31@tcp:4:dd.0 Request processed in 49023us (53045us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1782759715.623878:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 48 00000100:00100000:3.0:1782759715.632632:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759715.632676:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218588928 00000100:00100000:3.0:1782759715.632686:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218588928 00000100:00100000:3.0:1782759715.633195:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 49 00000100:00100000:3.0:1782759715.633207:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218588928:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759715.633261:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 1048576, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x800 00010000:00010000:3.0:1782759715.633271:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.633287:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3755s v=(0 0) 00010000:00010000:3.0:1782759715.633291:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759715.633298:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.633312:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.661626:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:2.0:1782759715.661686:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233058560:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759715.661747:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759715.661796:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759715.662725:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058560 00000100:00100000:1.0:1782759715.662736:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058560 00000100:00100000:1.0:1782759715.662794:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1782759715.662804:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9332450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233058560:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:1.0:1782759715.662837:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759715.663105:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9332450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233058560:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 302us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759715.663113:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1782759715.663313:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233058560:0@lo:601:ll_ost_io00_002.0 00010000:00010000:3.0:1782759715.663348:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782759715.663359:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000001:00080000:3.0:1782759715.676428:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967419 is committed 00002000:00010000:2.0:1782759715.676685:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1782759715.676690:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:2.0:1782759715.676705:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.676717:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.676742:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.676749:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759715.676753:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.676763:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.676794:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.676803:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da17 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759715.676918:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218588928:12345-192.168.202.31@tcp:4:dd.0 Request processed in 43709us (44294us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1782759715.676930:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 49 00000100:00100000:2.0:1782759715.702622:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759715.703164:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589056 00000100:00100000:3.0:1782759715.703177:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589056 00000100:00100000:3.0:1782759715.703253:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00100000:3.0:1782759715.703263:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218589056:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759715.703317:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 2097152, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x1000 00010000:00010000:3.0:1782759715.703328:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.703345:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3755s v=(0 0) 00010000:00010000:3.0:1782759715.703350:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759715.703357:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.703372:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.729009:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000100:00100000:3.0:1782759715.729064:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233058688:0@lo:601:ll_ost_io00_001.0 00000100:00100000:3.0:1782759715.729127:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759715.729189:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759715.729192:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058688 00000100:00100000:1.0:1782759715.729202:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058688 00000100:00100000:1.0:1782759715.729263:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1782759715.729273:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233058688:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:1.0:1782759715.729303:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759715.729528:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233058688:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 255us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759715.729550:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1782759715.729670:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233058688:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759715.729704:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00010000:00010000:0.0:1782759715.729715:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000001:00080000:3.0:1782759715.736465:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967420 is committed 00002000:00010000:0.0:1782759715.749041:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1782759715.749051:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:0.0:1782759715.749066:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.749080:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.749089:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.749097:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759715.749101:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.749111:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.749155:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.749163:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da1e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.749272:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218589056:12345-192.168.202.31@tcp:4:dd.0 Request processed in 46005us (46700us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1782759715.749283:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 50 00000100:00100000:2.0:1782759715.761176:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759715.761270:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589184 00000100:00100000:0.0:1782759715.761281:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589184 00000100:00100000:0.0:1782759715.761354:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 51 00000100:00100000:0.0:1782759715.761364:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218589184:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759715.761412:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 3145728, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x1800 00010000:00010000:0.0:1782759715.761424:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.761439:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:0.0:1782759715.761443:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759715.761449:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.761462:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.769858:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:0.0:1782759715.769911:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233058816:0@lo:601:ll_ost_io00_000.0 00000100:00100000:0.0:1782759715.769971:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.770032:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759715.770483:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058816 00000100:00100000:3.0:1782759715.770490:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058816 00000100:00100000:3.0:1782759715.770561:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1782759715.770570:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233058816:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:3.0:1782759715.770625:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759715.770837:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233058816:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 267us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759715.770856:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1782759715.770999:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233058816:0@lo:601:ll_ost_io00_000.0 00010000:00010000:0.0:1782759715.771037:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:0.0:1782759715.771049:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:3.0:1782759715.778273:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967421 is committed 00002000:00010000:0.0:1782759715.778411:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1782759715.778417:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:0.0:1782759715.778431:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.778445:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.778455:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.778462:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759715.778477:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.778487:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.778508:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.778515:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da25 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.778626:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218589184:12345-192.168.202.31@tcp:4:dd.0 Request processed in 17258us (17454us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1782759715.778636:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 51 00010000:00010000:2.0:1782759715.786779:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759715.787667:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759715.790110:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589312 00000100:00100000:0.0:1782759715.790123:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589312 00000100:00100000:0.0:1782759715.790235:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 52 00000100:00100000:0.0:1782759715.790245:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218589312:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759715.790294:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 4194304, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x2000 00010000:00010000:0.0:1782759715.790304:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.790319:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:0.0:1782759715.790324:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759715.790331:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.790364:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.810913:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:0.0:1782759715.810967:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233058944:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759715.811023:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.811073:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759715.811296:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233058944 00000100:00100000:1.0:1782759715.811305:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233058944 00000100:00100000:1.0:1782759715.811370:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1782759715.811381:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233058944:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:1.0:1782759715.811412:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759715.811673:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233058944:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 292us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759715.811681:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1782759715.812098:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233058944:0@lo:601:ll_ost_io00_003.0 00010000:00010000:0.0:1782759715.812126:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1782759715.812186:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:0.0:1782759715.817410:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967422 is committed 00002000:00010000:2.0:1782759715.817686:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1782759715.817690:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:2.0:1782759715.817716:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.817728:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.817736:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.817743:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759715.817747:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.817757:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.817787:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.817796:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd127e05/0xd5b45c7f5c60da2c lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759715.819068:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218589312:12345-192.168.202.31@tcp:4:dd.0 Request processed in 28332us (30917us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1782759715.819081:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 52 00000100:00100000:2.0:1782759715.830826:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759715.831103:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589440 00000100:00100000:3.0:1782759715.831113:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589440 00000100:00100000:3.0:1782759715.831191:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00100000:3.0:1782759715.831202:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218589440:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759715.831254:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 5242880, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x2800 00010000:00010000:3.0:1782759715.831264:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.831281:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:3.0:1782759715.831286:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759715.831292:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.831305:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.852870:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:2.0:1782759715.852936:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233059072:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759715.853007:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.853143:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059072 00000100:00100000:0.0:1782759715.853149:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059072 00000100:00100000:0.0:1782759715.853193:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1782759715.853202:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233059072:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:0.0:1782759715.853230:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.853410:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233059072:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 208us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759715.853427:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1782759715.853560:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759715.853606:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233059072:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759715.853629:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1782759715.853638:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:0.0:1782759715.863720:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967423 is committed 00002000:00010000:2.0:1782759715.863981:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1782759715.863986:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:2.0:1782759715.864007:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.864021:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.864030:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.864036:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759715.864041:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.864068:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.864089:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.864097:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000153d21fc/0xd5b45c7f5c60da33 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759715.864196:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218589440:12345-192.168.202.31@tcp:4:dd.0 Request processed in 32992us (33376us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1782759715.864208:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 53 00000100:00100000:1.0:1782759715.869448:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759715.869621:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589568 00000100:00100000:3.0:1782759715.869632:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589568 00000100:00100000:3.0:1782759715.869720:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:3.0:1782759715.869731:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218589568:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759715.869790:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 6291456, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x3000 00010000:00010000:3.0:1782759715.869799:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.869815:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:3.0:1782759715.869820:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759715.869826:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759715.869839:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.903419:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:2.0:1782759715.904165:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233059200:0@lo:601:ll_ost_io00_001.0 00000100:00100000:2.0:1782759715.904227:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759715.904346:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759715.904432:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059200 00000100:00100000:0.0:1782759715.904441:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059200 00000100:00100000:0.0:1782759715.904498:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1782759715.904508:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233059200:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:0.0:1782759715.904537:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759715.904755:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233059200:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 247us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759715.904762:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1782759715.904925:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233059200:0@lo:601:ll_ost_io00_001.0 00010000:00010000:2.0:1782759715.904961:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782759715.904972:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000001:00080000:2.0:1782759715.910175:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967424 is committed 00002000:00010000:1.0:1782759715.917047:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1782759715.917058:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:1.0:1782759715.917074:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.917087:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.917096:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.917103:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166d800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759715.917107:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.917135:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.917155:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.917163:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ec1fc12/0xd5b45c7f5c60da3a lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759715.917257:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218589568:12345-192.168.202.31@tcp:4:dd.0 Request processed in 47525us (47816us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1782759715.917268:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 54 00000100:00100000:1.0:1782759715.928240:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759715.928500:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589696 00000100:00100000:0.0:1782759715.928510:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589696 00000100:00100000:0.0:1782759715.928612:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:0.0:1782759715.928622:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218589696:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759715.928671:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 7340032, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x3800 00010000:00010000:0.0:1782759715.928681:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.928696:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:0.0:1782759715.928700:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759715.928706:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.928719:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.943716:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:0.0:1782759715.943777:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233059328:0@lo:601:ll_ost_io00_000.0 00000100:00100000:0.0:1782759715.943835:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.944019:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759715.944278:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059328 00000100:00100000:2.0:1782759715.944286:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059328 00000100:00100000:2.0:1782759715.944349:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1782759715.944371:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233059328:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:2.0:1782759715.944400:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759715.944605:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233059328:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 247us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759715.944612:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1782759715.948478:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233059328:0@lo:601:ll_ost_io00_000.0 00010000:00010000:0.0:1782759715.948535:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1782759715.948550:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:0.0:1782759715.956513:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967425 is committed 00002000:00010000:1.0:1782759715.956671:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:1.0:1782759715.956676:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:1.0:1782759715.956691:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.956704:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.956714:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.956722:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759715.956741:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.956751:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.956785:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759715.956795:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60da41 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759715.956907:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218589696:12345-192.168.202.31@tcp:4:dd.0 Request processed in 28272us (28663us total) trans 4294967425 rc 0/0 00000100:00100000:1.0:1782759715.956918:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 55 00000100:00100000:1.0:1782759715.966214:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759715.966288:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589824 00000100:00100000:2.0:1782759715.966299:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589824 00000100:00100000:2.0:1782759715.966409:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 56 00000100:00100000:2.0:1782759715.966422:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218589824:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759715.966479:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 8388608, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x4000 00010000:00010000:2.0:1782759715.966489:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.966505:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:2.0:1782759715.966509:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759715.966515:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759715.966529:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759715.993640:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:0.0:1782759715.993695:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233059456:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759715.993757:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.993827:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759715.995639:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059456 00000100:00100000:2.0:1782759715.995651:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059456 00000100:00100000:2.0:1782759715.995718:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1782759715.995729:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9331050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233059456:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:2.0:1782759715.995762:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759715.996049:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9331050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233059456:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 321us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759715.996057:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1782759715.996191:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233059456:0@lo:601:ll_ost_io00_003.0 00010000:00010000:3.0:1782759715.996228:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1782759715.996239:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:0.0:1782759715.998970:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480a80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233059584:0@lo:106: 00000100:00100000:0.0:1782759715.999042:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759715.999094:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759715.999170:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759715.999185:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059584 00000100:00100000:1.0:1782759715.999192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059584 00000100:00100000:1.0:1782759715.999240:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1782759715.999250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf62a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233059584:12345-0@lo:106: 00010000:00010000:1.0:1782759715.999261:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759715.999272:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759715.999341:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf62a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233059584:12345-0@lo:106: Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759715.999357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:0.0:1782759715.999907:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480a80 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233059584:0@lo:106: 00000001:00080000:3.0:1782759716.001365:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967426 is committed 00002000:00010000:0.0:1782759716.001517:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:0.0:1782759716.001532:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:0.0:1782759716.001546:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.001559:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.001568:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.001614:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759716.001620:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.001630:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.001649:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.001658:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c851b5/0xd5b45c7f5c60da48 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759716.001750:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218589824:12345-192.168.202.31@tcp:4:dd.0 Request processed in 35328us (35543us total) trans 4294967426 rc 0/0 00000100:00100000:0.0:1782759716.001760:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 56 00000100:00100000:2.0:1782759716.015729:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759716.015879:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218589952 00000100:00100000:0.0:1782759716.015902:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218589952 00000100:00100000:0.0:1782759716.015981:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00100000:0.0:1782759716.015991:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218589952:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759716.016035:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 9437184, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x4800 00010000:00010000:0.0:1782759716.016044:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.016059:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:0.0:1782759716.016063:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759716.016069:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.016081:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759716.043653:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967427 is committed 00000100:00100000:1.0:1782759716.044014:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233059712:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759716.044088:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759716.044164:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059712 00000100:00100000:0.0:1782759716.044172:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059712 00000100:00100000:0.0:1782759716.044242:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782759716.044251:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3664:x1869355233059712:12345-0@lo:601:ll_ost_io00_002.0 00000100:00080000:3.0:1782759716.044518:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:2.0:1782759716.045998:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1782759716.046007:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:2.0:1782759716.046022:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.046035:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.046045:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.046053:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759716.046058:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.046091:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.046110:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.046118:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000014be3f2/0xd5b45c7f5c60da4f lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759716.046204:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218589952:12345-192.168.202.31@tcp:4:dd.0 Request processed in 30211us (30482us total) trans 4294967427 rc 0/0 00000100:00100000:2.0:1782759716.046214:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 57 00000100:00100000:0.0:1782759716.051159:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3664:x1869355233059712:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 6900us (7062us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759716.051179:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1782759716.052469:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759716.052795:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590080 00000100:00100000:2.0:1782759716.052805:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590080 00000100:00100000:2.0:1782759716.052889:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 58 00000100:00100000:2.0:1782759716.052901:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218590080:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759716.052959:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 10485760, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x5000 00010000:00010000:2.0:1782759716.052968:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.052983:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:2.0:1782759716.052988:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759716.052994:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.053029:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759716.060048:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233059712:0@lo:601:ll_ost_io00_002.0 00000001:00080000:0.0:1782759716.090007:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967428 is committed 00000100:00100000:2.0:1782759716.090320:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00010000:1.0:1782759716.091241:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:1.0:1782759716.091247:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:1.0:1782759716.091260:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.091273:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.091282:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.091289:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759716.091294:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.091304:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.091323:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.091331:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b2ae48b/0xd5b45c7f5c60da56 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759716.091439:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218590080:12345-192.168.202.31@tcp:4:dd.0 Request processed in 38537us (38971us total) trans 4294967428 rc 0/0 00000100:00100000:1.0:1782759716.091449:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 58 00000100:00100000:3.0:1782759716.096050:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759716.096170:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590208 00000100:00100000:1.0:1782759716.096180:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590208 00000100:00100000:1.0:1782759716.096255:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00100000:1.0:1782759716.096268:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218590208:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759716.096314:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 11534336, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x5800 00010000:00010000:1.0:1782759716.096323:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.096395:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:1.0:1782759716.096401:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759716.096408:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.096423:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759716.099531:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233059840:0@lo:601:ll_ost_io00_001.0 00000100:00100000:2.0:1782759716.116242:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759716.117245:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059840 00000100:00100000:1.0:1782759716.117258:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059840 00000100:00100000:1.0:1782759716.117315:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1782759716.117326:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3664:x1869355233059840:12345-0@lo:601:ll_ost_io00_001.0 00000100:00100000:1.0:1782759716.117614:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3664:x1869355233059840:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 290us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759716.117639:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1782759716.118416:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233059840:0@lo:601:ll_ost_io00_001.0 00000001:00080000:1.0:1782759716.122813:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967429 is committed 00000100:00100000:1.0:1782759716.123232:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00010000:0.0:1782759716.123395:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1782759716.123400:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 22528 -> 24576 00010000:00010000:0.0:1782759716.123424:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.123436:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.123445:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.123453:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759716.123458:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.123467:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.123488:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.123497:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c62fea2/0xd5b45c7f5c60da5d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759716.123812:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218590208:12345-192.168.202.31@tcp:4:dd.0 Request processed in 27544us (27767us total) trans 4294967429 rc 0/0 00000100:00100000:0.0:1782759716.123824:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 59 00000100:00100000:1.0:1782759716.124142:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233059968:0@lo:601:ll_ost_io00_000.0 00000100:00100000:1.0:1782759716.124200:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759716.124355:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233059968 00000100:00100000:2.0:1782759716.124363:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233059968 00000100:00100000:2.0:1782759716.124418:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1782759716.124429:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3663:x1869355233059968:12345-0@lo:601:ll_ost_io00_000.0 00000100:00100000:2.0:1782759716.124665:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3663:x1869355233059968:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 239us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759716.124673:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1782759716.124829:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233059968:0@lo:601:ll_ost_io00_000.0 00000100:00100000:3.0:1782759716.130677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759716.130751:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590336 00000100:00100000:1.0:1782759716.130761:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590336 00000100:00100000:1.0:1782759716.130863:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00100000:1.0:1782759716.130874:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218590336:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759716.130926:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 12582912, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x6000 00010000:00010000:1.0:1782759716.130935:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.130962:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:1.0:1782759716.130966:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759716.130972:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.130985:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759716.154385:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967430 is committed 00002000:00010000:1.0:1782759716.154645:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:1.0:1782759716.154650:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:1.0:1782759716.154663:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.154688:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.154698:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.154705:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759716.154710:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.154720:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.154740:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.154749:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca8f45d/0xd5b45c7f5c60da64 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759716.154836:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218590336:12345-192.168.202.31@tcp:4:dd.0 Request processed in 23960us (24165us total) trans 4294967430 rc 0/0 00000100:00100000:1.0:1782759716.154859:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 60 00000100:00100000:0.0:1782759716.155061:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759716.155083:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233060096:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759716.155133:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759716.155239:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060096 00000100:00100000:1.0:1782759716.155246:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060096 00000100:00100000:1.0:1782759716.155289:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1782759716.155304:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3662:x1869355233060096:12345-0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759716.155523:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3662:x1869355233060096:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 219us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759716.155530:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1782759716.155612:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233060096:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759716.162393:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759716.162473:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590464 00000100:00100000:3.0:1782759716.162482:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590464 00000100:00100000:3.0:1782759716.162568:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 61 00000100:00100000:3.0:1782759716.162762:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218590464:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759716.163226:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 13631488, mtime: 0x6a42c124, atime: 0x0, ctime: 0x6a42c124, blocks: 0x6800 00010000:00010000:3.0:1782759716.163236:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.163253:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:3.0:1782759716.163257:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759716.163263:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.163277:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759716.182629:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967431 is committed 00000100:00100000:0.0:1782759716.182801:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759716.182822:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233060224:0@lo:601:ll_ost_io00_002.0 00000100:00100000:0.0:1782759716.182908:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1782759716.183038:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:0.0:1782759716.183042:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb mtime from disk: 1782759716 -> 1782759717 00002000:00010000:0.0:1782759716.183045:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb ctime from disk: 1782759716 -> 1782759717 00002000:00010000:0.0:1782759716.183047:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 26624 -> 28672 00010000:00010000:0.0:1782759716.183058:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.183071:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.183080:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.183088:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759716.183092:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.183101:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.183120:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.183142:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b8d894/0xd5b45c7f5c60da6b lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759716.183571:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218590464:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20990us (21184us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1782759716.183610:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 61 00000100:00100000:1.0:1782759716.184146:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060224 00000100:00100000:1.0:1782759716.184155:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060224 00000100:00100000:1.0:1782759716.184205:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1782759716.184215:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3665:x1869355233060224:12345-0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759716.184510:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3665:x1869355233060224:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 296us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759716.184517:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1782759716.192965:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233060224:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759716.193438:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759716.193513:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590592 00000100:00100000:2.0:1782759716.193520:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590592 00000100:00100000:1.0:1782759716.193715:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 62 00000100:00100000:1.0:1782759716.193727:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218590592:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759716.193973:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 14680064, mtime: 0x6a42c125, atime: 0x0, ctime: 0x6a42c125, blocks: 0x7000 00010000:00010000:1.0:1782759716.193983:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.194001:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:1.0:1782759716.194005:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759716.194011:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.194043:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759716.212519:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967432 is committed 00002000:00010000:1.0:1782759716.212731:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:1.0:1782759716.212736:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x17:0x0] updating lvb blocks from disk: 28672 -> 30720 00010000:00010000:1.0:1782759716.212748:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.212761:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.212781:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.212788:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759716.212793:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.212802:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.212821:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759716.212828:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60da72 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759716.213052:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218590592:12345-192.168.202.31@tcp:4:dd.0 Request processed in 19220us (19509us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1782759716.213064:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 62 00000100:00100000:0.0:1782759716.216078:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233060352:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759716.216177:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759716.216259:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060352 00000100:00100000:0.0:1782759716.216266:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060352 00000100:00100000:0.0:1782759716.216315:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1782759716.216324:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3665:x1869355233060352:12345-0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759716.216552:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3665:x1869355233060352:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 228us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759716.216559:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1782759716.218209:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759716.218833:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590848 00000100:00100000:3.0:1782759716.218879:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590848 00000100:00100000:3.0:1782759716.218931:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 385 00000100:00100000:3.0:1782759716.218940:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9331c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:113055:x1869355218590848:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:3.0:1782759716.219189:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967733 00000100:00100000:3.0:1782759716.219292:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9331c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:113055:x1869355218590848:12345-192.168.202.31@tcp:35:dd.0 Request processed in 353us (1092us total) trans 4294967734 rc 0/0 00000100:00100000:3.0:1782759716.219300:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 385 00000020:00080000:3.0:1782759716.219305:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782759716.229103:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759716.229232:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233060352:0@lo:601:ll_ost_io00_003.0 00000100:00100000:3.0:1782759716.229456:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218590976 00000100:00100000:3.0:1782759716.229465:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218590976 00000100:00100000:3.0:1782759716.229533:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3063 00000100:00100000:3.0:1782759716.229557:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:113056:x1869355218590976:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759716.229593:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759716.229612:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60da79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276e8 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229670:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229683:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229695:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229709:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229717:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229724:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229797:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60da8e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229805:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60da8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.229812:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60da8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759716.229852:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60da8e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230072:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230081:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230088:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230095:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230101:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759716.230105:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230114:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230126:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759716.230129:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759716.230133:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230140:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c400/0xd5b45c7f5c60da80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230153:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230165:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230172:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230177:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759716.230179:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230185:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230193:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x99c65c89 (ffff8cddc34f4700) 00010000:00010000:3.0:1782759716.230195:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759716.230198:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230204:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166c600/0xd5b45c7f5c60da87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x99c65c89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230230:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdec166d800/0xd5b45c7f5c60da79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276e8 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230243:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60da8e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276e8 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.230250:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759716.230252:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759716.230259:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7a00, rc 0) 00000100:00100000:3.0:1782759716.230360:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:113056:x1869355218590976:12345-192.168.202.31@tcp:101:rm.0 Request processed in 804us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759716.230368:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3063 00000100:00080000:0.0:1782759716.230432:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759716.234333:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759716.234440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759716.234532:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218591104 00000100:00100000:0.0:1782759716.234542:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218591104 00000100:00100000:0.0:1782759716.234634:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3064 00000100:00100000:0.0:1782759716.234645:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:113056:x1869355218591104:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759716.234669:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759716.234692:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802e00/0xd5b45c7f5c60da95 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276ef expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.234761:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60da9c lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.234786:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60da9c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.234798:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60da9c lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759716.234854:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00000004:00200000:0.0:1782759716.234858:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1782759716.234906:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802e00/0xd5b45c7f5c60da95 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276ef expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.234925:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60da9c lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276ef expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759716.234936:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3502b00) 00010000:00010000:0.0:1782759716.234940:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1782759716.234943:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803400, rc 0) 00000100:00100000:0.0:1782759716.235429:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:113056:x1869355218591104:12345-192.168.202.31@tcp:101:rm.0 Request processed in 785us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759716.235438:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3064 00000100:00100000:0.0:1782759716.235695:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233060480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759716.235742:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759716.235996:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759716.236004:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233060608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759716.236038:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759716.236071:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060480 00000100:00100000:0.0:1782759716.236078:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060480 00000100:00100000:0.0:1782759716.236120:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060608 00000100:00100000:0.0:1782759716.236123:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060608 00000100:00100000:0.0:1782759716.236143:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1782759716.236152:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233060480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759716.236603:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759716.236650:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233060480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 499us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759716.236657:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2774 00000100:00100000:0.0:1782759716.236673:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2775 00000100:00100000:0.0:1782759716.236679:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233060608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759716.236688:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1782759716.236712:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233060608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759716.236718:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2775 00000100:00080000:0.0:1782759716.236737:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759716.237012:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233060608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759716.237033:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233060480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759716.242676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218591232 00000100:00100000:3.0:1782759716.242692:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218591232 00000100:00100000:3.0:1782759716.242761:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 411 00000100:00100000:3.0:1782759716.242783:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218591232:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759716.242802:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759716.242825:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60da8e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276e8 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.242856:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759716.242881:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759716.242935:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218591232:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 156us (8495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759716.242942:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 411 00000100:00100000:1.0:1782759716.244400:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759716.247086:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218591360 00000100:00100000:3.0:1782759716.247099:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218591360 00000100:00100000:3.0:1782759716.247203:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1108 00000100:00100000:3.0:1782759716.247215:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218591360:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759716.247232:0:8600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759716.247251:0:8600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276f6 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759716.247274:0:8600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 15728640, mtime: 0x6a42c125, atime: 0x0, ctime: 0x6a42c125, blocks: 0x7800 00010000:00010000:3.0:1782759716.247295:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=3756s v=(0 0) 00010000:00010000:3.0:1782759716.247315:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759716.247324:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 8 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.247343:0:8600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 8 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.247356:0:8600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6a00, rc 0) 00000100:00100000:3.0:1782759716.247413:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218591360:12345-192.168.202.31@tcp:101:rm.0 Request processed in 201us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759716.247420:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1108 00000100:00100000:3.0:1782759716.252255:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233060736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759716.252329:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759716.252718:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060736 00000100:00100000:0.0:1782759716.252727:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060736 00000100:00100000:0.0:1782759716.252802:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3442 00000100:00100000:0.0:1782759716.252812:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233060736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759716.252855:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759716.252924:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233060736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759716.252955:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3442 00000100:00100000:2.0:1782759716.253097:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233060736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759716.253824:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759716.254018:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218591616 00000100:00100000:3.0:1782759716.254025:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218591616 00000100:00100000:3.0:1782759716.254113:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3065 00000100:00100000:3.0:1782759716.254122:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:113056:x1869355218591616:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1782759716.254180:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759716.254208:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166d000/0xd5b45c7f5c60d9f4 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276e1 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254227:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x27:0x0].0x0 (ffff8cded3a3b300) 00010000:00010000:3.0:1782759716.254237:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759716.254268:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254281:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254302:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254314:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254323:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254329:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254419:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254428:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254436:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782759716.254716:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:3.0:1782759716.254729:0:12673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3756531150306ns, next at 3757531147881ns, rc = 0 00010000:00010000:3.0:1782759716.254803:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 3/0,1 mode: --/PW res: [0x240000405:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254813:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254822:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254854:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254861:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254867:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254898:0:12673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759716.254919:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254925:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254931:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254938:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759716.254942:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254959:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254970:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x27:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759716.254973:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759716.254977:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.254992:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dab8 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x27:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255008:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255014:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255019:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255024:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255029:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759716.255032:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255038:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255046:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3502b00) 00010000:00010000:3.0:1782759716.255049:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759716.255052:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255058:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60daaa lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759716.255067:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001211fdd8 reply state 000000001da422f1 transno 4294967735 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255087:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759716.255094:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:3.0:1782759716.255096:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759716.255098:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759716.255179:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:113056:x1869355218591616:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1056us (1416us total) trans 4294967735 rc 0/0 00000100:00100000:3.0:1782759716.255188:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3065 00010000:00010000:2.0:1782759716.255256:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759716.255263:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.255280:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759716.255283:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.255289:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.255297:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x27:0x0].0x0 (ffff8cddc34f4e00) 00010000:00010000:2.0:1782759716.255299:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759716.255303:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 1/0,0 mode: --/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.255309:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60dabf lrc: 0/0,0 mode: --/PW res: [0x240000405:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759716.255322:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759716.255324:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759716.255326:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759716.595688:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759716.595745:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759716.595829:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218591872 00000100:00100000:2.0:1782759716.595849:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218591872 00000100:00100000:2.0:1782759716.595934:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3134 00000100:00100000:2.0:1782759716.595946:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218591872:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759716.596023:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218591872:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759716.596031:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3134 00000100:00080000:1.0:1782759716.596194:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759716.596305:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218591744 00000100:00100000:3.0:1782759716.596310:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218591744 00000100:00100000:3.0:1782759716.596347:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3402 00000100:00100000:3.0:1782759716.596354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218591744:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759716.598797:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218591744:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2431us (3103us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759716.598811:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3402 00010000:00010000:3.0:1782759716.811388:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759717.834776:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782759718.369195:0:157371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3758645615151ns, next at 3547591138841ns, rc = 0 00080000:00080000:0.0:1782759718.369215:0:157371:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782759718.369349:0:157371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3758645771512ns, next at 3564366780720ns, rc = 0 00080000:00080000:0.0:1782759718.369355:0:157371:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1782759718.370973:0:157371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3758647393807ns, next at 3705288120531ns, rc = 0 00080000:00080000:0.0:1782759718.370988:0:157371:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782759718.371114:0:157371:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3758647536347ns, next at 3757531147881ns, rc = 0 00080000:00080000:0.0:1782759718.371120:0:157371:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1782759718.373801:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000004:00080000:3.0:1782759718.374937:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 91 committed 00000001:00080000:3.0:1782759718.374973:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967735 is committed 00000004:00080000:3.0:1782759718.374980:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 94 committed 00000100:00100000:2.0:1782759718.375278:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233060864:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1782759718.375328:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375339:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375346:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375352:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166c800 already unused, calling callback (ffffffffc194d4f0) 00000100:00100000:2.0:1782759718.375355:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759718.375357:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375365:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375381:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:1.0:1782759718.375384:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759718.375389:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375404:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdec166c800/0xd5b45c7f5c60d9ed lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375420:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375427:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375433:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375438:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759718.375442:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375448:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375456:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:1.0:1782759718.375458:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759718.375461:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759718.375466:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60dab1 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759718.375546:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233060864 00000100:00100000:0.0:1782759718.375555:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233060864 00000100:00100000:0.0:1782759718.375637:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1782759718.375646:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233060864:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:0.0:1782759718.375675:0:8447:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:23 count 1 00010000:00010000:0.0:1782759718.375695:0:8447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.375713:0:8447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 7 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.375720:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782759718.375724:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759718.375727:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.375754:0:8447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 7 pid: 8600 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.375775:0:8447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 7 pid: 8600 timeout: 3858 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759718.375787:0:8447:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1869355233060992:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759718.375853:0:8447:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90c00 going to sleep for 11 seconds 00000100:00080000:1.0:1782759718.376199:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1782759718.378603:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000004:00080000:3.0:1782759718.379617:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 95 committed 00000100:00100000:2.0:1782759718.381991:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759718.384918:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592000 00000100:00100000:3.0:1782759718.384936:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592000 00010000:00010000:3.0:1782759718.385009:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 8 pid: 8600 timeout: 3858 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759718.385058:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 861 00000100:00100000:3.0:1782759718.385084:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5715c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218592000:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759718.385101:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759718.385107:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 8 pid: 8600 timeout: 3858 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.385122:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 8 pid: 8600 timeout: 3858 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.385149:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759718.385152:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759718.385158:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.385167:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.385189:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759718.385245:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5715c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218592000:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 163us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759718.385253:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 861 00000100:00080000:1.0:1782759718.385398:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759718.389843:0:8447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e24b9f76/0xd5b45c7f5c60daa3 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276f6 expref: 7 pid: 8600 timeout: 3858 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759718.389870:0:8447:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8447:1869355233060992:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759718.389895:0:8447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.389905:0:8447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.389910:0:8447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.389918:0:8447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.389923:0:8447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759718.390015:0:8447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782759718.390317:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233060864:12345-0@lo:6:osp-syn-1-1.0 Request processed in 14672us (14961us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1782759718.390325:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00010000:00010000:3.0:1782759718.390694:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759718.390700:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.390706:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759718.390709:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.390723:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.390738:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.390743:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31201c8/0xd5b45c7f5c60dac6 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759718.390759:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759718.390761:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759718.390763:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782759718.390831:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4480e00/2, rc 0, transno 4294967433 00000100:00100000:1.0:1782759718.390855:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233060864:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1782759718.798145:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759718.798331:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233061120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759718.798404:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759718.798569:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061120 00000100:00100000:1.0:1782759718.798603:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061120 00000100:00100000:1.0:1782759718.798664:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3443 00000100:00100000:1.0:1782759718.798672:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233061120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759718.798707:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759718.798756:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233061120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759718.798763:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3443 00000100:00100000:0.0:1782759718.798870:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233061120:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759718.859247:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759719.213610:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233061248:0@lo:601:kworker.0 00000100:00100000:1.0:1782759719.213680:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759719.214146:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061248 00000100:00100000:2.0:1782759719.214155:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061248 00000100:00100000:2.0:1782759719.214219:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1782759719.214236:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3663:x1869355233061248:12345-0@lo:601:kworker.0 00000100:00080000:3.0:1782759719.214483:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759719.218294:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6f480 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233061376:0@lo:106: 00000100:00100000:3.0:1782759719.218359:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.218417:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759719.218436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061376 00000100:00100000:3.0:1782759719.218442:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061376 00000100:00100000:3.0:1782759719.218483:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1782759719.218491:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233061376:12345-0@lo:106: 00010000:00010000:3.0:1782759719.218502:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759719.218512:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:3.0:1782759719.218569:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233061376:12345-0@lo:106: Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.218589:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1782759719.218650:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6f480 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233061376:0@lo:106: 00000100:00100000:2.0:1782759719.220875:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:3663:x1869355233061248:12345-0@lo:601:kworker.0 Request processed in 6638us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759719.220888:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1782759719.229139:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233061248:0@lo:601:kworker.0 00010000:00010000:0.0:1782759719.229505:0:9545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759719.229520:0:9545:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759719.229528:0:9545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759719.229537:0:9545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759719.229566:0:9545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759719.229795:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759719.229803:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.229824:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc14b8e50) 00040000:00010000:1.0:1782759719.229829:0:9533:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.229838:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00040000:00010000:1.0:1782759719.229846:0:9533:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.229888:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.229901:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759719.229924:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.229932:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdedf802800/0xd5b45c7f5c60da09 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60da10 expref: -99 pid: 125830 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759719.229949:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759719.229951:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759719.229953:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759719.229969:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233061504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759719.230239:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.232296:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061504 00000100:00100000:3.0:1782759719.232310:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061504 00000100:00100000:3.0:1782759719.232386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1782759719.232397:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-lwp-OST0001_UUID+7:3664:x1869355233061504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759719.232414:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759719.232434:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60da10 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60da09 expref: 7 pid: 66654 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759719.232469:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759719.232535:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233061504:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.232543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1782759719.232685:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233061504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759719.819025:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233061760:0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819110:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.819175:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233062272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819199:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.819218:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233062784:0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819240:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.819263:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759719.819269:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233061888:0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819295:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.819328:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233062400:0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819351:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.819368:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233062912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819388:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759719.819419:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061760 00000100:00100000:3.0:1782759719.819427:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061760 00000100:00100000:3.0:1782759719.819472:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062272 00000100:00100000:3.0:1782759719.819475:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062272 00000100:00100000:3.0:1782759719.819499:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062784 00000100:00100000:3.0:1782759719.819502:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062784 00000100:00100000:3.0:1782759719.819512:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062400 00000100:00100000:3.0:1782759719.819514:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062400 00000100:00100000:3.0:1782759719.819525:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062912 00000100:00100000:3.0:1782759719.819527:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062912 00000100:00100000:3.0:1782759719.819554:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5368 00000100:00100000:3.0:1782759719.819562:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233061760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819646:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233061760:12345-0@lo:400:kworker.0 Request processed in 83us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.819653:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5368 00000100:00100000:3.0:1782759719.819671:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5369 00000100:00100000:3.0:1782759719.819677:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233062272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819706:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233062272:12345-0@lo:400:kworker.0 Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.819711:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5369 00000100:00100000:3.0:1782759719.819722:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5370 00000100:00100000:3.0:1782759719.819728:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233062784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819753:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233062784:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.819766:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5370 00000100:00100000:3.0:1782759719.819777:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5371 00000100:00100000:3.0:1782759719.819783:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233062400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819823:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233062400:12345-0@lo:400:kworker.0 Request processed in 40us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.819830:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5371 00000100:00100000:3.0:1782759719.819841:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5372 00000100:00100000:3.0:1782759719.819847:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233062912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.819875:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233062912:12345-0@lo:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.819881:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5372 00000100:00100000:3.0:1782759719.819900:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061888 00000100:00100000:3.0:1782759719.819904:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061888 00000100:00100000:3.0:1782759719.819944:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00080000:0.0:1782759719.820338:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759719.820344:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759719.820390:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233062400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.820402:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233062912:0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.820426:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233061760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.820437:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233062272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.820447:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233062784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820662:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233061632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820724:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.820766:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233062144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820791:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.820820:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233062656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820848:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.820868:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233063168:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820891:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.820913:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782759719.820919:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233062016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820943:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.820972:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233062528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.820996:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.821011:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233063040:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821032:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759719.821065:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062144 00000100:00100000:1.0:1782759719.821070:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062144 00000100:00100000:1.0:1782759719.821105:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1782759719.821112:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233062144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821156:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233062144:12345-0@lo:400:kworker.0 Request processed in 43us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.821162:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1782759719.821182:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062656 00000100:00100000:1.0:1782759719.821185:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062656 00000100:00100000:1.0:1782759719.821216:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063168 00000100:00100000:1.0:1782759719.821219:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063168 00000100:00100000:1.0:1782759719.821234:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062528 00000100:00100000:1.0:1782759719.821237:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062528 00000100:00100000:1.0:1782759719.821248:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063040 00000100:00100000:1.0:1782759719.821250:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063040 00000100:00100000:1.0:1782759719.821263:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3135 00000100:00100000:1.0:1782759719.821269:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233062656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821302:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233062656:12345-0@lo:400:kworker.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.821308:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3135 00000100:00100000:1.0:1782759719.821320:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3136 00000100:00100000:1.0:1782759719.821326:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821354:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233063168:12345-0@lo:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.821370:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3136 00000100:00100000:1.0:1782759719.821382:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1782759719.821388:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233062528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821417:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233062528:12345-0@lo:400:kworker.0 Request processed in 29us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.821423:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3137 00000100:00100000:1.0:1782759719.821439:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3138 00000100:00100000:1.0:1782759719.821445:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233063040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821472:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233063040:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.821478:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3138 00000100:00080000:1.0:1782759719.821500:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759719.821504:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759719.821525:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233062528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821534:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233063040:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821543:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233062144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821550:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233062656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821558:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233063168:0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821619:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233062016 00000100:00100000:1.0:1782759719.821623:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233062016 00000100:00100000:1.0:1782759719.821649:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5373 00000100:00100000:1.0:1782759719.821655:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233062016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759719.821689:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233062016:12345-0@lo:400:kworker.0 Request processed in 34us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759719.821702:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5373 00000100:00100000:1.0:1782759719.821732:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233062016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.821891:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233061632 00000100:00100000:0.0:1782759719.821896:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233061632 00000100:00100000:0.0:1782759719.821935:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403 00000100:00100000:0.0:1782759719.821943:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233061632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.821987:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233061632:12345-0@lo:400:kworker.0 Request processed in 46us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759719.821994:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403 00000100:00100000:3.0:1782759719.822269:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233061888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759719.822324:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233061888:12345-0@lo:400:kworker.0 Request processed in 2373us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759719.822331:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:1.0:1782759719.826147:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233061632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759719.826402:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233061888:0@lo:400:kworker.0 00010000:00010000:3.0:1782759719.882921:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759720.332871:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759720.332895:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233063296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759720.332971:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759720.333162:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063296 00000100:00100000:3.0:1782759720.333171:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063296 00000100:00100000:3.0:1782759720.333232:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2776 00000100:00100000:3.0:1782759720.333242:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233063296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759720.333273:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759720.333447:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233063296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 207us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759720.333464:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2776 00000100:00080000:1.0:1782759720.333539:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759720.333779:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759720.333790:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233063424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759720.333833:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759720.333908:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063424 00000100:00100000:3.0:1782759720.333913:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063424 00000100:00100000:3.0:1782759720.333950:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2777 00000100:00100000:3.0:1782759720.333957:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233063424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759720.333970:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759720.334011:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233063424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759720.334017:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2777 00000100:00100000:1.0:1782759720.334188:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233063424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759720.336643:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233063296:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759720.910312:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759721.354898:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233063680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759721.354974:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759721.355040:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759721.355049:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233063552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759721.355075:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759721.355107:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063680 00000100:00100000:1.0:1782759721.355114:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063680 00000100:00100000:1.0:1782759721.355174:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063552 00000100:00100000:1.0:1782759721.355177:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063552 00000100:00100000:1.0:1782759721.355201:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2778 00000100:00100000:1.0:1782759721.355210:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233063680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759721.355242:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759721.355289:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233063680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759721.355307:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2778 00000100:00100000:1.0:1782759721.355326:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2779 00000100:00100000:1.0:1782759721.355332:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233063552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759721.355343:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759721.355369:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233063552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759721.355375:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2779 00000100:00080000:1.0:1782759721.355391:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759721.355428:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233063552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759721.355442:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233063680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759721.357428:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759721.357450:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759721.357517:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759721.357683:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063808 00000100:00100000:0.0:1782759721.357691:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063808 00000100:00100000:0.0:1782759721.357749:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3446 00000100:00100000:0.0:1782759721.357759:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233063808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759721.357793:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759721.357859:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233063808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759721.357866:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3446 00000100:00100000:2.0:1782759721.357936:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233063808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759721.696889:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759721.697399:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759721.697475:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759721.697504:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759721.697530:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592128 00000100:00100000:3.0:1782759721.697541:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592128 00000100:00100000:3.0:1782759721.697632:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3404 00000100:00100000:3.0:1782759721.697643:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218592128:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759721.697729:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218592128:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 77us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759721.697738:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3404 00000100:00100000:1.0:1782759721.700257:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759721.700284:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592640 00000100:00100000:1.0:1782759721.700292:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592640 00000100:00100000:1.0:1782759721.700344:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592512 00000100:00100000:1.0:1782759721.700347:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592512 00000100:00100000:1.0:1782759721.700371:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3139 00000100:00100000:1.0:1782759721.700382:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218592640:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759721.700451:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218592640:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 70us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759721.700458:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3139 00000100:00100000:1.0:1782759721.700476:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3140 00000100:00100000:1.0:1782759721.700493:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218592512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759721.700523:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218592512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759721.700530:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3140 00000100:00080000:1.0:1782759721.700552:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759721.700556:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759721.701939:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592384 00000100:00100000:2.0:1782759721.701950:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592384 00000100:00100000:2.0:1782759721.702018:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592256 00000100:00100000:2.0:1782759721.702022:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592256 00000100:00100000:2.0:1782759721.702053:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5374 00000100:00100000:2.0:1782759721.702072:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218592384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759721.702139:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2402:x1869355218592384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 79us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759721.702147:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5374 00000100:00080000:1.0:1782759721.702285:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759721.702289:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759721.702338:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5375 00000100:00100000:2.0:1782759721.702348:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218592256:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759721.702386:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218592256:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (4880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759721.702393:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5375 00000001:00080000:0.0:1782759721.891925:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967433 is committed 00010000:00010000:1.0:1782759721.931066:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759722.956758:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759723.917972:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233063936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759723.918051:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759723.921722:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233063936 00000100:00100000:0.0:1782759723.921946:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233063936 00000100:00100000:0.0:1782759723.922027:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447 00000100:00100000:0.0:1782759723.922039:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233063936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759723.924215:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:0.0:1782759723.924352:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233063936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2312us (6297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759723.924364:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447 00000100:00100000:2.0:1782759723.924713:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233063936:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759723.978895:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759724.938775:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233064064:0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.938875:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759724.938915:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064064 00000100:00100000:0.0:1782759724.938924:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064064 00000100:00100000:3.0:1782759724.938948:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233064576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759724.938979:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3405 00000100:00100000:3.0:1782759724.938983:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759724.938993:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233064064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.939008:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233065088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759724.939049:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233064064:12345-0@lo:400:kworker.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759724.939057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3405 00000100:00100000:3.0:1782759724.939173:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759724.939199:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233065600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.939238:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759724.939269:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233064064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939273:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233064192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939314:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759724.939315:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064576 00000100:00100000:3.0:1782759724.939321:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064576 00000100:00100000:1.0:1782759724.939338:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233064704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939364:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759724.939368:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3448 00000100:00100000:3.0:1782759724.939378:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233064576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939388:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233065216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939420:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759724.939429:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233064576:12345-0@lo:400:kworker.0 Request processed in 52us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759724.939439:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3448 00000100:00100000:1.0:1782759724.939457:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065088 00000100:00100000:1.0:1782759724.939463:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065088 00000100:00100000:3.0:1782759724.939476:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233064576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939514:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065600 00000100:00100000:3.0:1782759724.939515:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064192 00000100:00100000:1.0:1782759724.939518:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065600 00000100:00100000:3.0:1782759724.939521:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064192 00000100:00100000:1.0:1782759724.939550:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1782759724.939556:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064704 00000100:00100000:3.0:1782759724.939561:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064704 00000100:00100000:1.0:1782759724.939561:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233065088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.939618:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065216 00000100:00100000:3.0:1782759724.939622:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065216 00000100:00100000:1.0:1782759724.939637:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233065088:12345-0@lo:400:kworker.0 Request processed in 79us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.939645:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3141 00000100:00100000:3.0:1782759724.939661:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5376 00000100:00100000:1.0:1782759724.939666:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1782759724.939672:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233064192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939678:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233065600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.939718:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233064192:12345-0@lo:400:kworker.0 Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759724.939726:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5376 00000100:00100000:1.0:1782759724.939733:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233065600:12345-0@lo:400:kworker.0 Request processed in 59us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759724.939741:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5377 00000100:00100000:1.0:1782759724.939743:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3142 00000100:00100000:3.0:1782759724.939753:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233064704:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1782759724.939776:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759724.939782:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759724.939785:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759724.939796:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233064704:12345-0@lo:400:kworker.0 Request processed in 46us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.939807:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5378 00000100:00100000:3.0:1782759724.939820:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5377 00000100:00100000:3.0:1782759724.939873:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233065088:0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.939883:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233065600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939947:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233065216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.939981:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233065216:12345-0@lo:400:kworker.0 Request processed in 166us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.939993:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5378 00000100:00100000:1.0:1782759724.940022:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233064192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940032:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233064704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940041:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233065216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759724.940146:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233064320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759724.940179:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759724.940392:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233064448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940418:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759724.940435:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233064960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940453:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759724.940474:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233065472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940492:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759724.940514:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064960 00000100:00100000:1.0:1782759724.940517:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064960 00000100:00100000:1.0:1782759724.940540:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065472 00000100:00100000:1.0:1782759724.940542:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065472 00000100:00100000:1.0:1782759724.940559:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3143 00000100:00100000:1.0:1782759724.940571:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233064960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940620:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233064960:12345-0@lo:400:kworker.0 Request processed in 48us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.940625:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3143 00000100:00100000:1.0:1782759724.940635:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3144 00000100:00100000:1.0:1782759724.940640:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233065472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940660:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233065472:12345-0@lo:400:kworker.0 Request processed in 20us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.940666:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3144 00000100:00080000:1.0:1782759724.940680:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759724.940683:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759724.940697:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233064960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940704:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967433 gen 2 00000004:00080000:1.0:1782759724.940708:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4480e00, transno 4294967433 00000100:00100000:1.0:1782759724.940720:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233065472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940741:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064448 00000100:00100000:1.0:1782759724.940744:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064448 00000100:00100000:1.0:1782759724.940780:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5379 00000100:00100000:1.0:1782759724.940787:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.940820:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233064448:12345-0@lo:400:kworker.0 Request processed in 34us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.940826:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5379 00000100:00100000:1.0:1782759724.940864:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233064448:0@lo:400:kworker.0 00000100:00100000:2.0:1782759724.945166:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233064832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759724.945243:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759724.945276:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233065344:0@lo:400:kworker.0 00000100:00100000:2.0:1782759724.945300:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759724.948831:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064832 00000100:00100000:1.0:1782759724.948863:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064832 00000100:00100000:1.0:1782759724.948956:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5380 00000100:00100000:1.0:1782759724.948969:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233064832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.949070:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233064832:12345-0@lo:400:kworker.0 Request processed in 104us (3826us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.949077:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5380 00000100:00100000:1.0:1782759724.949093:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065344 00000100:00100000:1.0:1782759724.949096:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065344 00000100:00100000:1.0:1782759724.949120:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5381 00000100:00100000:1.0:1782759724.949125:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233065344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.949157:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233065344:12345-0@lo:400:kworker.0 Request processed in 32us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759724.949163:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5381 00000100:00080000:1.0:1782759724.949189:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759724.949255:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233064832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759724.949269:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233065344:0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.950874:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233064320 00000100:00100000:3.0:1782759724.950884:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233064320 00000100:00100000:3.0:1782759724.950945:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3449 00000100:00100000:3.0:1782759724.950955:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233064320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759724.951181:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233064320:12345-0@lo:400:kworker.0 Request processed in 226us (10999us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759724.951189:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3449 00000100:00100000:0.0:1782759724.951305:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233064320:0@lo:400:kworker.0 00010000:00010000:1.0:1782759725.004171:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759725.451217:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233065856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759725.451285:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759725.451358:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065856 00000100:00100000:1.0:1782759725.451491:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233065728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759725.451521:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759725.452011:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065728 00000100:00100000:0.0:1782759725.452017:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065728 00000100:00100000:0.0:1782759725.452070:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2780 00000100:00100000:0.0:1782759725.452080:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233065728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759725.452110:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759725.452122:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065856 00000100:00100000:3.0:1782759725.452158:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2781 00000100:00100000:0.0:1782759725.452159:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233065728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759725.452164:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233065856:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759725.452166:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2780 00002000:00000024:3.0:1782759725.452173:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759725.452206:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233065856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759725.452212:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2781 00000100:00100000:0.0:1782759725.452248:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233065856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759725.452390:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233065728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759726.035196:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759726.478778:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759726.478801:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233065984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759726.478871:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759726.481780:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233066112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759726.481869:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759726.482940:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233066240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759726.483025:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759726.487144:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233065984 00000100:00100000:3.0:1782759726.487158:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233065984 00000100:00100000:3.0:1782759726.487238:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066112 00000100:00100000:3.0:1782759726.487241:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066112 00000100:00100000:3.0:1782759726.487270:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1782759726.487281:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233065984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759726.487319:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759726.487422:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233065984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (8550us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759726.487430:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2782 00000100:00100000:3.0:1782759726.487449:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2783 00000100:00100000:3.0:1782759726.487455:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233066112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759726.487466:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1782759726.487496:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233066112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (5627us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759726.487502:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2783 00000100:00100000:3.0:1782759726.487677:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066240 00000100:00100000:3.0:1782759726.487682:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066240 00000100:00100000:3.0:1782759726.487726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3450 00000100:00100000:3.0:1782759726.487733:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233066240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759726.487769:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:3.0:1782759726.487810:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233066240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (4787us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759726.487817:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3450 00000100:00100000:3.0:1782759726.488012:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233065984:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759726.488092:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759726.488291:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233066112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759726.488375:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233066240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759726.815860:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759726.815917:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759726.816023:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759726.816053:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759726.816106:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592768 00000100:00100000:3.0:1782759726.816118:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592768 00000100:00100000:3.0:1782759726.816184:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3406 00000100:00100000:3.0:1782759726.816195:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218592768:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759726.816285:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218592768:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 92us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759726.816293:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3406 00000100:00100000:0.0:1782759726.817184:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593280 00000100:00100000:0.0:1782759726.817193:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593280 00000100:00100000:0.0:1782759726.817269:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3145 00000100:00100000:0.0:1782759726.817277:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218593280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759726.817342:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218593280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 65us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759726.817349:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3145 00000100:00080000:3.0:1782759726.817769:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759726.829683:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759726.829893:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593152 00000100:00100000:0.0:1782759726.829904:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593152 00000100:00100000:0.0:1782759726.829988:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3146 00000100:00100000:0.0:1782759726.829998:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218593152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759726.830088:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218593152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759726.830095:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3146 00000100:00080000:1.0:1782759726.831130:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759726.835374:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593024 00000100:00100000:2.0:1782759726.835393:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593024 00000100:00100000:3.0:1782759726.835833:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218592896 00000100:00100000:3.0:1782759726.835840:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218592896 00000100:00100000:3.0:1782759726.836047:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5382 00000100:00100000:3.0:1782759726.836057:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218592896:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759726.836147:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218592896:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (20092us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759726.836154:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5382 00000100:00080000:1.0:1782759726.837546:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759726.837555:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759726.841286:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5383 00000100:00100000:0.0:1782759726.841305:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218593024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759726.841418:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:2404:x1869355218593024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 120us (25501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759726.841427:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5383 00010000:00010000:3.0:1782759727.064021:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759728.075026:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759729.037421:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759729.037456:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233066368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759729.037525:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759729.037609:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066368 00000100:00100000:1.0:1782759729.037616:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066368 00000100:00100000:1.0:1782759729.037690:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451 00000100:00100000:1.0:1782759729.037701:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233066368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759729.037746:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759729.037807:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233066368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759729.037815:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451 00000100:00100000:3.0:1782759729.037852:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233066368:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759729.102854:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782759729.127419:0:157681:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782759729.127430:0:157681:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:3.0:1782759729.277181:0:157703:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782759729.277191:0:157703:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1782759730.060492:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233066880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060565:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060630:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233067392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060654:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060670:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233067904:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060690:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060741:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1782759730.060748:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233066496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060773:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060794:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233067008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060812:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060826:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233067520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060843:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060857:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233068032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060871:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060892:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233066752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060911:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060924:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233067264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060943:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060954:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233067776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.060973:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.060989:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782759730.060995:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233066624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.061016:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.061038:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233067136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.061059:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759730.061077:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233067648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759730.061083:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066880 00000100:00100000:0.0:1782759730.061090:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066880 00000100:00100000:1.0:1782759730.061095:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759730.069542:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067264 00000100:00100000:0.0:1782759730.069565:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067264 00000100:00080000:2.0:1782759730.069707:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759730.072492:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067776 00000100:00100000:1.0:1782759730.072510:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067776 00000100:00100000:1.0:1782759730.072597:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066624 00000100:00100000:1.0:1782759730.072614:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066624 00000100:00100000:1.0:1782759730.072628:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067136 00000100:00100000:1.0:1782759730.072631:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067136 00000100:00100000:1.0:1782759730.072642:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067648 00000100:00100000:1.0:1782759730.072644:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067648 00000100:00100000:1.0:1782759730.072663:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5384 00000100:00100000:1.0:1782759730.072672:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233066880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.072787:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233066880:12345-0@lo:400:kworker.0 Request processed in 116us (12221us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.072794:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5384 00000100:00080000:2.0:1782759730.072807:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759730.072812:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759730.072812:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5385 00000100:00100000:1.0:1782759730.072819:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233067264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.072871:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233067264:12345-0@lo:400:kworker.0 Request processed in 52us (11926us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.072877:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5385 00000100:00100000:1.0:1782759730.072890:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5386 00000100:00100000:1.0:1782759730.072895:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233067776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.072923:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233067776:12345-0@lo:400:kworker.0 Request processed in 27us (11948us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.072928:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5386 00000100:00100000:1.0:1782759730.072940:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5387 00000100:00100000:1.0:1782759730.072945:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233066624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.072973:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233066624:12345-0@lo:400:kworker.0 Request processed in 28us (11957us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.072978:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5387 00000100:00100000:1.0:1782759730.072988:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5388 00000100:00100000:1.0:1782759730.072994:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233067136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.073026:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233067136:12345-0@lo:400:kworker.0 Request processed in 33us (11966us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.073032:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5388 00000100:00100000:1.0:1782759730.073043:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5389 00000100:00100000:1.0:1782759730.073049:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233067648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.073075:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233067648:12345-0@lo:400:kworker.0 Request processed in 27us (11978us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.073080:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5389 00000100:00100000:2.0:1782759730.073112:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233066624:0@lo:400:kworker.0 00000100:00100000:2.0:1782759730.073135:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233067136:0@lo:400:kworker.0 00000100:00100000:2.0:1782759730.073145:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233067648:0@lo:400:kworker.0 00000100:00100000:2.0:1782759730.073156:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233067264:0@lo:400:kworker.0 00000100:00100000:2.0:1782759730.073166:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233067776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.074488:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067392 00000100:00100000:1.0:1782759730.074500:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067392 00000100:00100000:1.0:1782759730.074569:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067904 00000100:00100000:1.0:1782759730.074572:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067904 00000100:00100000:1.0:1782759730.074599:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067520 00000100:00100000:1.0:1782759730.074602:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067520 00000100:00100000:1.0:1782759730.074613:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068032 00000100:00100000:1.0:1782759730.074616:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068032 00000100:00080000:2.0:1782759730.074617:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759730.074621:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759730.074631:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1782759730.074639:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233067392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759730.074693:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3148 00000100:00100000:0.0:1782759730.074702:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233067904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.074705:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233067392:12345-0@lo:400:kworker.0 Request processed in 68us (14050us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.074711:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3147 00000100:00100000:1.0:1782759730.074737:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1782759730.074742:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233067520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759730.074747:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233067904:12345-0@lo:400:kworker.0 Request processed in 48us (14057us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759730.074753:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3148 00000100:00100000:1.0:1782759730.074766:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233067520:12345-0@lo:400:kworker.0 Request processed in 26us (13923us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759730.074766:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3150 00000100:00100000:0.0:1782759730.074786:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233068032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759730.074818:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233068032:12345-0@lo:400:kworker.0 Request processed in 34us (13945us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.075683:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3149 00000100:00100000:1.0:1782759730.075718:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066496 00000100:00100000:1.0:1782759730.075742:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066496 00000100:00100000:1.0:1782759730.075785:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3407 00000100:00100000:1.0:1782759730.075791:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233066496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.075838:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233066496:12345-0@lo:400:kworker.0 Request processed in 47us (15063us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.075844:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3407 00000100:00100000:1.0:1782759730.075875:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233067008 00000100:00100000:1.0:1782759730.075879:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233067008 00000100:00100000:1.0:1782759730.075918:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233066752 00000100:00100000:1.0:1782759730.075922:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233066752 00000100:00100000:1.0:1782759730.075936:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:1.0:1782759730.075942:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233067008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.075976:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233067008:12345-0@lo:400:kworker.0 Request processed in 34us (15162us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.075982:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:1.0:1782759730.075994:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453 00000100:00100000:1.0:1782759730.076000:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.076034:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233066752:12345-0@lo:400:kworker.0 Request processed in 34us (15122us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759730.076040:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453 00000100:00100000:2.0:1782759730.077838:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233066752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079039:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233066496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079057:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233067008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079069:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233067520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079081:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233068032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079092:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233066880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079178:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233067392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759730.079188:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233067904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759730.080825:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3150 00010000:00010000:3.0:1782759730.124076:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759730.222907:0:157757:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0843cf10 20000000:00000080:3.0:1782759730.222932:0:157757:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc24f1000 uarg=0000000000000000 00010000:00010000:3.0:1782759730.223879:0:157757:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759730.223899:0:157757:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759730.223921:0:157757:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759730.223953:0:157757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3502b00) 00010000:00010000:3.0:1782759730.223957:0:157757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1782759730.223970:0:157757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60da9c lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276ef expref: 5 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.223994:0:157757:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782759730.224013:0:157757:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759730.224026:0:157757:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.224053:0:157757:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.224061:0:157757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.225570:0:157757:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.225606:0:157757:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 23 pid: 6526 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759730.225623:0:157757:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:157757:1869355233068160:0@lo:104: 00000100:00100000:3.0:1782759730.225693:0:157757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759730.225761:0:157757:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc26299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759730.228816:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068160 00000100:00100000:2.0:1782759730.228831:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068160 00000100:00100000:2.0:1782759730.228975:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:2.0:1782759730.228988:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:157757:x1869355233068160:12345-0@lo:104: 00010000:00010000:2.0:1782759730.229007:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759730.229105:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759730.229112:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:157757:x1869355233068160:12345-0@lo:104: Request processed in 129us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759730.229119:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1782759730.229170:0:157757:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:157757:1869355233068160:0@lo:104: 00010000:00010000:0.0:1782759730.229193:0:157757:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759730.229196:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759730.229202:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759730.229210:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdec166ca00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759730.229213:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759730.229222:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759730.229230:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759730.229235:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759730.229278:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759730.229285:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759730.229313:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759730.229321:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdec166ca00/0xd5b45c7f5c60d9d1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d9d8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759730.229338:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759730.229340:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759730.229351:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759730.229404:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233068288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759730.229445:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759730.229564:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068288 00000100:00100000:3.0:1782759730.229569:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068288 00010000:00010000:3.0:1782759730.229608:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 24 pid: 6526 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759730.229638:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1782759730.229645:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233068288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759730.229656:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759730.229661:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 24 pid: 6526 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229672:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 24 pid: 6526 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229698:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60d9d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d9d1 expref: 24 pid: 6526 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229712:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229729:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229743:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229750:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229756:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229762:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229767:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759730.229770:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229777:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229798:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759730.229818:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759730.229856:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233068288:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759730.229863:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00010000:00010000:0.0:1782759730.229925:0:157757:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759730.229932:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233068288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759730.229933:0:157757:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759730.229940:0:157757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60dacd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 157757 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759730.571052:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233068416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759730.571123:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759730.571241:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068416 00000100:00100000:3.0:1782759730.571249:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068416 00000100:00100000:3.0:1782759730.571296:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2784 00000100:00100000:3.0:1782759730.571306:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233068416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759730.571336:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759730.571398:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233068416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759730.571405:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2784 00000100:00100000:2.0:1782759730.571486:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233068416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759730.577757:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759730.577780:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233068544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759730.577857:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759730.578409:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068544 00000100:00100000:2.0:1782759730.578437:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068544 00000100:00100000:2.0:1782759730.578502:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2785 00000100:00100000:2.0:1782759730.578512:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233068544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759730.578538:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759730.578609:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233068544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759730.578616:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2785 00000100:00100000:2.0:1782759730.578663:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233068544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759731.154350:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759731.597606:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233068672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759731.597690:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759731.597804:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068672 00000100:00100000:2.0:1782759731.597812:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068672 00000100:00100000:2.0:1782759731.597879:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2786 00000100:00100000:2.0:1782759731.597891:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233068672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759731.597922:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1782759731.597969:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233068672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759731.597976:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2786 00000100:00100000:2.0:1782759731.598184:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233068672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759731.598645:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759731.598657:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233068800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759731.598691:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759731.598737:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068800 00000100:00100000:1.0:1782759731.598741:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068800 00000100:00100000:1.0:1782759731.598767:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1782759731.598775:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233068800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759731.598786:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17123264 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1782759731.598817:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233068800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759731.598823:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:1.0:1782759731.598863:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233068800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759731.603591:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233068928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759731.604135:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759731.604970:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233068928 00000100:00100000:3.0:1782759731.604981:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233068928 00000100:00100000:3.0:1782759731.605086:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454 00000100:00100000:3.0:1782759731.605097:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233068928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759731.605140:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:3.0:1782759731.605224:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233068928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759731.605232:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454 00000100:00100000:0.0:1782759731.605405:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233068928:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1782759731.658697:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759731.658705:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759731.658718:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759731.658781:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759731.658794:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759731.658991:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759731.659025:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233069056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759731.659095:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759731.659157:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec2c69e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759731.659384:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069056 00000100:00100000:3.0:1782759731.659766:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069056 00000100:00100000:3.0:1782759731.660103:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3408 00000100:00100000:3.0:1782759731.660112:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233069056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759731.660127:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759731.660151:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dad4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759731.660175:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759731.660186:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759731.660196:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7a00, rc 0) 00000100:00100000:3.0:1782759731.660254:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233069056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759731.660260:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3408 00000100:00100000:2.0:1782759731.660451:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233069056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759731.660466:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759731.661076:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759731.661100:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759731.661106:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759731.661113:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759731.936249:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759731.936335:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759731.936375:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759731.936399:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759731.936448:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593792 00000100:00100000:0.0:1782759731.936457:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593792 00000100:00100000:0.0:1782759731.936536:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3151 00000100:00100000:0.0:1782759731.936547:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218593792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759731.936658:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218593792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 113us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759731.936667:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3151 00000100:00080000:0.0:1782759731.936689:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759731.936848:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593408 00000100:00100000:0.0:1782759731.936854:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593408 00000100:00100000:0.0:1782759731.936884:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3409 00000100:00100000:0.0:1782759731.936891:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218593408:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759731.936941:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218593408:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 50us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759731.936949:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3409 00000100:00100000:1.0:1782759731.944516:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759731.944563:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593920 00000100:00100000:1.0:1782759731.944574:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593920 00000100:00100000:1.0:1782759731.944682:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3152 00000100:00100000:1.0:1782759731.944693:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218593920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759731.944787:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218593920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 95us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759731.944819:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3152 00000100:00080000:1.0:1782759731.944840:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759731.951213:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593536 00000100:00100000:3.0:1782759731.951228:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593536 00000100:00100000:3.0:1782759731.951844:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218593664 00000100:00100000:3.0:1782759731.951850:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218593664 00000100:00100000:0.0:1782759731.953101:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5390 00000100:00100000:0.0:1782759731.953122:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218593536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759731.953212:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218593536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 98us (16972us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759731.953219:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5390 00000100:00080000:1.0:1782759731.961164:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759731.961174:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759731.966401:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5391 00000100:00100000:3.0:1782759731.966417:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218593664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759731.966513:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218593664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 101us (30112us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759731.966520:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5391 00010000:00010000:1.0:1782759732.180119:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759733.194729:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759733.404500:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.404662:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594176 00000100:00100000:0.0:1782759733.404673:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594176 00000100:00100000:0.0:1782759733.404796:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3066 00000100:00100000:0.0:1782759733.404807:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:113467:x1869355218594176:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782759733.404830:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759733.404854:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dae2 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb276fd expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.404989:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405025:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405039:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405065:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405072:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405078:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759733.405446:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x18:0x0], index 0: 0 00010000:00010000:0.0:1782759733.405571:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60daf7 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405608:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60daf7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405616:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60daf7 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405650:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405658:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405665:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405678:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405684:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759733.405689:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405708:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405721:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759733.405725:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759733.405729:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405736:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dae9 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759733.405750:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000113c5cb9 reply state 00000000669828e2 transno 4294967736 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405763:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405769:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0a300) 00010000:00010000:0.0:1782759733.405772:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759733.405774:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759733.405805:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dae2 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276fd expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405825:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60daf7 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276fd expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.405835:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x28:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:0.0:1782759733.405837:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759733.405839:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802a00, rc 0) 00000100:00100000:0.0:1782759733.405896:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:113467:x1869355218594176:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1091us (1408us total) trans 4294967736 rc 0/0 00000100:00100000:0.0:1782759733.405904:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3066 00000100:00080000:2.0:1782759733.409656:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759733.415538:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.415889:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594304 00000100:00100000:0.0:1782759733.415899:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594304 00000100:00100000:0.0:1782759733.419432:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:0.0:1782759733.419449:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218594304:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759733.419503:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1782759733.419512:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.419528:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:0.0:1782759733.419533:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759733.419539:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.419553:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782759733.424195:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759733.445086:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.445107:0:8452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759733.445148:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233069184:0@lo:101:ll_ost_io00_002.0 00000100:00100000:3.0:1782759733.445209:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759733.445252:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759733.445281:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069184 00000100:00100000:3.0:1782759733.445287:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069184 00000100:00100000:3.0:1782759733.445348:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1782759733.445358:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+6:8452:x1869355233069184:12345-0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759733.445374:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759733.445388:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60db0c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.446852:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.446868:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.446882:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7000, rc 0) 00000100:00100000:3.0:1782759733.446950:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233069184:12345-0@lo:101:ll_ost_io00_002.0 Request processed in 1592us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759733.446959:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1782759733.447037:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233069184:0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759733.447059:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.447069:0:8452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.447109:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.447118:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00080000:3.0:1782759733.449020:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1782759733.449837:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967424 is committed 00002000:00010000:3.0:1782759733.449937:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1782759733.449941:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1782759734 00002000:00010000:3.0:1782759733.449944:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1782759734 00002000:00010000:3.0:1782759733.449946:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1782759733.449961:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.449973:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.449982:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.449989:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759733.449994:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.450004:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.450040:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.450049:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60db05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759733.450154:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218594304:12345-192.168.202.31@tcp:4:dd.0 Request processed in 30704us (34621us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1782759733.450165:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 63 00000100:00100000:3.0:1782759733.468867:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.468939:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594432 00000100:00100000:0.0:1782759733.468949:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594432 00000100:00100000:0.0:1782759733.469369:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 64 00000100:00100000:0.0:1782759733.469381:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218594432:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759733.469469:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 1048576, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x800 00010000:00010000:0.0:1782759733.469479:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.469494:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:0.0:1782759733.469502:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759733.469508:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.469522:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.490926:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1782759733.491260:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233069312:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759733.491330:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759733.491424:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759733.491473:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069312 00000100:00100000:1.0:1782759733.491481:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069312 00000100:00100000:1.0:1782759733.491528:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1782759733.491544:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233069312:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:1.0:1782759733.491720:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759733.491964:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233069312:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 426us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.492045:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1782759733.492155:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233069312:0@lo:601:ll_ost_io00_003.0 00010000:00010000:0.0:1782759733.492177:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1782759733.492186:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000001:00080000:0.0:1782759733.498079:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967425 is committed 00002000:00010000:2.0:1782759733.498246:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1782759733.498252:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:2.0:1782759733.498267:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.498280:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.498296:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.498303:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759733.498308:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.498317:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.498337:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.498345:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60db1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759733.498466:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218594432:12345-192.168.202.31@tcp:4:dd.0 Request processed in 29081us (29602us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1782759733.498480:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 64 00000100:00100000:3.0:1782759733.505564:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.505795:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594560 00000100:00100000:0.0:1782759733.505805:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594560 00000100:00100000:0.0:1782759733.505879:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 65 00000100:00100000:0.0:1782759733.505889:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218594560:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759733.505936:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 2097152, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x1000 00010000:00010000:0.0:1782759733.505946:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.505964:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:0.0:1782759733.505969:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759733.505976:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.505990:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.529154:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000100:00100000:0.0:1782759733.529281:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf877100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233069440:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759733.529347:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759733.529414:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759733.529712:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069440 00000100:00100000:1.0:1782759733.529721:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069440 00000100:00100000:1.0:1782759733.529782:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1782759733.529792:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233069440:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:1.0:1782759733.529822:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759733.530052:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233069440:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 261us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.530060:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1782759733.530316:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf877100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233069440:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759733.530350:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00010000:00010000:0.0:1782759733.530361:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000001:00080000:2.0:1782759733.539630:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967426 is committed 00002000:00010000:0.0:1782759733.542509:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1782759733.542520:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:0.0:1782759733.542535:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.542549:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.542559:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.542567:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759733.542572:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.542743:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.542763:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.542771:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008736483c/0xd5b45c7f5c60db21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759733.543334:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218594560:12345-192.168.202.31@tcp:4:dd.0 Request processed in 37440us (37774us total) trans 4294967426 rc 0/0 00000100:00100000:0.0:1782759733.543363:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 65 00000100:00100000:2.0:1782759733.551261:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759733.551353:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594688 00000100:00100000:1.0:1782759733.551363:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594688 00000100:00100000:1.0:1782759733.551442:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 66 00000100:00100000:1.0:1782759733.551451:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218594688:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759733.551504:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 3145728, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x1800 00010000:00010000:1.0:1782759733.551514:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.551531:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:1.0:1782759733.551536:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759733.551543:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.551558:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.564274:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:1.0:1782759733.564333:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233069568:0@lo:601:ll_ost_io00_000.0 00000100:00100000:1.0:1782759733.564396:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.564457:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513840 going to sleep for 11 seconds 00000100:00100000:1.0:1782759733.564481:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069568 00000100:00100000:1.0:1782759733.564488:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069568 00000100:00100000:1.0:1782759733.564537:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1782759733.564546:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233069568:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:1.0:1782759733.564601:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759733.564824:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233069568:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 278us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.564832:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1782759733.564875:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233069568:0@lo:601:ll_ost_io00_000.0 00010000:00010000:1.0:1782759733.564900:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:1.0:1782759733.564910:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:0.0:1782759733.570529:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967427 is committed 00002000:00010000:1.0:1782759733.570976:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1782759733.570983:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:1.0:1782759733.570998:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.571086:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.571096:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.571104:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759733.571109:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.571118:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.571152:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.571160:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d119f65/0xd5b45c7f5c60db28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759733.571306:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218594688:12345-192.168.202.31@tcp:4:dd.0 Request processed in 19848us (20048us total) trans 4294967427 rc 0/0 00000100:00100000:1.0:1782759733.571317:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 66 00000100:00100000:0.0:1782759733.576947:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759733.577103:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594816 00000100:00100000:3.0:1782759733.577113:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594816 00000100:00100000:3.0:1782759733.577222:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00100000:3.0:1782759733.577233:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218594816:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759733.577281:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 4194304, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x2000 00010000:00010000:3.0:1782759733.577291:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.577308:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:3.0:1782759733.577313:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759733.577319:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.577335:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.610449:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:3.0:1782759733.610507:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233069696:0@lo:601:ll_ost_io00_002.0 00000100:00100000:3.0:1782759733.610569:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759733.610718:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069696 00000100:00100000:0.0:1782759733.610726:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069696 00000100:00100000:0.0:1782759733.610786:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1782759733.610796:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9330050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233069696:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:0.0:1782759733.610823:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759733.611045:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759733.611438:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9330050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233069696:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 642us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.611447:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1782759733.612389:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233069696:0@lo:601:ll_ost_io00_002.0 00010000:00010000:3.0:1782759733.612476:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1782759733.612489:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:0.0:1782759733.616388:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967428 is committed 00002000:00010000:2.0:1782759733.616536:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1782759733.616543:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:2.0:1782759733.616558:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.616712:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.616721:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.616728:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759733.616733:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.616743:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.616767:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.616775:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd7ed91e/0xd5b45c7f5c60db2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759733.616986:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218594816:12345-192.168.202.31@tcp:4:dd.0 Request processed in 39751us (40046us total) trans 4294967428 rc 0/0 00000100:00100000:2.0:1782759733.616997:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 67 00000100:00100000:1.0:1782759733.623768:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759733.623941:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218594944 00000100:00100000:2.0:1782759733.623951:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218594944 00000100:00100000:2.0:1782759733.624039:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 68 00000100:00100000:2.0:1782759733.624052:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218594944:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759733.624120:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 5242880, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x2800 00010000:00010000:2.0:1782759733.624130:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.624146:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:2.0:1782759733.624151:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759733.624158:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.624172:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.634290:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:3.0:1782759733.634352:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233069824:0@lo:601:ll_ost_io00_003.0 00000100:00100000:3.0:1782759733.634413:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759733.634479:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759733.635180:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069824 00000100:00100000:0.0:1782759733.635188:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069824 00000100:00100000:0.0:1782759733.635243:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1782759733.635253:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233069824:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:0.0:1782759733.635286:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759733.635503:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233069824:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 251us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.635511:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1782759733.635954:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233069824:0@lo:601:ll_ost_io00_003.0 00010000:00010000:3.0:1782759733.635990:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:3.0:1782759733.636076:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:0.0:1782759733.640564:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967429 is committed 00002000:00010000:3.0:1782759733.641070:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:3.0:1782759733.641076:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:3.0:1782759733.641095:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.641110:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.641119:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.641127:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759733.641133:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.641142:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.641164:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.641172:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8258051/0xd5b45c7f5c60db36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759733.641322:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218594944:12345-192.168.202.31@tcp:4:dd.0 Request processed in 17268us (17559us total) trans 4294967429 rc 0/0 00000100:00100000:3.0:1782759733.641348:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 68 00000100:00100000:2.0:1782759733.647329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.647424:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218595072 00000100:00100000:0.0:1782759733.647433:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218595072 00000100:00100000:0.0:1782759733.647524:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 69 00000100:00100000:0.0:1782759733.647535:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218595072:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759733.647767:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 6291456, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x3000 00010000:00010000:0.0:1782759733.647778:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.647794:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:0.0:1782759733.647798:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759733.647815:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.647830:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.661314:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:3.0:1782759733.661374:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233069952:0@lo:601:ll_ost_io00_001.0 00000100:00100000:3.0:1782759733.661436:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759733.661502:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4d089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759733.661605:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233069952 00000100:00100000:0.0:1782759733.661613:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233069952 00000100:00100000:0.0:1782759733.661677:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1782759733.661687:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233069952:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:0.0:1782759733.661731:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759733.662144:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233069952:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 457us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.662151:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1782759733.662306:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233069952:0@lo:601:ll_ost_io00_001.0 00010000:00010000:3.0:1782759733.662382:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:3.0:1782759733.662393:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000001:00080000:2.0:1782759733.667904:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967430 is committed 00002000:00010000:0.0:1782759733.668308:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1782759733.668314:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:0.0:1782759733.668331:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.668355:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.668365:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.668372:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759733.668376:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.668386:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.668408:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.668417:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759733.668639:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218595072:12345-192.168.202.31@tcp:4:dd.0 Request processed in 21035us (21250us total) trans 4294967430 rc 0/0 00000100:00100000:0.0:1782759733.668653:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 69 00000100:00100000:2.0:1782759733.675174:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759733.675258:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218595200 00000100:00100000:1.0:1782759733.675268:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218595200 00000100:00100000:1.0:1782759733.675378:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 70 00000100:00100000:1.0:1782759733.675389:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218595200:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759733.675442:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 7340032, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x3800 00010000:00010000:1.0:1782759733.675451:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.675468:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:1.0:1782759733.675472:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759733.675479:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.675494:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.686392:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:1.0:1782759733.686450:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233070080:0@lo:601:ll_ost_io00_000.0 00000100:00100000:1.0:1782759733.686506:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.686574:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759733.686937:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070080 00000100:00100000:3.0:1782759733.687418:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070080 00000100:00100000:2.0:1782759733.688485:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1782759733.688512:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233070080:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:2.0:1782759733.688551:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759733.688993:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233070080:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 496us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759733.689075:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1782759733.689155:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233070080:0@lo:601:ll_ost_io00_000.0 00010000:00010000:1.0:1782759733.689195:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:1.0:1782759733.689207:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:0.0:1782759733.693569:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967431 is committed 00002000:00010000:1.0:1782759733.694127:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:1.0:1782759733.694133:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:1.0:1782759733.694148:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.694161:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.694170:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.694176:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759733.694196:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.694206:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.694226:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.694234:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60db44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759733.694332:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218595200:12345-192.168.202.31@tcp:4:dd.0 Request processed in 18941us (19164us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1782759733.694342:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 70 00000100:00100000:2.0:1782759733.703173:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759733.703772:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218595328 00000100:00100000:1.0:1782759733.703782:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218595328 00000100:00100000:1.0:1782759733.704115:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 71 00000100:00100000:1.0:1782759733.704128:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218595328:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759733.704179:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 8388608, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x4000 00010000:00010000:1.0:1782759733.704189:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.704207:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3773s v=(0 0) 00010000:00010000:1.0:1782759733.704212:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759733.704218:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.704256:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.720477:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:1.0:1782759733.720913:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233070208:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759733.720984:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.721173:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759733.721293:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070208 00000100:00100000:0.0:1782759733.721301:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070208 00000100:00100000:0.0:1782759733.721387:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1782759733.721397:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233070208:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:0.0:1782759733.721427:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759733.721899:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aea00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233070336:0@lo:106: 00000100:00100000:1.0:1782759733.721928:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759733.721955:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759733.721969:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070336 00000100:00100000:1.0:1782759733.721973:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070336 00000100:00100000:1.0:1782759733.722014:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1782759733.722022:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233070336:12345-0@lo:106: 00010000:00010000:1.0:1782759733.722032:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1782759733.722041:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:1.0:1782759733.722087:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233070336:12345-0@lo:106: Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759733.722095:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1782759733.722149:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aea00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233070336:0@lo:106: 00000100:00100000:0.0:1782759733.722365:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233070208:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 969us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.722373:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1782759733.722865:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233070208:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759733.722902:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1782759733.722921:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000001:00080000:0.0:1782759733.728246:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967432 is committed 00002000:00010000:2.0:1782759733.728453:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1782759733.728459:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:2.0:1782759733.728472:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.728485:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.728495:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.728502:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759733.728506:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.728514:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.728797:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.728865:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee44090/0xd5b45c7f5c60db4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759733.729088:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218595328:12345-192.168.202.31@tcp:4:dd.0 Request processed in 24958us (25920us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1782759733.729099:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 71 00000100:00100000:2.0:1782759733.738378:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759733.738460:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218595456 00000100:00100000:3.0:1782759733.738470:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218595456 00000100:00100000:3.0:1782759733.738552:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 72 00000100:00100000:3.0:1782759733.738571:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218595456:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759733.739005:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 9437184, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x4800 00010000:00010000:3.0:1782759733.739016:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.739032:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3774s v=(0 0) 00010000:00010000:3.0:1782759733.739036:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759733.739059:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759733.739076:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750167:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750189:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750198:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750205:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759733.750211:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750221:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750241:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759733.750249:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007101a54e/0xd5b45c7f5c60db52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759733.750420:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218595456:12345-192.168.202.31@tcp:4:dd.0 Request processed in 11847us (12048us total) trans 0 rc -122/-122 00000100:00100000:2.0:1782759733.750431:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 72 00000100:00100000:0.0:1782759733.755548:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759733.755742:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218595712 00000100:00100000:2.0:1782759733.755752:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218595712 00000100:00100000:2.0:1782759733.755886:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 396 00000100:00100000:2.0:1782759733.755896:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:113467:x1869355218595712:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:2.0:1782759733.756227:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:113467:x1869355218595712:12345-192.168.202.31@tcp:35:dd.0 Request processed in 331us (691us total) trans 4294967737 rc 0/0 00000100:00100000:2.0:1782759733.756238:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 396 00000100:00100000:1.0:1782759733.809735:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.810432:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218595840 00000100:00100000:0.0:1782759733.810446:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218595840 00000100:00100000:0.0:1782759733.810518:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1110 00000100:00100000:0.0:1782759733.810546:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218595840:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759733.810568:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759733.810632:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27704 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759733.810662:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 9437184, mtime: 0x6a42c136, atime: 0x0, ctime: 0x6a42c136, blocks: 0x4800 00010000:00010000:0.0:1782759733.810684:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=3774s v=(0 0) 00010000:00010000:0.0:1782759733.810689:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759733.810708:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.810895:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.810910:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803800, rc 0) 00000100:00100000:0.0:1782759733.811442:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218595840:12345-192.168.202.31@tcp:101:rm.0 Request processed in 901us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759733.811451:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1110 00000100:00100000:1.0:1782759733.818717:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759733.820960:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596096 00000100:00100000:0.0:1782759733.820975:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596096 00000100:00100000:0.0:1782759733.821365:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3067 00000100:00100000:0.0:1782759733.821377:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:113470:x1869355218596096:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782759733.821441:0:42628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759733.821482:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60daf7 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb276fd expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.821504:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x28:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:0.0:1782759733.821515:0:42628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759733.821541:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.821554:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.821564:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824183:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824216:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824230:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824362:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 3/0,1 mode: --/EX res: [0x240000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824372:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824379:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759733.824656:0:42628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9688 00000004:00080000:0.0:1782759733.824667:0:42628:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3774101088968ns, next at 3775101086484ns, rc = 0 00010000:00010000:0.0:1782759733.824746:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824755:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824763:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824771:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824777:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824783:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824814:0:42628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759733.824840:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824847:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824853:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824858:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759733.824862:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824869:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824881:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x28:0x0].0x0 (ffff8cdecda0ae00) 00010000:00010000:0.0:1782759733.824884:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759733.824889:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 2/0,0 mode: --/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824895:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60db6e lrc: 0/0,0 mode: --/EX res: [0x240000405:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824915:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824920:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824925:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824930:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824935:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759733.824938:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824943:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824951:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cdecda0af00) 00010000:00010000:0.0:1782759733.824954:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759733.824957:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824963:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60db60 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759733.824978:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002397649d reply state 00000000c95e68e3 transno 4294967738 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824986:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759733.824990:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0a300) 00010000:00010000:0.0:1782759733.824992:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759733.824994:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759733.825074:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:113470:x1869355218596096:12345-192.168.202.31@tcp:36:rm.0 Request processed in 3696us (6364us total) trans 4294967738 rc 0/0 00000100:00100000:0.0:1782759733.825083:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3067 00010000:00010000:1.0:1782759733.826230:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759733.826250:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.826260:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759733.826264:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.826272:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.826285:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x28:0x0].0x0 (ffff8cdecda0ae00) 00010000:00010000:1.0:1782759733.826288:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1782759733.826292:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.826298:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60db75 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759733.826317:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759733.826318:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759733.826320:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759734.155364:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759734.155390:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233070464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759734.155464:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759734.155609:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070464 00000100:00100000:1.0:1782759734.155617:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070464 00000100:00100000:1.0:1782759734.155699:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3455 00000100:00100000:1.0:1782759734.155709:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233070464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759734.155754:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759734.155817:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233070464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759734.155839:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3455 00000100:00100000:2.0:1782759734.156502:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233070464:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759734.219330:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759735.180165:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233070976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180240:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180303:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233071488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180330:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180349:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233072000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180370:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180396:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782759735.180402:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233070592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180428:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180448:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233071104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180470:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180484:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233071616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180505:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180520:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233072128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.180539:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.180567:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070976 00000100:00100000:0.0:1782759735.180599:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070976 00000100:00100000:0.0:1782759735.180647:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5392 00000100:00100000:0.0:1782759735.180656:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233070976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181350:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233070976:12345-0@lo:400:kworker.0 Request processed in 692us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.181360:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5392 00000100:00100000:0.0:1782759735.181390:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071488 00000100:00100000:0.0:1782759735.181394:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071488 00000100:00100000:0.0:1782759735.181437:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072000 00000100:00100000:0.0:1782759735.181440:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072000 00000100:00100000:0.0:1782759735.181454:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071616 00000100:00100000:0.0:1782759735.181457:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071616 00000100:00100000:0.0:1782759735.181469:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072128 00000100:00100000:0.0:1782759735.181473:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072128 00000100:00100000:0.0:1782759735.181489:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3153 00000100:00100000:0.0:1782759735.181495:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233071488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181530:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233071488:12345-0@lo:400:kworker.0 Request processed in 36us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.181536:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3153 00000100:00100000:0.0:1782759735.181548:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1782759735.181553:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233072000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181602:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233072000:12345-0@lo:400:kworker.0 Request processed in 48us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.181608:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3154 00000100:00100000:0.0:1782759735.181619:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1782759735.181625:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233071616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181651:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233071616:12345-0@lo:400:kworker.0 Request processed in 26us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.181657:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3155 00000100:00100000:0.0:1782759735.181668:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3156 00000100:00100000:0.0:1782759735.181674:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233072128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181709:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233072128:12345-0@lo:400:kworker.0 Request processed in 35us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.181714:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3156 00000100:00080000:0.0:1782759735.181816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759735.181820:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759735.181853:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233071616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181865:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233072128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181878:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233070976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181886:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233071488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.181894:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233072000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.182437:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233070720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.182479:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759735.182516:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233071232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.182540:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759735.182557:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233071744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.182602:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759735.182624:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759735.182631:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233070848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.182654:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759735.182672:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233071360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.182705:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.183056:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070720 00000100:00100000:0.0:1782759735.183062:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070720 00000100:00100000:0.0:1782759735.183104:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071232 00000100:00100000:0.0:1782759735.183107:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071232 00000100:00100000:0.0:1782759735.183134:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071744 00000100:00100000:0.0:1782759735.183137:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071744 00000100:00100000:0.0:1782759735.183151:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071360 00000100:00100000:0.0:1782759735.183153:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071360 00000100:00100000:0.0:1782759735.183169:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5393 00000100:00100000:0.0:1782759735.183176:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233070720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.183221:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233070720:12345-0@lo:400:kworker.0 Request processed in 45us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.183228:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5393 00000100:00100000:0.0:1782759735.183243:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5394 00000100:00100000:0.0:1782759735.183262:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233071232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.183291:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233071232:12345-0@lo:400:kworker.0 Request processed in 43us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.183298:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5394 00000100:00100000:0.0:1782759735.183312:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5395 00000100:00100000:0.0:1782759735.183318:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233071744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.183347:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233071744:12345-0@lo:400:kworker.0 Request processed in 29us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.183356:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5395 00000100:00100000:0.0:1782759735.183366:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5396 00000100:00100000:0.0:1782759735.183390:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233071360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.183419:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233071360:12345-0@lo:400:kworker.0 Request processed in 47us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.183425:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5396 00000100:00080000:0.0:1782759735.183518:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759735.183522:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759735.183814:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233071872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.183847:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759735.183890:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233070720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.183902:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233071232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.183911:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233071744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.183943:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233071360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.183972:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070592 00000100:00100000:1.0:1782759735.183976:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070592 00000100:00100000:1.0:1782759735.184048:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410 00000100:00100000:1.0:1782759735.184056:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233070592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.184106:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233070592:12345-0@lo:400:kworker.0 Request processed in 51us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759735.184112:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410 00000100:00100000:0.0:1782759735.184168:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071872 00000100:00100000:0.0:1782759735.184172:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071872 00000100:00100000:0.0:1782759735.184202:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5397 00000100:00100000:0.0:1782759735.184208:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233071872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.184242:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233071872:12345-0@lo:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.184258:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5397 00000100:00080000:0.0:1782759735.184273:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759735.184903:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233071104 00000100:00100000:0.0:1782759735.184910:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233071104 00000100:00100000:0.0:1782759735.184963:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233070848 00000100:00100000:0.0:1782759735.184967:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233070848 00000100:00100000:0.0:1782759735.184984:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3456 00000100:00100000:0.0:1782759735.184990:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233071104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.185030:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233071104:12345-0@lo:400:kworker.0 Request processed in 40us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.185037:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3456 00000100:00100000:0.0:1782759735.185050:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457 00000100:00100000:0.0:1782759735.185056:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759735.185086:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233070848:12345-0@lo:400:kworker.0 Request processed in 30us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.185090:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457 00000100:00100000:1.0:1782759735.189486:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233070848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.189505:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233071872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.189551:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233070592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759735.189565:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233071104:0@lo:400:kworker.0 00010000:00010000:1.0:1782759735.242823:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759735.695912:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233072384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759735.695991:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.696064:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759735.696072:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233072256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759735.696097:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759735.696134:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072384 00000100:00100000:0.0:1782759735.696142:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072384 00000100:00100000:0.0:1782759735.696198:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072256 00000100:00100000:0.0:1782759735.696201:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072256 00000100:00100000:0.0:1782759735.696219:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1782759735.696227:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233072384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759735.696256:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759735.696305:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233072384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.696312:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1782759735.696329:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1782759735.696335:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233072256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759735.696344:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759735.696365:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233072256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759735.696370:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1782759735.696413:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233072256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759735.696424:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233072384:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759736.277230:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782759736.709167:0:158001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3776985587863ns, next at 3547591138841ns, rc = 0 00080000:00080000:3.0:1782759736.709185:0:158001:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1782759736.709342:0:158001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3776985764450ns, next at 3775101086484ns, rc = 0 00080000:00080000:3.0:1782759736.709348:0:158001:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1782759736.711307:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00000100:00100000:3.0:1782759736.714747:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1782759736.714771:0:8592:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3776991191312ns, next at 3777991187797ns, rc = 0 00000100:00100000:3.0:1782759736.714774:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233072512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759736.714849:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759736.714974:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759736.714988:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233072640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759736.715025:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759736.715080:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072512 00000100:00100000:3.0:1782759736.715087:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072512 00000100:00100000:3.0:1782759736.715139:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072640 00000100:00100000:3.0:1782759736.715141:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072640 00000100:00100000:3.0:1782759736.715156:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:3.0:1782759736.715161:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233072512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759736.715190:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3914084352 avail 3682562048 00000100:00100000:1.0:1782759736.715201:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:1.0:1782759736.715214:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233072640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759736.715228:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3914084352 avail 3682562048 00000100:00100000:3.0:1782759736.715251:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233072512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759736.715259:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:1.0:1782759736.715269:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233072640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759736.715277:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00000100:00100000:3.0:1782759736.715310:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233072512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759736.715350:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233072640:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1782759736.718520:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 93 committed 00000001:00080000:3.0:1782759736.718563:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967738 is committed 00000004:00080000:3.0:1782759736.718570:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 92 committed 00000100:00100000:0.0:1782759736.718851:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233072768:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1782759736.718935:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759736.718994:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759736.719003:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233072896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759736.719035:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759736.719098:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072768 00000100:00100000:0.0:1782759736.719108:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072768 00000100:00100000:1.0:1782759736.719114:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233072896 00000100:00100000:1.0:1782759736.719121:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233072896 00000100:00100000:0.0:1782759736.719182:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1782759736.719184:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:1.0:1782759736.719201:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233072896:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759736.719201:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233072768:12345-0@lo:6:osp-syn-0-1.0 00000004:00000024:1.0:1782759736.719243:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00002000:00080000:0.0:1782759736.719244:0:8600:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:24 count 1 00010000:00010000:0.0:1782759736.719284:0:8600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759736.719305:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233072896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (268us total) trans 0 rc 0/0 00010000:00010000:0.0:1782759736.719311:0:8600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759736.719316:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00010000:00010000:0.0:1782759736.719324:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1782759736.719329:0:8600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759736.719336:0:8600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759736.719370:0:8600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759736.719387:0:8600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 7 pid: 8446 timeout: 3876 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759736.719405:0:8600:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8600:1869355233073024:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759736.719474:0:8600:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5523600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759736.719516:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233072896:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782759736.719966:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.719978:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.719986:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.719993:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759736.720004:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720013:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720029:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0a300) 00010000:00010000:2.0:1782759736.720032:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759736.720037:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720043:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60daf0 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720059:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720065:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720071:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720076:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759736.720079:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720085:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720092:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0a300) 00010000:00010000:2.0:1782759736.720094:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759736.720101:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759736.720107:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60db67 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759736.723835:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759736.725122:0:8600:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8600:1869355233073024:192.168.202.31@tcp:104: 00010000:00010000:0.0:1782759736.725151:0:8600:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759736.725541:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596224 00000100:00100000:3.0:1782759736.725549:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596224 00010000:00010000:3.0:1782759736.725636:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 8 pid: 8446 timeout: 3876 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759736.725637:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759736.725690:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 863 00000100:00100000:3.0:1782759736.725702:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218596224:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759736.725719:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759736.725725:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 8 pid: 8446 timeout: 3876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759736.725738:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 8 pid: 8446 timeout: 3876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759736.725763:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b9a9b37/0xd5b45c7f5c60db59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27704 expref: 8 pid: 8446 timeout: 3876 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759736.725780:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782759736.725784:0:6517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759736.725789:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759736.725799:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759736.725845:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759736.725904:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218596224:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 204us (2080us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759736.725912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 863 00010000:00010000:0.0:1782759736.726789:0:8600:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759736.726804:0:8600:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759736.726816:0:8600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759736.726824:0:8600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759736.726850:0:8600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782759736.728896:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1782759736.728965:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233072768:12345-0@lo:6:osp-syn-0-1.0 Request processed in 9766us (10024us total) trans 4294967433 rc 0/0 00000004:00080000:2.0:1782759736.728970:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cdedf874380/2, rc 0, transno 4294967433 00000100:00100000:0.0:1782759736.728986:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1782759736.728996:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233072768:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1782759736.729083:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759736.729098:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759736.729104:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759736.729116:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759736.729138:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759736.729146:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cfb1a48/0xd5b45c7f5c60db7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759736.729171:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759736.729172:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759736.729174:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782759736.729333:0:158001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3777005754141ns, next at 3705288120531ns, rc = 0 00080000:00080000:3.0:1782759736.729346:0:158001:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1782759736.729455:0:158001:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3777005876713ns, next at 3757531147881ns, rc = 0 00080000:00080000:3.0:1782759736.729461:0:158001:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1782759736.730361:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00000004:00080000:3.0:1782759736.738701:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 96 committed 00000004:00080000:3.0:1782759736.738728:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 94 committed 00000100:00100000:2.0:1782759737.059684:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759737.059717:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759737.059795:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759737.059824:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759737.059877:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596864 00000100:00100000:1.0:1782759737.059887:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596864 00000100:00100000:1.0:1782759737.059946:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3157 00000100:00100000:1.0:1782759737.059956:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218596864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759737.060028:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218596864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 74us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759737.060052:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3157 00000100:00100000:0.0:1782759737.060345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596352 00000100:00100000:0.0:1782759737.060351:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596352 00000100:00100000:0.0:1782759737.060393:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3411 00000100:00100000:0.0:1782759737.060401:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218596352:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759737.060439:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218596352:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759737.060446:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3411 00000100:00080000:0.0:1782759737.060473:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759737.062762:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759737.062891:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596736 00000100:00100000:1.0:1782759737.062901:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596736 00000100:00100000:1.0:1782759737.062955:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3158 00000100:00100000:1.0:1782759737.062964:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218596736:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759737.063032:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218596736:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 68us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759737.063040:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3158 00000100:00100000:3.0:1782759737.066393:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596608 00000100:00100000:3.0:1782759737.066411:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596608 00000100:00100000:2.0:1782759737.067552:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596480 00000100:00100000:2.0:1782759737.067560:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596480 00000100:00100000:2.0:1782759737.067634:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5398 00000100:00100000:2.0:1782759737.067654:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218596608:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759737.067764:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218596608:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 122us (8045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759737.067773:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5398 00000100:00100000:2.0:1782759737.067792:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5399 00000100:00100000:2.0:1782759737.067801:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218596480:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759737.067827:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218596480:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759737.067833:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5399 00000100:00080000:1.0:1782759737.068170:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759737.068175:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1782759737.290882:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759737.711320:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233073152:0@lo:601:kworker.0 00000100:00100000:2.0:1782759737.711411:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759737.711599:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073152 00000100:00100000:0.0:1782759737.711608:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073152 00000100:00100000:0.0:1782759737.711709:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1782759737.711720:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9332c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233073152:12345-0@lo:601:kworker.0 00000100:00100000:0.0:1782759737.712280:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9332c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233073152:12345-0@lo:601:kworker.0 Request processed in 561us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759737.712289:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1782759737.712395:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233073280:0@lo:106: 00000100:00100000:0.0:1782759737.712471:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759737.712496:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5661480 going to sleep for 11 seconds 00000100:00080000:2.0:1782759737.713159:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759737.713223:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233073152:0@lo:601:kworker.0 00000100:00100000:2.0:1782759737.713255:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073280 00000100:00100000:2.0:1782759737.713260:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073280 00000100:00100000:2.0:1782759737.713321:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1782759737.713331:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233073280:12345-0@lo:106: 00010000:00010000:2.0:1782759737.713344:0:18645:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:2.0:1782759737.713355:0:18645:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:2.0:1782759737.713408:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233073280:12345-0@lo:106: Request processed in 79us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759737.713414:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:2.0:1782759737.713459:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233073280:0@lo:106: 00010000:00010000:0.0:1782759737.718918:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759737.719598:0:8471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759737.719609:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759737.719618:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759737.719642:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759737.720287:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759737.720296:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759737.720317:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7200 already unused, calling callback (ffffffffc14b8e50) 00040000:00010000:3.0:1782759737.720321:0:6518:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759737.720330:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00040000:00010000:3.0:1782759737.720337:0:6518:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759737.720384:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759737.720401:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759737.720438:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759737.720445:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdecd8a7200/0xd5b45c7f5c60db0c lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60db13 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759737.720465:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759737.720467:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759737.720469:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759737.720601:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233073408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759737.720691:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759737.721085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073408 00000100:00100000:3.0:1782759737.721093:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073408 00000100:00100000:3.0:1782759737.721148:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1782759737.721156:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3663:x1869355233073408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759737.721170:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759737.721186:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60db13 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60db0c expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759737.721217:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759737.721261:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233073408:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759737.721269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1782759737.721322:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233073408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759738.314770:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759739.304903:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759739.304937:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233073536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759739.305052:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759739.305639:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073536 00000100:00100000:3.0:1782759739.305661:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073536 00000100:00100000:3.0:1782759739.305753:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:3.0:1782759739.305766:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233073536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759739.305833:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:3.0:1782759739.305905:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233073536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759739.305913:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:1.0:1782759739.306378:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233073536:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759739.339038:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759739.796392:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967433 is committed 00000100:00100000:1.0:1782759740.299107:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233073792:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.299144:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233074048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.299259:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759740.299332:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233074560:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.299364:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759740.299385:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233075072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.299407:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759740.299437:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1782759740.299448:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233073664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.299684:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759740.299749:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759740.299819:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233074304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.299852:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759740.299945:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233074176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.299978:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233074816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.299996:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759740.300026:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759740.300042:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074048 00000100:00100000:2.0:1782759740.300049:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074048 00000100:00100000:0.0:1782759740.300068:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074560 00000100:00100000:0.0:1782759740.300075:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074560 00000100:00100000:2.0:1782759740.300097:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073792 00000100:00100000:2.0:1782759740.300100:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073792 00000100:00100000:3.0:1782759740.300128:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233074688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.300131:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074304 00000100:00100000:0.0:1782759740.300134:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075072 00000100:00100000:2.0:1782759740.300137:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074304 00000100:00100000:0.0:1782759740.300140:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075072 00000100:00100000:2.0:1782759740.300167:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5400 00000100:00100000:3.0:1782759740.300185:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759740.300187:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3159 00000100:00100000:2.0:1782759740.300196:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233074048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759740.300200:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233074560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.300291:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233075200:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.300742:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759740.300748:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233074048:12345-0@lo:400:kworker.0 Request processed in 572us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759740.300752:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233073920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.300801:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759740.300822:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233074432:0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.300835:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5400 00000100:00100000:1.0:1782759740.300842:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759740.300851:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233074944:0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.300853:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074816 00000100:00100000:2.0:1782759740.300856:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074816 00000100:00100000:1.0:1782759740.300869:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759740.300874:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074432 00000100:00100000:2.0:1782759740.300876:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074432 00000100:00100000:2.0:1782759740.300889:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074944 00000100:00100000:2.0:1782759740.300891:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074944 00000100:00100000:1.0:1782759740.300902:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073664 00000100:00100000:1.0:1782759740.300905:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073664 00000100:00100000:2.0:1782759740.300906:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5401 00000100:00100000:2.0:1782759740.300912:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.300930:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:1.0:1782759740.300936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233073664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.300946:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233073792:12345-0@lo:400:kworker.0 Request processed in 35us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.300952:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5401 00000100:00100000:1.0:1782759740.300963:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233073664:12345-0@lo:400:kworker.0 Request processed in 27us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.300964:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5402 00000100:00100000:2.0:1782759740.300970:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233074304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.300997:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233074304:12345-0@lo:400:kworker.0 Request processed in 28us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.301003:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5402 00000100:00100000:2.0:1782759740.301014:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5403 00000100:00100000:2.0:1782759740.301021:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233074816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.301047:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233074816:12345-0@lo:400:kworker.0 Request processed in 27us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.301052:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5403 00000100:00100000:2.0:1782759740.301062:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5404 00000100:00100000:2.0:1782759740.301069:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.301095:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233074432:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.301111:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5404 00000100:00100000:2.0:1782759740.301123:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5405 00000100:00100000:2.0:1782759740.301130:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233074944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.301156:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233074944:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.301162:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5405 00000100:00100000:1.0:1782759740.301163:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:1.0:1782759740.301207:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074688 00000100:00100000:1.0:1782759740.301211:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074688 00000100:00100000:0.0:1782759740.301217:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233074560:12345-0@lo:400:kworker.0 Request processed in 1020us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759740.301226:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3159 00000100:00100000:1.0:1782759740.301305:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3160 00000100:00100000:1.0:1782759740.301313:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233075072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301348:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233075072:12345-0@lo:400:kworker.0 Request processed in 37us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759740.301354:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3160 00000100:00100000:1.0:1782759740.301364:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3161 00000100:00100000:1.0:1782759740.301370:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233074688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301397:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233074688:12345-0@lo:400:kworker.0 Request processed in 26us (1222us total) trans 0 rc 0/0 00000100:00080000:2.0:1782759740.301402:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759740.301402:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3161 00000100:00080000:2.0:1782759740.301407:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759740.301409:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759740.301411:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759740.301418:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233074176 00000100:00100000:1.0:1782759740.301426:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233074176 00000100:00100000:1.0:1782759740.301524:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233073920 00000100:00100000:1.0:1782759740.301527:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233073920 00000100:00100000:1.0:1782759740.301543:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460 00000100:00100000:2.0:1782759740.301548:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3461 00000100:00100000:1.0:1782759740.301548:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233074176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.301555:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233073920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.301605:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233073920:12345-0@lo:400:kworker.0 Request processed in 50us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759740.301605:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233074176:12345-0@lo:400:kworker.0 Request processed in 55us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.301612:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3461 00000100:00100000:1.0:1782759740.301622:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460 00000100:00100000:1.0:1782759740.301665:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233073920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301676:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233074432:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301684:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233074944:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301692:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233073792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301698:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233074304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759740.301703:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233074816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.306275:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759740.306359:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075200 00000100:00100000:2.0:1782759740.306372:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075200 00000100:00100000:3.0:1782759740.306399:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233074048:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.306427:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967433 gen 2 00000004:00080000:3.0:1782759740.306435:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cdedf874380, transno 4294967433 00000100:00100000:2.0:1782759740.306450:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3162 00000100:00100000:3.0:1782759740.306459:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233074560:0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.306463:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233075200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759740.306537:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233075200:12345-0@lo:400:kworker.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.306541:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3162 00000100:00080000:2.0:1782759740.306570:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759740.307101:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233075072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.307135:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233073664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.307148:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233074176:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.307164:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233074688:0@lo:400:kworker.0 00000100:00100000:3.0:1782759740.307178:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233075200:0@lo:400:kworker.0 00010000:00010000:3.0:1782759740.366870:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759740.811037:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233075456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759740.811134:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759740.811210:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759740.811235:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233075328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759740.811263:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759740.811299:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075456 00000100:00100000:2.0:1782759740.811309:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075456 00000100:00100000:2.0:1782759740.811394:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075328 00000100:00100000:2.0:1782759740.811398:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075328 00000100:00100000:2.0:1782759740.811422:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:2.0:1782759740.811432:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233075456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759740.811472:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759740.811525:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233075456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.811533:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:2.0:1782759740.811551:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:2.0:1782759740.811572:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233075328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759740.811609:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759740.811645:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233075328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759740.811652:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00000100:00100000:2.0:1782759740.811710:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233075328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759740.811723:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233075456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759741.387991:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759741.835033:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759741.835067:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759741.835161:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759741.835242:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075584 00000100:00100000:1.0:1782759741.835253:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075584 00000100:00100000:1.0:1782759741.835315:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:1.0:1782759741.835325:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233075584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759741.835368:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759741.835572:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233075584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 247us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759741.835607:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00000100:00100000:1.0:1782759741.835693:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233075584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759741.847974:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759741.848089:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759741.848213:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075712 00000100:00100000:2.0:1782759741.848223:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075712 00000100:00100000:2.0:1782759741.848296:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:2.0:1782759741.848307:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759741.848361:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759741.848430:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759741.848439:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00100000:2.0:1782759741.848514:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759741.852055:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233075840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759741.852165:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759741.852270:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075840 00000100:00100000:0.0:1782759741.852282:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075840 00000100:00100000:0.0:1782759741.852366:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3462 00000100:00100000:0.0:1782759741.852376:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233075840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759741.852426:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759741.852484:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233075840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759741.852492:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3462 00000100:00100000:0.0:1782759741.852556:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233075840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759742.176073:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759742.176126:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759742.176166:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759742.176196:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759742.176225:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759742.176258:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597504 00000100:00100000:2.0:1782759742.176271:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597504 00000100:00100000:2.0:1782759742.176340:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597376 00000100:00100000:2.0:1782759742.176345:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597376 00000100:00100000:2.0:1782759742.176373:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3163 00000100:00100000:2.0:1782759742.176399:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218597504:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759742.176500:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218597504:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 116us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759742.176509:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3163 00000100:00100000:2.0:1782759742.176530:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3164 00000100:00100000:2.0:1782759742.176538:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218597376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759742.176565:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218597376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759742.176570:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3164 00000100:00100000:2.0:1782759742.176630:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597248 00000100:00100000:2.0:1782759742.176651:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597248 00000100:00100000:2.0:1782759742.176682:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597120 00000100:00100000:2.0:1782759742.176684:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597120 00000100:00100000:2.0:1782759742.176703:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5406 00000100:00100000:2.0:1782759742.176708:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218597248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759742.176742:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218597248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759742.176747:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5406 00000100:00100000:2.0:1782759742.176760:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5407 00000100:00100000:2.0:1782759742.176767:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218597120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759742.176789:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218597120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759742.176795:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5407 00000100:00080000:2.0:1782759742.176816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759742.176820:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759742.176823:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759742.176825:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759742.177045:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218596992 00000100:00100000:1.0:1782759742.177051:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218596992 00000100:00100000:1.0:1782759742.177098:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3413 00000100:00100000:1.0:1782759742.177107:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218596992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759742.177139:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218596992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759742.177146:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3413 00010000:00010000:1.0:1782759742.411106:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759743.434849:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1782759744.246352:0:158230:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1782759744.246367:0:158230:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:2.0:1782759744.268446:0:158232:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782759744.268459:0:158232:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1782759744.398050:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233075968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759744.398150:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759744.398301:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233075968 00000100:00100000:2.0:1782759744.398310:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233075968 00000100:00100000:2.0:1782759744.398394:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3463 00000100:00100000:2.0:1782759744.398406:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233075968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759744.398454:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759744.398519:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233075968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759744.398527:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3463 00000100:00100000:0.0:1782759744.398698:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233075968:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759744.460360:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759745.419093:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233076096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419195:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419263:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233076608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419295:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419316:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233077120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419343:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419362:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233077632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419378:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233076224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419384:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759745.419414:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419422:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233076352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419435:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233076736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419448:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759745.419453:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419465:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233076864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419466:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233077248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419484:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419491:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233076480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419515:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419535:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233076992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419536:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076224 00000100:00100000:1.0:1782759745.419544:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076224 00000100:00100000:0.0:1782759745.419555:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.419570:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233077504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419626:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759745.419632:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076736 00000100:00100000:1.0:1782759745.419635:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076736 00000100:00100000:0.0:1782759745.419656:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076608 00000100:00100000:0.0:1782759745.419659:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076608 00000100:00100000:1.0:1782759745.419668:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077248 00000100:00100000:1.0:1782759745.419670:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077248 00000100:00100000:1.0:1782759745.419695:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076480 00000100:00100000:1.0:1782759745.419697:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076480 00000100:00100000:0.0:1782759745.419718:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076352 00000100:00100000:0.0:1782759745.419721:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076352 00000100:00100000:1.0:1782759745.419723:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5408 00000100:00100000:1.0:1782759745.419731:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233076224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419739:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3464 00000100:00100000:0.0:1782759745.419745:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233076608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419804:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233076224:12345-0@lo:400:kworker.0 Request processed in 71us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.419804:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233076608:12345-0@lo:400:kworker.0 Request processed in 57us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.419812:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5408 00000100:00100000:0.0:1782759745.419812:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3464 00000100:00100000:1.0:1782759745.419833:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5409 00000100:00100000:0.0:1782759745.419833:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1782759745.419839:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233076736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419839:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233076352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419867:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233076736:12345-0@lo:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.419872:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5409 00000100:00100000:1.0:1782759745.419884:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5410 00000100:00100000:1.0:1782759745.419890:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233077248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.419917:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233077248:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.419924:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5410 00000100:00100000:0.0:1782759745.419925:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233076352:12345-0@lo:400:kworker.0 Request processed in 88us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.419931:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:1.0:1782759745.419935:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5411 00000100:00100000:1.0:1782759745.419940:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233076480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.419951:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077120 00000100:00100000:0.0:1782759745.419954:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077120 00000100:00100000:1.0:1782759745.419973:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233076480:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.419979:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5411 00000100:00100000:0.0:1782759745.419981:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077632 00000100:00100000:0.0:1782759745.419984:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077632 00000100:00100000:0.0:1782759745.419996:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076992 00000100:00100000:0.0:1782759745.419998:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076992 00000100:00080000:1.0:1782759745.420006:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759745.420010:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759745.420011:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077504 00000100:00080000:1.0:1782759745.420013:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759745.420013:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077504 00000100:00100000:1.0:1782759745.420027:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.420034:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3165 00000100:00100000:0.0:1782759745.420039:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233077120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420042:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233077376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420064:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.420068:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233077120:12345-0@lo:400:kworker.0 Request processed in 29us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.420074:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3165 00000100:00100000:0.0:1782759745.420085:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1782759745.420090:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233077632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420104:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233076352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.420116:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233077632:12345-0@lo:400:kworker.0 Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.420121:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3166 00000100:00100000:0.0:1782759745.420131:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3167 00000100:00100000:0.0:1782759745.420137:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233076992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420139:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076864 00000100:00100000:1.0:1782759745.420142:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076864 00000100:00100000:0.0:1782759745.420162:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233076992:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.420164:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077376 00000100:00100000:1.0:1782759745.420166:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077376 00000100:00100000:0.0:1782759745.420168:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3167 00000100:00100000:0.0:1782759745.420179:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3168 00000100:00100000:1.0:1782759745.420185:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5412 00000100:00100000:0.0:1782759745.420185:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233077504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420189:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233076864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.420211:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233077504:12345-0@lo:400:kworker.0 Request processed in 26us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.420216:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233076864:12345-0@lo:400:kworker.0 Request processed in 26us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.420217:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3168 00000100:00100000:1.0:1782759745.420222:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5412 00000100:00100000:1.0:1782759745.420231:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5413 00000100:00100000:1.0:1782759745.420237:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420260:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233077376:12345-0@lo:400:kworker.0 Request processed in 24us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.420265:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5413 00000100:00100000:0.0:1782759745.420272:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233076608:0@lo:400:kworker.0 00000100:00080000:1.0:1782759745.420279:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759745.420281:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759745.420283:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233077120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.420293:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233077632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420294:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233076480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420303:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233076992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.420311:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233077504:0@lo:400:kworker.0 00000100:00100000:2.0:1782759745.420484:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233076096 00000100:00100000:2.0:1782759745.420489:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233076096 00000100:00100000:0.0:1782759745.420748:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233076224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.420760:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233076736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759745.420769:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233077248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.426393:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233076864:0@lo:400:kworker.0 00000100:00100000:1.0:1782759745.426422:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233077376:0@lo:400:kworker.0 00000100:00100000:2.0:1782759745.426445:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3414 00000100:00100000:2.0:1782759745.426481:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233076096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759745.426637:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233076096:12345-0@lo:400:kworker.0 Request processed in 181us (7441us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759745.426646:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3414 00000100:00100000:1.0:1782759745.428983:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233076096:0@lo:400:kworker.0 00010000:00010000:2.0:1782759745.493850:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759745.503068:0:158291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff86a9b60 20000000:00000080:0.0:1782759745.503097:0:158291:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3745400 uarg=0000000000000000 00010000:00010000:0.0:1782759745.503395:0:158291:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759745.503415:0:158291:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759745.503440:0:158291:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759745.503452:0:158291:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759745.503468:0:158291:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759745.503494:0:158291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.503515:0:158291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.505323:0:158291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.505407:0:158291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.505429:0:158291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 23 pid: 6526 timeout: 3935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759745.505449:0:158291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158291:1869355233077760:0@lo:104: 00000100:00100000:0.0:1782759745.505550:0:158291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.505741:0:158291:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759745.517269:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077760 00000100:00100000:1.0:1782759745.517289:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077760 00000100:00100000:1.0:1782759745.517391:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1782759745.517415:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:158291:x1869355233077760:12345-0@lo:104: 00010000:00010000:1.0:1782759745.517438:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759745.517908:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759745.517916:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:158291:x1869355233077760:12345-0@lo:104: Request processed in 516us (12367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759745.517926:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1782759745.518038:0:158291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158291:1869355233077760:0@lo:104: 00010000:00010000:0.0:1782759745.518072:0:158291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518134:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759745.518143:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518152:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759745.518156:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518167:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759745.518175:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759745.518181:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759745.518239:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518263:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759745.518302:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518310:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dad4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dadb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518333:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759745.518335:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759745.518337:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759745.518346:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759745.518364:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233077888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759745.518423:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759745.518476:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233077888 00000100:00100000:3.0:1782759745.518482:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233077888 00010000:00010000:3.0:1782759745.518508:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 24 pid: 6526 timeout: 3935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759745.518546:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1782759745.518554:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233077888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759745.518566:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759745.518572:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 24 pid: 6526 timeout: 3935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518618:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 24 pid: 6526 timeout: 3935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518634:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dadb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dad4 expref: 24 pid: 6526 timeout: 3935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518658:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518667:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518686:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518703:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518711:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518717:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518722:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759745.518727:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518735:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518747:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759745.518758:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759745.518788:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233077888:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759745.518801:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1782759745.518835:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233077888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759745.519212:0:158291:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.519222:0:158291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759745.519229:0:158291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60db83 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759745.938265:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233078144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759745.938377:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.938469:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759745.938478:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233078016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759745.938510:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759745.938555:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078144 00000100:00100000:0.0:1782759745.938565:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078144 00000100:00100000:0.0:1782759745.938664:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078016 00000100:00100000:0.0:1782759745.938668:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078016 00000100:00100000:0.0:1782759745.938695:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1782759745.938705:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233078144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759745.938750:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759745.938808:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233078144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.938816:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1782759745.938837:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1782759745.938855:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233078016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759745.938879:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 119183296 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759745.938908:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233078016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759745.938914:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1782759745.938972:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233078016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759745.938989:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233078144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759746.506776:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759746.828116:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759746.828127:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759746.828134:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759746.828200:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759746.828216:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759746.828230:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759746.828262:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233078272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759746.828352:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759746.828427:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc56e1600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759746.828500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078272 00000100:00100000:1.0:1782759746.828510:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078272 00000100:00100000:1.0:1782759746.828616:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3415 00000100:00100000:1.0:1782759746.828627:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233078272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759746.828644:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759746.828661:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60db8a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759746.828701:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759746.828713:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759746.828724:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759746.828775:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233078272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759746.828782:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3415 00000100:00100000:3.0:1782759746.829129:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233078272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759746.829147:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759746.829158:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759746.829179:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759746.829186:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759746.829193:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759746.955465:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759746.955530:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233078400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759746.955663:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759746.956013:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078400 00000100:00100000:2.0:1782759746.956023:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078400 00000100:00100000:2.0:1782759746.956111:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:2.0:1782759746.956121:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233078400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759746.956168:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:2.0:1782759746.956235:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233078400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759746.956252:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:2.0:1782759746.956334:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233078400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759746.957219:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759746.957238:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233078656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759746.957296:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759746.957349:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078656 00000100:00100000:0.0:1782759746.957356:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078656 00000100:00100000:0.0:1782759746.957400:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:0.0:1782759746.957410:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233078656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759746.957440:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759746.957486:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233078656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759746.957492:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:2.0:1782759746.957633:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233078528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759746.957667:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759746.958251:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078528 00000100:00100000:2.0:1782759746.958257:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078528 00000100:00100000:2.0:1782759746.958310:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759746.958320:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233078528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759746.958336:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759746.958376:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233078528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759746.958382:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:2.0:1782759746.958431:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233078528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759746.959389:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233078656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759747.295458:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759747.295513:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759747.295553:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597632 00000100:00100000:2.0:1782759747.295553:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759747.295569:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597632 00000100:00100000:2.0:1782759747.295621:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759747.295650:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759747.295676:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598144 00000100:00100000:2.0:1782759747.295681:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598144 00000100:00100000:2.0:1782759747.295742:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598016 00000100:00100000:2.0:1782759747.295744:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598016 00000100:00100000:2.0:1782759747.295770:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3169 00000100:00100000:2.0:1782759747.295796:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598144:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759747.295811:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3416 00000100:00100000:3.0:1782759747.295822:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218597632:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759747.295905:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598144:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 125us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759747.295914:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3169 00000100:00100000:1.0:1782759747.295932:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597888 00000100:00100000:2.0:1782759747.295933:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3170 00000100:00100000:1.0:1782759747.295937:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597888 00000100:00100000:2.0:1782759747.295941:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598016:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759747.295973:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218597760 00000100:00100000:1.0:1782759747.295976:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218597760 00000100:00100000:1.0:1782759747.295999:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5414 00000100:00100000:1.0:1782759747.296006:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218597888:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759747.297296:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218597632:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1465us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759747.297309:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3416 00000100:00100000:2.0:1782759747.297509:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598016:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1567us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759747.297521:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3170 00000100:00100000:2.0:1782759747.297557:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5415 00000100:00100000:2.0:1782759747.297603:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218597760:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759747.297655:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218597760:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 90us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759747.297663:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5415 00000100:00080000:2.0:1782759747.298344:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759747.298353:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759747.298357:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759747.298361:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759747.307074:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218597888:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 11048us (11539us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759747.307094:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5414 00010000:00010000:3.0:1782759747.530921:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759748.557226:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759749.514926:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759749.514960:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233078784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759749.515072:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759749.515215:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078784 00000100:00100000:2.0:1782759749.515227:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078784 00000100:00100000:2.0:1782759749.515342:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467 00000100:00100000:2.0:1782759749.515355:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233078784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759749.515405:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759749.515475:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233078784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759749.515497:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467 00000100:00100000:1.0:1782759749.515649:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233078784:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759749.579713:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759750.141150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759750.141334:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598400 00000100:00100000:1.0:1782759750.141351:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598400 00000100:00100000:1.0:1782759750.141462:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3068 00000100:00100000:1.0:1782759750.141475:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:113801:x1869355218598400:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782759750.141507:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759750.141540:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60db98 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2770b expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.141773:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.141806:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.141849:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.141867:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.141874:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.141881:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759750.144766:0:8593:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x18:0x0], index 1: 0 00010000:00010000:1.0:1782759750.145121:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dbad lrc: 3/1,0 mode: --/PR res: [0x240000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.145146:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dbad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.145164:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dbad lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.145219:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782759750.146147:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1782759750.148215:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148293:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148302:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148336:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759750.148341:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148354:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148379:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f6e00) 00010000:00010000:1.0:1782759750.148383:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759750.148389:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148398:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60db9f lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759750.148489:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035b3548d reply state 000000000878df30 transno 4294967739 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148510:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148517:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6f00) 00010000:00010000:1.0:1782759750.148519:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759750.148524:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759750.148656:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60db98 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2770b expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148684:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dbad lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2770b expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.148707:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x29:0x0].0x0 (ffff8cddc34f6800) 00010000:00010000:1.0:1782759750.148709:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759750.148712:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413c00, rc 0) 00000100:00100000:1.0:1782759750.149728:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:113801:x1869355218598400:12345-192.168.202.31@tcp:101:dd.0 Request processed in 8245us (8579us total) trans 4294967739 rc 0/0 00000100:00100000:1.0:1782759750.149744:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3068 00000100:00100000:2.0:1782759750.185330:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759750.185496:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598528 00000100:00100000:1.0:1782759750.185513:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598528 00000100:00100000:1.0:1782759750.185706:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 73 00000100:00100000:1.0:1782759750.185721:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218598528:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759750.185805:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1782759750.185817:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.185838:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:1.0:1782759750.185844:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759750.185853:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.185873:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782759750.188641:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759750.220338:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.220380:0:8452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.220424:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233078912:0@lo:101:ll_ost_io00_002.0 00000100:00100000:3.0:1782759750.220529:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759750.220652:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44bec00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759750.220692:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233078912 00000100:00100000:3.0:1782759750.220701:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233078912 00000100:00100000:3.0:1782759750.224896:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782759750.224917:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+6:8452:x1869355233078912:12345-0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759750.224944:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759750.224972:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dbc2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.225350:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.225362:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.225378:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7200, rc 0) 00000100:00100000:3.0:1782759750.225486:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233078912:12345-0@lo:101:ll_ost_io00_002.0 Request processed in 574us (4958us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.225495:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1782759750.226034:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233078912:0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759750.226068:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.226097:0:8452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.226131:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.226143:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00080000:3.0:1782759750.227658:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1782759750.249156:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967434 is committed 00002000:00010000:3.0:1782759750.250571:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1782759750.250607:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1782759751 00002000:00010000:3.0:1782759750.250610:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1782759751 00002000:00010000:3.0:1782759750.250613:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:3.0:1782759750.250635:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.250651:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.250662:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.250672:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759750.250677:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.250803:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.251003:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.251013:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c34cdbe/0xd5b45c7f5c60dbbb lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.251178:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218598528:12345-192.168.202.31@tcp:4:dd.0 Request processed in 65452us (65858us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1782759750.251193:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 73 00000100:00100000:3.0:1782759750.262261:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759750.267055:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598656 00000100:00100000:2.0:1782759750.267080:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598656 00000100:00100000:2.0:1782759750.267215:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 74 00000100:00100000:2.0:1782759750.269449:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598656:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759750.269538:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 1048576, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x800 00010000:00010000:2.0:1782759750.269560:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.269595:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:2.0:1782759750.269601:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759750.269609:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.269628:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.289040:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1782759750.289119:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233079040:0@lo:601:ll_ost_io00_003.0 00000100:00100000:3.0:1782759750.289193:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759750.289247:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759750.294378:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079040 00000100:00100000:2.0:1782759750.294424:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079040 00000100:00100000:3.0:1782759750.294653:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1782759750.294670:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233079040:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759750.294712:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.295032:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233079040:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 366us (5838us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.295064:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1782759750.296076:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233079040:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759750.296142:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1782759750.296178:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000001:00080000:2.0:1782759750.314972:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967435 is committed 00002000:00010000:1.0:1782759750.315618:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1782759750.315633:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:1.0:1782759750.315663:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.315677:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.315686:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.315693:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759750.315699:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.315708:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.315733:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.315741:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dbd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759750.315896:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598656:12345-192.168.202.31@tcp:4:dd.0 Request processed in 46494us (53645us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1782759750.315908:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 74 00000100:00100000:3.0:1782759750.343143:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759750.343268:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598784 00000100:00100000:1.0:1782759750.343289:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598784 00000100:00100000:1.0:1782759750.343405:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 75 00000100:00100000:1.0:1782759750.343415:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598784:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759750.343489:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 2097152, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x1000 00010000:00010000:1.0:1782759750.343499:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.343517:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:1.0:1782759750.343522:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759750.343529:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.343789:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.373509:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000100:00100000:2.0:1782759750.373888:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233079168:0@lo:601:ll_ost_io00_000.0 00000100:00100000:3.0:1782759750.374343:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759750.374417:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759750.374713:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079168 00000100:00100000:2.0:1782759750.374720:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079168 00000100:00100000:2.0:1782759750.374848:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1782759750.374859:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233079168:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:2.0:1782759750.374890:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.376209:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233079168:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 1345us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759750.376222:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1782759750.377158:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233079168:0@lo:601:ll_ost_io00_000.0 00010000:00010000:3.0:1782759750.377206:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00010000:00010000:3.0:1782759750.377220:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000001:00080000:3.0:1782759750.397676:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967436 is committed 00002000:00010000:1.0:1782759750.404993:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1782759750.405005:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:1.0:1782759750.405021:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.405034:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.405059:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.405066:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759750.405071:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.405081:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.405101:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.405108:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dbd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759750.405223:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218598784:12345-192.168.202.31@tcp:4:dd.0 Request processed in 61804us (62092us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1782759750.405235:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 75 00000100:00100000:1.0:1782759750.416950:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759750.417055:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218598912 00000100:00100000:2.0:1782759750.417066:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218598912 00000100:00100000:2.0:1782759750.417166:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 76 00000100:00100000:2.0:1782759750.417178:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218598912:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759750.417243:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 3145728, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x1800 00010000:00010000:2.0:1782759750.417255:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.417275:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:2.0:1782759750.417279:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759750.417287:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.417304:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.442873:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:0.0:1782759750.442923:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233079296:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759750.443091:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.443159:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759750.443600:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079296 00000100:00100000:3.0:1782759750.443609:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079296 00000100:00100000:3.0:1782759750.443662:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1782759750.443672:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233079296:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:3.0:1782759750.443702:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.444141:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233079296:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 468us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.444150:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1782759750.444245:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233079296:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759750.444278:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:0.0:1782759750.444290:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:3.0:1782759750.458146:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967437 is committed 00002000:00010000:0.0:1782759750.458395:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1782759750.458402:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:0.0:1782759750.458418:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.458437:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.458447:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.458455:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759750.458461:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.458470:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.458504:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.458512:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8258051/0xd5b45c7f5c60dbde lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759750.458683:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218598912:12345-192.168.202.31@tcp:4:dd.0 Request processed in 41503us (41751us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1782759750.458694:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 76 00000100:00100000:3.0:1782759750.466498:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759750.466642:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599040 00000100:00100000:0.0:1782759750.466653:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599040 00000100:00100000:0.0:1782759750.466735:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 77 00000100:00100000:0.0:1782759750.466745:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218599040:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759750.466797:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 4194304, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x2000 00010000:00010000:0.0:1782759750.466808:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.466826:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:0.0:1782759750.466831:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759750.466838:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.466854:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.485502:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:0.0:1782759750.487713:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233079424:0@lo:601:ll_ost_io00_002.0 00000100:00100000:0.0:1782759750.487800:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.487867:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759750.489220:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079424 00000100:00100000:2.0:1782759750.489233:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079424 00000100:00100000:2.0:1782759750.489317:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1782759750.489329:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233079424:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:2.0:1782759750.489374:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.492742:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233079424:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 3407us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759750.492754:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1782759750.496424:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233079424:0@lo:601:ll_ost_io00_002.0 00010000:00010000:0.0:1782759750.496495:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:0.0:1782759750.496511:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:2.0:1782759750.503043:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967438 is committed 00002000:00010000:0.0:1782759750.503438:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1782759750.503445:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:0.0:1782759750.503464:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.503729:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.503741:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.503750:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759750.503755:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.503764:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.503785:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.503793:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbe5 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759750.513364:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218599040:12345-192.168.202.31@tcp:4:dd.0 Request processed in 46603us (46872us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1782759750.513381:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 77 00000100:00100000:3.0:1782759750.526134:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759750.526334:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599168 00000100:00100000:1.0:1782759750.526346:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599168 00000100:00100000:1.0:1782759750.526444:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 78 00000100:00100000:1.0:1782759750.526457:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218599168:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759750.526524:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 5242880, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x2800 00010000:00010000:1.0:1782759750.526558:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.526622:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:1.0:1782759750.526627:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759750.526633:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.526648:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759750.541399:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233079680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541463:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541528:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233080192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541557:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541573:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233080704:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541617:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541653:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782759750.541659:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233079552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541685:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541702:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233080064:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541723:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541740:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233080576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541762:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541788:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233079808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541812:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541829:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233080320:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541848:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541861:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233080832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541881:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541900:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759750.541906:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233079936:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541926:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541943:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233080448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.541964:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.541979:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233080960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542001:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759750.542033:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079680 00000100:00100000:0.0:1782759750.542040:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079680 00000100:00100000:0.0:1782759750.542082:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080192 00000100:00100000:0.0:1782759750.542085:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080192 00000100:00100000:0.0:1782759750.542111:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080704 00000100:00100000:0.0:1782759750.542114:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080704 00000100:00100000:0.0:1782759750.542127:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080320 00000100:00100000:0.0:1782759750.542129:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080320 00000100:00100000:0.0:1782759750.542140:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079936 00000100:00100000:0.0:1782759750.542142:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079936 00000100:00100000:0.0:1782759750.542156:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5416 00000100:00100000:0.0:1782759750.542163:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233079680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542217:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233079680:12345-0@lo:400:kworker.0 Request processed in 53us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542223:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5416 00000100:00100000:0.0:1782759750.542242:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5417 00000100:00100000:0.0:1782759750.542248:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233080192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542274:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233080192:12345-0@lo:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542279:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5417 00000100:00100000:0.0:1782759750.542290:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5418 00000100:00100000:0.0:1782759750.542295:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233080704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542320:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233080704:12345-0@lo:400:kworker.0 Request processed in 25us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542325:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5418 00000100:00100000:0.0:1782759750.542337:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5419 00000100:00100000:0.0:1782759750.542342:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233080320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542371:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233080320:12345-0@lo:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542377:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5419 00000100:00100000:0.0:1782759750.542393:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5420 00000100:00100000:0.0:1782759750.542398:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233079936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542422:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233079936:12345-0@lo:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542428:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5420 00000100:00100000:0.0:1782759750.542451:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079552 00000100:00100000:0.0:1782759750.542454:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079552 00000100:00100000:0.0:1782759750.542480:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3417 00000100:00100000:0.0:1782759750.542486:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233079552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542516:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233079552:12345-0@lo:400:kworker.0 Request processed in 29us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542522:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3417 00000100:00100000:0.0:1782759750.542547:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080064 00000100:00100000:0.0:1782759750.542559:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080064 00000100:00100000:0.0:1782759750.542628:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233079808 00000100:00100000:0.0:1782759750.542631:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233079808 00000100:00100000:0.0:1782759750.542648:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3468 00000100:00100000:0.0:1782759750.542655:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542687:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233080064:12345-0@lo:400:kworker.0 Request processed in 34us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542693:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3468 00000100:00100000:0.0:1782759750.542704:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3469 00000100:00100000:0.0:1782759750.542709:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233079808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542733:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233079808:12345-0@lo:400:kworker.0 Request processed in 24us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542742:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3469 00000100:00100000:0.0:1782759750.542759:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080576 00000100:00100000:0.0:1782759750.542763:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080576 00000100:00100000:0.0:1782759750.542795:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080832 00000100:00100000:0.0:1782759750.542798:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080832 00000100:00100000:0.0:1782759750.542812:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080448 00000100:00100000:0.0:1782759750.542814:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080448 00000100:00100000:0.0:1782759750.542825:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233080960 00000100:00100000:0.0:1782759750.542828:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233080960 00000100:00100000:0.0:1782759750.542840:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3171 00000100:00100000:0.0:1782759750.542846:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233080576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542872:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233080576:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542877:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3171 00000100:00100000:0.0:1782759750.542887:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3172 00000100:00100000:0.0:1782759750.542892:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233080832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542914:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233080832:12345-0@lo:400:kworker.0 Request processed in 23us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542920:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3172 00000100:00100000:0.0:1782759750.542929:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3173 00000100:00100000:0.0:1782759750.542935:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233080448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.542958:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233080448:12345-0@lo:400:kworker.0 Request processed in 24us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.542963:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3173 00000100:00100000:0.0:1782759750.543133:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3174 00000100:00100000:0.0:1782759750.543140:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233080960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543165:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233080960:12345-0@lo:400:kworker.0 Request processed in 26us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.543170:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3174 00000100:00080000:0.0:1782759750.543203:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759750.543207:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759750.543210:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759750.543212:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759750.543249:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233079936:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543260:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233080448:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543268:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233080960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543276:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233079808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543284:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233080320:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543292:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233080832:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543328:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233079552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543339:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233080064:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543348:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233080576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543358:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233079680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543367:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233080192:0@lo:400:kworker.0 00000100:00100000:0.0:1782759750.543376:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233080704:0@lo:400:kworker.0 00010000:00010000:1.0:1782759750.544269:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:1.0:1782759750.544319:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233081088:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759750.544369:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759750.544405:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759750.547082:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081088 00000100:00100000:3.0:1782759750.547098:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081088 00000100:00100000:3.0:1782759750.547184:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1782759750.547195:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9332850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233081088:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:3.0:1782759750.547233:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.547492:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9332850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:125830:x1869355233081088:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 300us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.547500:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1782759750.548871:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0001_UUID:125830:1869355233081088:0@lo:601:ll_ost_io00_003.0 00010000:00010000:1.0:1782759750.548917:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1782759750.548931:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:2.0:1782759750.561360:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967439 is committed 00002000:00010000:1.0:1782759750.561844:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:1.0:1782759750.561851:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:1.0:1782759750.561868:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.561897:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.561907:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.561914:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759750.561919:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.561929:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.561949:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.561957:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbec lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759750.562203:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218599168:12345-192.168.202.31@tcp:4:dd.0 Request processed in 35599us (35931us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1782759750.562214:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 78 00000100:00100000:3.0:1782759750.580026:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759750.580197:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599296 00000100:00100000:1.0:1782759750.580207:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599296 00000100:00100000:1.0:1782759750.580288:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 79 00000100:00100000:1.0:1782759750.580299:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218599296:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759750.580359:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 6291456, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x3000 00010000:00010000:1.0:1782759750.580368:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.580383:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:1.0:1782759750.580387:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759750.580393:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.580405:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.602482:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:2.0:1782759750.602536:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233081216:0@lo:601:ll_ost_io00_000.0 00000100:00100000:2.0:1782759750.602623:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759750.602681:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759750.604828:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081216 00000100:00100000:0.0:1782759750.604843:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081216 00000100:00100000:0.0:1782759750.604926:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1782759750.604938:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233081216:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:0.0:1782759750.604978:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759750.605285:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:8450:x1869355233081216:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 349us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.605293:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1782759750.605692:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0001_UUID:8450:1869355233081216:0@lo:601:ll_ost_io00_000.0 00010000:00010000:2.0:1782759750.605738:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782759750.605751:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1782759750.607543:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759750.614877:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967440 is committed 00002000:00010000:2.0:1782759750.616832:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1782759750.616842:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:2.0:1782759750.616859:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.616874:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.616883:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.616890:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759750.616895:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.616904:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.616925:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.616934:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dbf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.618402:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218599296:12345-192.168.202.31@tcp:4:dd.0 Request processed in 38093us (38373us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1782759750.618415:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 79 00000100:00100000:1.0:1782759750.638299:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759750.638409:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599424 00000100:00100000:0.0:1782759750.638423:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599424 00000100:00100000:0.0:1782759750.638574:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 80 00000100:00100000:0.0:1782759750.638813:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218599424:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759750.638872:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 7340032, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x3800 00010000:00010000:0.0:1782759750.638884:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.638902:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:0.0:1782759750.638906:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759750.638914:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.638929:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.664433:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:2.0:1782759750.664491:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233081344:0@lo:601:ll_ost_io00_001.0 00000100:00100000:2.0:1782759750.664568:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759750.664666:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759750.665617:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081344 00000100:00100000:3.0:1782759750.665627:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081344 00000100:00100000:3.0:1782759750.665691:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1782759750.665710:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233081344:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:3.0:1782759750.665743:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.666087:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+7:8451:x1869355233081344:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 386us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759750.666094:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1782759750.669691:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0001_UUID:8451:1869355233081344:0@lo:601:ll_ost_io00_001.0 00010000:00010000:2.0:1782759750.669737:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:2.0:1782759750.669751:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:0.0:1782759750.673330:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967441 is committed 00002000:00010000:2.0:1782759750.673489:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:2.0:1782759750.673495:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:2.0:1782759750.673509:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.673531:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.673540:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.673556:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759750.673561:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.673618:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.673638:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759750.673646:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dbfa lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.673742:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218599424:12345-192.168.202.31@tcp:4:dd.0 Request processed in 34929us (35448us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1782759750.673752:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 80 00000100:00100000:0.0:1782759750.686151:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759750.686230:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599552 00000100:00100000:3.0:1782759750.686241:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599552 00000100:00100000:3.0:1782759750.686315:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 81 00000100:00100000:3.0:1782759750.686325:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218599552:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759750.686375:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 8388608, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x4000 00010000:00010000:3.0:1782759750.686386:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.686431:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3790s v=(0 0) 00010000:00010000:3.0:1782759750.686436:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759750.686442:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.686458:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.712786:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:1.0:1782759750.712839:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233081472:0@lo:601:ll_ost_io00_002.0 00000100:00100000:1.0:1782759750.712897:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759750.713006:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1782759750.726882:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081472 00000100:00100000:2.0:1782759750.726900:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081472 00000100:00100000:2.0:1782759750.726971:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1782759750.726981:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233081472:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:2.0:1782759750.727017:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.727305:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+7:8452:x1869355233081472:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 324us (14406us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759750.727314:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1782759750.727426:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dbd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0001_UUID:8452:1869355233081472:0@lo:601:ll_ost_io00_002.0 00010000:00010000:1.0:1782759750.727470:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:1.0:1782759750.727482:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:3.0:1782759750.728229:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233081600:0@lo:106: 00000100:00100000:3.0:1782759750.728277:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759750.728327:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44be600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759750.728439:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759750.728457:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081600 00000100:00100000:1.0:1782759750.728461:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081600 00000100:00100000:1.0:1782759750.728502:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:1.0:1782759750.728510:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233081600:12345-0@lo:106: 00010000:00010000:1.0:1782759750.728574:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759750.728615:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759750.728664:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233081600:12345-0@lo:106: Request processed in 154us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759750.728671:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1782759750.728844:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233081600:0@lo:106: 00000001:00080000:1.0:1782759750.729962:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967442 is committed 00002000:00010000:3.0:1782759750.730736:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:3.0:1782759750.730743:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x18:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:3.0:1782759750.730757:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.730782:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.730792:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.730799:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759750.730804:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.730834:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.730856:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.730864:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d371c9b/0xd5b45c7f5c60dc01 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759750.730971:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218599552:12345-192.168.202.31@tcp:4:dd.0 Request processed in 44643us (44825us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1782759750.730983:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 81 00000100:00100000:3.0:1782759750.749952:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759750.750655:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599680 00000100:00100000:1.0:1782759750.750665:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599680 00000100:00100000:1.0:1782759750.750746:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 82 00000100:00100000:1.0:1782759750.750756:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218599680:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759750.750817:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 9437184, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x4800 00010000:00010000:1.0:1782759750.750827:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.750844:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:1.0:1782759750.750848:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759750.750853:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.750866:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775878:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775898:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775908:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775917:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759750.775922:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775931:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775951:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.775960:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d93e597/0xd5b45c7f5c60dc08 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759750.781481:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218599680:12345-192.168.202.31@tcp:4:dd.0 Request processed in 30701us (31517us total) trans 0 rc -122/-122 00000100:00100000:1.0:1782759750.781497:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 82 00000100:00100000:0.0:1782759750.796900:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759750.797019:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218599936 00000100:00100000:3.0:1782759750.797030:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218599936 00000100:00100000:3.0:1782759750.797160:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 407 00000100:00100000:3.0:1782759750.797171:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:113801:x1869355218599936:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1782759750.798394:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:113801:x1869355218599936:12345-192.168.202.31@tcp:35:dd.0 Request processed in 1217us (1501us total) trans 4294967740 rc 0/0 00000100:00100000:3.0:1782759750.798407:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 407 00000001:00080000:0.0:1782759750.800935:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967740 is committed 00010000:00010000:1.0:1782759750.801015:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.801027:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.801035:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.801041:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759750.801045:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.801053:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.801071:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6f00) 00010000:00010000:1.0:1782759750.801074:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759750.801078:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759750.801094:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60dba6 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759750.873029:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759750.873121:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600064 00000100:00100000:0.0:1782759750.873131:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600064 00000100:00100000:0.0:1782759750.873202:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1112 00000100:00100000:0.0:1782759750.873212:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218600064:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759750.873233:0:82628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759750.873252:0:82628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27712 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759750.873276:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 9437184, mtime: 0x6a42c147, atime: 0x0, ctime: 0x6a42c147, blocks: 0x4800 00010000:00010000:0.0:1782759750.873295:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3791s v=(0 0) 00010000:00010000:0.0:1782759750.873300:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759750.873308:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.873324:0:82628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.873337:0:82628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803e00, rc 0) 00000100:00100000:0.0:1782759750.873402:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218600064:12345-192.168.202.31@tcp:101:rm.0 Request processed in 191us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759750.873408:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1112 00000100:00100000:1.0:1782759750.876679:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759750.876902:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600320 00000100:00100000:0.0:1782759750.876913:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600320 00000100:00100000:0.0:1782759750.876980:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3069 00000100:00100000:0.0:1782759750.876990:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:113805:x1869355218600320:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782759750.877055:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759750.877088:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dbad lrc: 0/0,0 mode: --/PR res: [0x240000405:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2770b expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877111:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x29:0x0].0x0 (ffff8cddc34f6800) 00010000:00010000:0.0:1782759750.877123:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759750.877152:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877361:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877371:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877386:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877393:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877399:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877487:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877495:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.877501:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759750.878302:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:0.0:1782759750.878313:0:6532:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3791154734441ns, next at 3792154732173ns, rc = 0 00010000:00010000:0.0:1782759750.878376:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878386:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878395:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878403:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878409:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878414:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878444:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759750.878466:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878482:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878489:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.878495:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759750.878500:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879706:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879720:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x29:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759750.879723:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759750.879728:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879735:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dc24 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x29:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879758:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879766:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879896:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879903:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879908:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759750.879912:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879918:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879930:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759750.879932:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759750.879934:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879940:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60dc16 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759750.879963:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e637392 reply state 00000000e7b9ad98 transno 4294967741 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879975:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759750.879981:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc24d2000) 00010000:00010000:0.0:1782759750.879983:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759750.879986:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759750.880079:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:113805:x1869355218600320:12345-192.168.202.31@tcp:36:rm.0 Request processed in 3086us (3405us total) trans 4294967741 rc 0/0 00000100:00100000:0.0:1782759750.880088:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3069 00010000:00010000:3.0:1782759750.880182:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759750.880189:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.880197:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759750.880216:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.880223:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.880232:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x29:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:3.0:1782759750.880234:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782759750.880237:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 1/0,0 mode: --/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.880243:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dc2b lrc: 0/0,0 mode: --/PW res: [0x240000405:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759750.880258:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759750.880260:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759750.880262:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759751.050946:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759751.050970:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233081728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759751.051043:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759751.051285:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233081856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759751.051314:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759751.051390:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081728 00000100:00100000:2.0:1782759751.051399:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081728 00000100:00100000:2.0:1782759751.051455:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081856 00000100:00100000:2.0:1782759751.051474:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081856 00000100:00100000:2.0:1782759751.051511:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:2.0:1782759751.051522:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233081728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759751.051543:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3680518144 00000100:00100000:2.0:1782759751.051842:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233081728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 322us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759751.051850:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00000100:00100000:2.0:1782759751.051869:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:2.0:1782759751.051876:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233081856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759751.051886:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3680518144 00000100:00100000:2.0:1782759751.051909:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233081856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759751.051914:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1782759751.052222:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233081856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759751.052247:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233081728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759751.626990:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759752.078081:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233081984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759752.078147:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759752.078211:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233081984 00000100:00100000:2.0:1782759752.078219:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233081984 00000100:00100000:2.0:1782759752.078275:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:2.0:1782759752.078293:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233081984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759752.078325:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759752.078372:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233081984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759752.078378:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00000100:00100000:2.0:1782759752.078421:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233081984:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1782759752.078461:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759752.078546:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759752.078555:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233082112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759752.078603:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759752.078631:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233082112 00000100:00100000:1.0:1782759752.078635:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233082112 00000100:00100000:1.0:1782759752.078667:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:1.0:1782759752.078673:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233082112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759752.078684:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759752.078715:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233082112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759752.078721:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00080000:1.0:1782759752.078740:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759752.078759:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233082112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759752.081269:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759752.081291:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233082240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759752.081351:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759752.086740:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233082240 00000100:00100000:3.0:1782759752.086752:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233082240 00000100:00100000:3.0:1782759752.086828:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3470 00000100:00100000:3.0:1782759752.086838:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233082240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759752.086876:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:3.0:1782759752.086961:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233082240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (5609us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759752.086969:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3470 00000100:00100000:3.0:1782759752.087032:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233082240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759752.423283:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759752.423345:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759752.423383:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759752.423424:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600576 00000100:00100000:1.0:1782759752.423434:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600576 00000100:00100000:1.0:1782759752.423519:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600704 00000100:00100000:1.0:1782759752.423523:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600704 00000100:00100000:1.0:1782759752.423563:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5421 00000100:00100000:1.0:1782759752.423574:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218600576:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759752.423709:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218600576:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 136us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759752.423719:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5421 00000100:00100000:1.0:1782759752.423740:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5422 00000100:00100000:1.0:1782759752.423747:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218600704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759752.423776:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218600704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759752.423784:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5422 00000100:00080000:1.0:1782759752.423802:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759752.423807:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759752.426340:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600448 00000100:00100000:3.0:1782759752.426355:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600448 00000100:00100000:3.0:1782759752.426420:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3418 00000100:00100000:3.0:1782759752.426432:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218600448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759752.426664:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218600448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 221us (3379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759752.426673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3418 00000100:00100000:1.0:1782759752.427957:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759752.428699:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759752.428893:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600832 00000100:00100000:3.0:1782759752.428902:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600832 00000100:00080000:1.0:1782759752.429084:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759752.434732:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218600960 00000100:00100000:3.0:1782759752.434749:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218600960 00000100:00100000:0.0:1782759752.436480:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3175 00000100:00100000:0.0:1782759752.436501:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218600832:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759752.436637:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218600832:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 145us (8684us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759752.436659:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3175 00000100:00100000:0.0:1782759752.436689:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3176 00000100:00100000:0.0:1782759752.436696:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218600960:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759752.436731:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2404:x1869355218600960:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (8036us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759752.436737:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3176 00000100:00080000:1.0:1782759752.442796:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759752.651003:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759753.679645:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782759754.349782:0:158535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3794626201977ns, next at 3547591138841ns, rc = 0 00080000:00080000:3.0:1782759754.349916:0:158535:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1782759754.350154:0:158535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3794626576260ns, next at 3777991187797ns, rc = 0 00080000:00080000:3.0:1782759754.350162:0:158535:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1782759754.350280:0:158535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3794626701931ns, next at 3705288120531ns, rc = 0 00080000:00080000:3.0:1782759754.350296:0:158535:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1782759754.353892:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000004:00080000:3.0:1782759754.356168:0:158535:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3794632587292ns, next at 3792154732173ns, rc = 0 00080000:00080000:3.0:1782759754.356200:0:158535:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1782759754.356796:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 95 committed 00000001:00080000:0.0:1782759754.356833:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967741 is committed 00000004:00080000:0.0:1782759754.356840:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 97 committed 00000100:00100000:0.0:1782759754.357019:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759754.357038:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233082368:0@lo:6:osp-syn-1-1.0 00000100:00100000:0.0:1782759754.357111:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759754.357321:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233082368 00000100:00100000:3.0:1782759754.357330:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233082368 00000100:00100000:3.0:1782759754.357396:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1782759754.357408:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233082368:12345-0@lo:6:osp-syn-1-1.0 00002000:00080000:3.0:1782759754.357439:0:8446:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:24 count 1 00010000:00010000:3.0:1782759754.357463:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.357498:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 7 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.357529:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1782759754.357534:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759754.357539:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.357569:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 7 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759754.357594:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782759754.357647:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 7 pid: 82628 timeout: 3894 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759754.357659:0:8446:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1869355233082496:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759754.357737:0:8446:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44bea80 going to sleep for 11 seconds 00010000:00010000:1.0:1782759754.358903:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759754.358916:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759754.358924:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759754.358930:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759754.358934:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759754.358954:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759754.358972:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc24d2000) 00010000:00010000:1.0:1782759754.358975:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759754.358979:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759754.358986:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60dc1d lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759754.359936:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000004:00080000:3.0:1782759754.360277:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 98 committed 00000100:00100000:3.0:1782759754.360937:0:8446:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8446:1869355233082496:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759754.360963:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759754.361298:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759754.361753:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601088 00000100:00100000:3.0:1782759754.361761:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601088 00010000:00010000:3.0:1782759754.361824:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 8 pid: 82628 timeout: 3894 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759754.361855:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 865 00000100:00100000:3.0:1782759754.361876:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218601088:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759754.361891:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759754.361897:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 8 pid: 82628 timeout: 3894 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.361909:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 8 pid: 82628 timeout: 3894 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.361933:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008736483c/0xd5b45c7f5c60dc0f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27712 expref: 8 pid: 82628 timeout: 3894 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.361949:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759754.361954:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759754.361959:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.361969:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.361993:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759754.362041:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218601088:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 167us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759754.362050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 865 00010000:00010000:3.0:1782759754.362071:0:8446:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.362091:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.362100:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.362107:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759754.362121:0:8446:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782759754.362133:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759754.362144:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759754.362152:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759754.362167:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759754.362175:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759754.362187:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759754.362194:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000536d3ad4/0xd5b45c7f5c60dc32 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759754.362214:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759754.362215:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759754.362217:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759754.362306:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233082368:12345-0@lo:6:osp-syn-1-1.0 Request processed in 4901us (5195us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1782759754.362315:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000004:00080000:2.0:1782759754.362418:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4bcf100/2, rc 0, transno 4294967443 00000100:00100000:2.0:1782759754.362438:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233082368:0@lo:6:osp-syn-1-1.0 00000100:00080000:1.0:1782759754.362705:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759754.636938:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233082624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759754.637027:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759754.638746:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233082624 00000100:00100000:2.0:1782759754.638761:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233082624 00000100:00100000:2.0:1782759754.638855:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3471 00000100:00100000:2.0:1782759754.638867:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233082624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759754.638909:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759754.639007:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233082624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759754.639025:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3471 00000100:00100000:1.0:1782759754.639471:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233082624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759754.709485:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759755.242310:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233082752:0@lo:601:kworker.0 00000100:00100000:1.0:1782759755.242391:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759755.247495:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233082752 00000100:00100000:2.0:1782759755.247519:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233082752 00000100:00100000:2.0:1782759755.247616:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1782759755.247637:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3663:x1869355233082752:12345-0@lo:601:kworker.0 00000100:00100000:2.0:1782759755.247959:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+7:3663:x1869355233082752:12345-0@lo:601:kworker.0 Request processed in 334us (5568us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759755.247967:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1782759755.248041:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233082880:0@lo:106: 00000100:00100000:2.0:1782759755.248078:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759755.248111:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32600 going to sleep for 11 seconds 00000100:00080000:1.0:1782759755.248194:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759755.248210:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233082880 00000100:00100000:1.0:1782759755.248214:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233082880 00000100:00100000:1.0:1782759755.248254:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1782759755.248262:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233082880:12345-0@lo:106: 00010000:00010000:1.0:1782759755.248276:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759755.248298:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759755.248362:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:6554:x1869355233082880:12345-0@lo:106: Request processed in 101us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.248368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1782759755.248416:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233082880:0@lo:106: 00000100:00100000:1.0:1782759755.248473:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233082752:0@lo:601:kworker.0 00010000:00010000:1.0:1782759755.248619:0:9545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759755.248629:0:9545:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759755.248637:0:9545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759755.248644:0:9545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759755.248658:0:9545:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759755.249821:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759755.249829:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759755.249838:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7a00 already unused, calling callback (ffffffffc14b8e50) 00040000:00010000:3.0:1782759755.249843:0:6518:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759755.249852:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00040000:00010000:3.0:1782759755.249859:0:6518:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759755.249907:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759755.249913:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782759755.249962:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233083008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759755.250014:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759755.250090:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083008 00000100:00100000:1.0:1782759755.250096:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083008 00000100:00100000:1.0:1782759755.250138:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1782759755.250147:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5715050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0001_UUID+7:3664:x1869355233083008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759755.250158:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759755.250184:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7200/0xd5b45c7f5c60dbc9 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60dbc2 expref: 7 pid: 6534 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759755.250220:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759755.250262:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759755.250270:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dbc2 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60dbc9 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759755.250292:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759755.250295:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759755.250296:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759755.263727:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5715050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233083008:12345-0@lo:103:ldlm_bl.0 Request processed in 13569us (13700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.263743:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1782759755.265769:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233083008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759755.663051:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233083136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.663118:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.663154:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233083648:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.663177:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.663192:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233084160:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.663210:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.663236:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782759755.663240:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233083520:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.663260:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.663273:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233084032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.663290:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.663302:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233084544:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.663320:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.663362:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083136 00000100:00100000:3.0:1782759755.663369:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083136 00000100:00100000:2.0:1782759755.663673:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084160 00000100:00100000:2.0:1782759755.663677:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084160 00000100:00100000:2.0:1782759755.663720:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084032 00000100:00100000:2.0:1782759755.663722:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084032 00000100:00100000:2.0:1782759755.663744:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084544 00000100:00100000:2.0:1782759755.663746:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084544 00000100:00100000:2.0:1782759755.663760:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3177 00000100:00100000:2.0:1782759755.663768:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233084160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.663822:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233084160:12345-0@lo:400:kworker.0 Request processed in 55us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759755.663828:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3177 00000100:00100000:2.0:1782759755.663843:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3178 00000100:00100000:2.0:1782759755.663850:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233084032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.663873:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233084032:12345-0@lo:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759755.663878:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3178 00000100:00100000:2.0:1782759755.663893:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3179 00000100:00100000:2.0:1782759755.663898:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233084544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.663921:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233084544:12345-0@lo:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759755.663927:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3179 00000100:00100000:2.0:1782759755.663941:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083520 00000100:00100000:2.0:1782759755.663944:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083520 00000100:00100000:2.0:1782759755.663967:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5423 00000100:00100000:2.0:1782759755.663973:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233083520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.663998:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233083520:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759755.664004:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5423 00000100:00080000:2.0:1782759755.664017:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759755.664021:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759755.664050:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233083520:0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.664059:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233084032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.664067:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233084544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759755.664075:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233084160:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664653:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233083264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664687:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759755.664707:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233083776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664725:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759755.664739:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233084288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664757:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759755.664774:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759755.664780:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233083392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664803:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759755.664819:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233083904:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664837:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759755.664851:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233084416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.664870:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759755.665049:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3419 00000100:00100000:3.0:1782759755.665057:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233083136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.665096:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233083136:12345-0@lo:400:kworker.0 Request processed in 40us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759755.665102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3419 00000100:00100000:3.0:1782759755.665132:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083648 00000100:00100000:3.0:1782759755.665136:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083648 00000100:00100000:3.0:1782759755.665172:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083392 00000100:00100000:3.0:1782759755.665175:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083392 00000100:00100000:3.0:1782759755.665188:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3472 00000100:00100000:3.0:1782759755.665193:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233083648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.665223:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233083648:12345-0@lo:400:kworker.0 Request processed in 30us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759755.665228:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3472 00000100:00100000:3.0:1782759755.665240:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3473 00000100:00100000:3.0:1782759755.665245:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233083392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.665270:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233083392:12345-0@lo:400:kworker.0 Request processed in 25us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759755.665275:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3473 00000100:00100000:3.0:1782759755.665289:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084416 00000100:00100000:3.0:1782759755.665292:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084416 00000100:00100000:3.0:1782759755.665317:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3180 00000100:00100000:3.0:1782759755.665322:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233084416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.665348:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233084416:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759755.665365:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3180 00000100:00100000:1.0:1782759755.666723:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083264 00000100:00100000:1.0:1782759755.666733:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083264 00000100:00100000:1.0:1782759755.666773:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083776 00000100:00100000:1.0:1782759755.666777:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083776 00000100:00100000:1.0:1782759755.666803:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084288 00000100:00100000:1.0:1782759755.666805:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084288 00000100:00100000:1.0:1782759755.666819:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233083904 00000100:00100000:1.0:1782759755.666821:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233083904 00000100:00100000:1.0:1782759755.666837:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5424 00000100:00100000:1.0:1782759755.666852:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233083264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.666911:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233083264:12345-0@lo:400:kworker.0 Request processed in 60us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.666917:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5424 00000100:00100000:1.0:1782759755.666932:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5425 00000100:00100000:1.0:1782759755.666939:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233083776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.666966:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233083776:12345-0@lo:400:kworker.0 Request processed in 28us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.666972:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5425 00000100:00100000:1.0:1782759755.666982:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5426 00000100:00100000:1.0:1782759755.666988:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233084288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667015:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233084288:12345-0@lo:400:kworker.0 Request processed in 27us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.667020:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5426 00000100:00100000:1.0:1782759755.667032:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5427 00000100:00100000:1.0:1782759755.667038:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233083904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667063:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233083904:12345-0@lo:400:kworker.0 Request processed in 26us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759755.667068:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5427 00000100:00100000:1.0:1782759755.667121:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233083392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667134:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233083904:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667145:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233084416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667154:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233083264:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667176:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233083776:0@lo:400:kworker.0 00000100:00100000:1.0:1782759755.667187:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233084288:0@lo:400:kworker.0 00000100:00080000:1.0:1782759755.667227:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759755.667231:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759755.667823:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233083136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759755.667838:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233083648:0@lo:400:kworker.0 00010000:00010000:3.0:1782759755.724640:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759756.171813:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233084672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759756.171883:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759756.172077:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084672 00000100:00100000:3.0:1782759756.172120:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084672 00000100:00100000:3.0:1782759756.172167:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:3.0:1782759756.172173:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233084672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759756.172199:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759756.172234:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233084672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759756.172239:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00000100:00080000:3.0:1782759756.172254:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759756.172281:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233084672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759756.172692:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233084800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759756.172726:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759756.172810:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084800 00000100:00100000:0.0:1782759756.172815:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084800 00000100:00100000:0.0:1782759756.172848:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:0.0:1782759756.172856:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233084800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759756.172869:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759756.172914:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233084800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759756.172921:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:2.0:1782759756.173006:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233084800:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1782759756.689048:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967443 is committed 00010000:00010000:1.0:1782759756.746767:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759757.194715:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759757.194737:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233084928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759757.194802:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759757.195126:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233084928 00000100:00100000:3.0:1782759757.195134:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233084928 00000100:00100000:3.0:1782759757.195184:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:3.0:1782759757.195195:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233084928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759757.195224:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759757.195272:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233084928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759757.195279:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00000100:00080000:3.0:1782759757.195309:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759757.195342:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233084928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759757.195855:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759757.195885:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759757.195909:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759757.195915:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233085056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759757.195938:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759757.195976:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085056 00000100:00100000:3.0:1782759757.195979:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085056 00000100:00100000:3.0:1782759757.196018:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3474 00000100:00100000:3.0:1782759757.196025:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233085056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759757.196048:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:3.0:1782759757.196083:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233085056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759757.196089:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3474 00000100:00100000:3.0:1782759757.196117:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233085056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759757.196267:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085184 00000100:00100000:1.0:1782759757.196271:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085184 00000100:00100000:1.0:1782759757.196317:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:1.0:1782759757.196324:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233085184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759757.196335:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759757.196365:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233085184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759757.196371:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000100:00080000:3.0:1782759757.198534:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759757.198602:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233085184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759757.532864:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759757.532913:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759757.532951:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759757.532972:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759757.532995:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759757.533021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601216 00000100:00100000:1.0:1782759757.533030:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601216 00000100:00100000:1.0:1782759757.533080:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3420 00000100:00100000:1.0:1782759757.533098:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218601216:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759757.533169:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218601216:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759757.533176:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3420 00000100:00100000:1.0:1782759757.533210:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601344 00000100:00100000:1.0:1782759757.533214:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601344 00000100:00100000:1.0:1782759757.533248:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601472 00000100:00100000:1.0:1782759757.533251:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601472 00000100:00100000:1.0:1782759757.533271:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5428 00000100:00100000:1.0:1782759757.533277:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218601344:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759757.533307:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218601344:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759757.533313:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5428 00000100:00100000:1.0:1782759757.533325:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5429 00000100:00100000:1.0:1782759757.533331:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218601472:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759757.533353:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218601472:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 22us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759757.533359:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5429 00000100:00100000:1.0:1782759757.533375:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601600 00000100:00100000:1.0:1782759757.533378:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601600 00000100:00100000:1.0:1782759757.533413:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601728 00000100:00100000:1.0:1782759757.533416:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601728 00000100:00100000:1.0:1782759757.533437:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3181 00000100:00100000:1.0:1782759757.533443:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218601600:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759757.533469:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218601600:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759757.533483:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3181 00000100:00100000:1.0:1782759757.533505:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3182 00000100:00100000:1.0:1782759757.533511:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218601728:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759757.533537:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218601728:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759757.533543:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3182 00000100:00080000:1.0:1782759757.533695:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759757.533699:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759757.533702:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759757.533704:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759757.772788:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759758.794878:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759759.755438:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233085312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759759.755533:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759759.755654:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085312 00000100:00100000:0.0:1782759759.755662:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085312 00000100:00100000:0.0:1782759759.755740:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3475 00000100:00100000:0.0:1782759759.755749:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233085312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759759.755786:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:0.0:1782759759.756210:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233085312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 461us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759759.756293:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3475 00000100:00100000:0.0:1782759759.756354:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233085312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759759.819807:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759760.781692:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233085696:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.781764:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759760.781819:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233086208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.781844:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759760.781864:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233086720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.781904:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759760.781926:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782759760.781931:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233085568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.781951:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759760.781964:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233086080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.781984:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759760.781997:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233086592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.782016:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759760.782045:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085696 00000100:00100000:3.0:1782759760.782054:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085696 00000100:00100000:3.0:1782759760.782116:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476 00000100:00100000:3.0:1782759760.782125:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233085696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.782180:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233085696:12345-0@lo:400:kworker.0 Request processed in 55us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759760.782187:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476 00000100:00100000:3.0:1782759760.782228:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233085696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782350:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233085440:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782388:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782409:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233085952:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782432:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782446:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233086464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782479:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782498:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233086976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782523:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782545:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759760.782552:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233085824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782595:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782617:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233086336:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782640:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782671:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233086848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782694:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759760.782723:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086208 00000100:00100000:1.0:1782759760.782728:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086208 00000100:00100000:1.0:1782759760.782764:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086720 00000100:00100000:1.0:1782759760.782767:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086720 00000100:00100000:1.0:1782759760.782781:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085568 00000100:00100000:1.0:1782759760.782784:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085568 00000100:00100000:1.0:1782759760.782795:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086080 00000100:00100000:1.0:1782759760.782798:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086080 00000100:00100000:1.0:1782759760.782812:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086592 00000100:00100000:1.0:1782759760.782814:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086592 00000100:00100000:1.0:1782759760.782838:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085824 00000100:00100000:1.0:1782759760.782841:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085824 00000100:00100000:1.0:1782759760.782855:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5430 00000100:00100000:1.0:1782759760.782863:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233086208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.782944:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233086208:12345-0@lo:400:kworker.0 Request processed in 81us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.782951:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5430 00000100:00100000:1.0:1782759760.782967:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5431 00000100:00100000:1.0:1782759760.782974:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233086720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783001:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233086720:12345-0@lo:400:kworker.0 Request processed in 29us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783007:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5431 00000100:00100000:1.0:1782759760.783019:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5432 00000100:00100000:1.0:1782759760.783025:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233085568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783048:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233085568:12345-0@lo:400:kworker.0 Request processed in 23us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783063:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5432 00000100:00100000:1.0:1782759760.783076:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5433 00000100:00100000:1.0:1782759760.783081:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233086080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783108:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233086080:12345-0@lo:400:kworker.0 Request processed in 27us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783113:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5433 00000100:00100000:1.0:1782759760.783123:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5434 00000100:00100000:1.0:1782759760.783128:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233086592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783154:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233086592:12345-0@lo:400:kworker.0 Request processed in 25us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783158:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5434 00000100:00100000:1.0:1782759760.783169:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5435 00000100:00100000:1.0:1782759760.783174:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233085824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783203:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233085824:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783209:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5435 00000100:00100000:1.0:1782759760.783255:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086464 00000100:00100000:1.0:1782759760.783258:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086464 00000100:00100000:1.0:1782759760.783283:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086976 00000100:00100000:1.0:1782759760.783286:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086976 00000100:00100000:1.0:1782759760.783300:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086336 00000100:00100000:1.0:1782759760.783302:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086336 00000100:00100000:1.0:1782759760.783314:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233086848 00000100:00100000:1.0:1782759760.783316:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233086848 00000100:00100000:1.0:1782759760.783328:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3183 00000100:00100000:1.0:1782759760.783333:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233086464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783391:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233086464:12345-0@lo:400:kworker.0 Request processed in 58us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783398:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3183 00000100:00100000:1.0:1782759760.783410:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1782759760.783416:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233086976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783441:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233086976:12345-0@lo:400:kworker.0 Request processed in 26us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783446:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3184 00000100:00100000:1.0:1782759760.783456:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3185 00000100:00100000:1.0:1782759760.783461:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233086336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783502:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233086336:12345-0@lo:400:kworker.0 Request processed in 41us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783508:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3185 00000100:00100000:1.0:1782759760.783518:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3186 00000100:00100000:1.0:1782759760.783524:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233086848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783549:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233086848:12345-0@lo:400:kworker.0 Request processed in 25us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759760.783554:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3186 00000100:00080000:1.0:1782759760.783605:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759760.783609:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759760.783612:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759760.783614:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759760.783638:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233085824:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783647:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233086336:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783655:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967443 gen 2 00000004:00080000:1.0:1782759760.783667:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4bcf100, transno 4294967443 00000100:00100000:1.0:1782759760.783679:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233086848:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783691:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233086464:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783700:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233086976:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783737:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233085568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783748:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233086080:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783758:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233086592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783767:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233086208:0@lo:400:kworker.0 00000100:00100000:1.0:1782759760.783777:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233086720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759760.784638:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085952 00000100:00100000:0.0:1782759760.784647:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085952 00000100:00100000:0.0:1782759760.784696:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3477 00000100:00100000:0.0:1782759760.784705:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233085952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759760.784765:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233085952:12345-0@lo:400:kworker.0 Request processed in 62us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759760.784772:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3477 00000100:00100000:0.0:1782759760.784961:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233085952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.785255:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233085440 00000100:00100000:3.0:1782759760.785261:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233085440 00000100:00100000:3.0:1782759760.785303:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3421 00000100:00100000:3.0:1782759760.785310:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233085440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759760.785358:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233085440:12345-0@lo:400:kworker.0 Request processed in 49us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759760.785364:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3421 00000100:00100000:3.0:1782759760.785415:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233085440:0@lo:400:kworker.0 00010000:00010000:3.0:1782759760.843264:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759761.291607:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233087104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759761.291690:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759761.291768:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759761.291775:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233087232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759761.291820:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759761.292511:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087104 00000100:00100000:3.0:1782759761.292522:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087104 00000100:00100000:3.0:1782759761.292593:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087232 00000100:00100000:3.0:1782759761.292596:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087232 00000100:00100000:3.0:1782759761.292615:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:3.0:1782759761.292624:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233087104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759761.292656:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759761.292712:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233087104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759761.292719:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00000100:00100000:3.0:1782759761.292735:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:3.0:1782759761.292741:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233087232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759761.292749:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759761.292768:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233087232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 28us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759761.292773:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:2.0:1782759761.292866:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233087232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759761.292878:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233087104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759761.871172:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759762.315025:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233087360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759762.315159:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759762.315324:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087360 00000100:00100000:0.0:1782759762.315331:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087360 00000100:00100000:0.0:1782759762.315397:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3478 00000100:00100000:0.0:1782759762.315406:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233087360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759762.315449:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759762.315521:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233087360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759762.315528:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3478 00000100:00100000:3.0:1782759762.315753:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233087488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759762.315786:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759762.315813:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759762.315820:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233087616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759762.315970:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759762.316006:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087488 00000100:00100000:3.0:1782759762.316010:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087488 00000100:00100000:3.0:1782759762.316045:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087616 00000100:00100000:3.0:1782759762.316049:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087616 00000100:00100000:3.0:1782759762.316069:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:3.0:1782759762.316076:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233087488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759762.316107:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759762.316142:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233087488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.316149:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:3.0:1782759762.316163:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:3.0:1782759762.316169:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233087616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759762.316178:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759762.316203:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233087616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.316208:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00000100:00080000:3.0:1782759762.316227:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759762.316265:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233087488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759762.316296:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233087616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759762.316385:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233087360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759762.660547:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759762.660647:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759762.660721:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601856 00000100:00100000:3.0:1782759762.660731:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601856 00000100:00100000:3.0:1782759762.660803:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3422 00000100:00100000:3.0:1782759762.660812:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218601856:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759762.660941:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218601856:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 130us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.660948:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3422 00000100:00100000:3.0:1782759762.660984:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759762.661086:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759762.661112:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759762.661173:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218601984 00000100:00100000:3.0:1782759762.661177:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218601984 00000100:00100000:3.0:1782759762.661230:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602112 00000100:00100000:3.0:1782759762.661233:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602112 00000100:00100000:3.0:1782759762.661255:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5436 00000100:00100000:3.0:1782759762.661261:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218601984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759762.661293:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218601984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.661300:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5436 00000100:00100000:3.0:1782759762.661312:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5437 00000100:00100000:3.0:1782759762.661317:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218602112:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759762.661337:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218602112:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.661356:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5437 00000100:00100000:3.0:1782759762.661374:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602240 00000100:00100000:3.0:1782759762.661377:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602240 00000100:00100000:3.0:1782759762.661404:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602368 00000100:00100000:3.0:1782759762.661407:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602368 00000100:00100000:3.0:1782759762.661427:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3187 00000100:00100000:3.0:1782759762.661433:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218602240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759762.661469:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218602240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.661475:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3187 00000100:00100000:3.0:1782759762.661486:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3188 00000100:00100000:3.0:1782759762.664044:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218602368:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759762.664115:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218602368:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2624us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759762.664132:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3188 00000100:00080000:3.0:1782759762.664162:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759762.664165:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759762.664168:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759762.664170:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759762.890943:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759763.919508:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759764.875703:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759764.875728:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233087744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759764.875800:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759764.875856:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087744 00000100:00100000:1.0:1782759764.875864:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087744 00000100:00100000:1.0:1782759764.875925:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479 00000100:00100000:1.0:1782759764.875935:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233087744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759764.875970:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759764.876021:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233087744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759764.878294:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233087744:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759764.881871:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479 00010000:00010000:2.0:1782759764.942785:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782759765.201078:0:158861:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782759765.201088:0:158861:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:1.0:1782759765.209422:0:158862:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782759765.210544:0:158862:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1782759765.900213:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233087872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900289:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900335:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233088384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900365:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900384:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233088896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900408:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900436:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233089408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900459:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900612:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759765.900619:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233088000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900646:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900663:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233088512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900683:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900699:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233089024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900719:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900745:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233088256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900768:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.900786:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233088768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.900826:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759765.900905:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233088128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.900934:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759765.900950:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233088640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.900969:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759765.900982:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233089152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.901003:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759765.901033:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088384 00000100:00100000:0.0:1782759765.901040:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088384 00000100:00100000:0.0:1782759765.901094:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088128 00000100:00100000:0.0:1782759765.901098:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088128 00000100:00100000:0.0:1782759765.901114:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480 00000100:00100000:0.0:1782759765.901122:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233088384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.901180:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233088384:12345-0@lo:400:kworker.0 Request processed in 57us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.901187:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480 00000100:00100000:0.0:1782759765.901204:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:0.0:1782759765.901210:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233088128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.901244:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233088128:12345-0@lo:400:kworker.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.901249:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:0.0:1782759765.901289:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233088128:0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.906741:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088000 00000100:00100000:0.0:1782759765.906761:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088000 00000100:00100000:0.0:1782759765.906813:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088512 00000100:00100000:0.0:1782759765.906817:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088512 00000100:00100000:0.0:1782759765.906852:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089024 00000100:00100000:0.0:1782759765.906855:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089024 00000100:00100000:0.0:1782759765.906871:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088256 00000100:00100000:0.0:1782759765.906874:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088256 00000100:00100000:0.0:1782759765.906884:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088640 00000100:00100000:0.0:1782759765.906886:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088640 00000100:00100000:0.0:1782759765.906898:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089152 00000100:00100000:0.0:1782759765.906901:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089152 00000100:00100000:0.0:1782759765.906918:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5438 00000100:00100000:0.0:1782759765.906928:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233088000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.907023:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233088000:12345-0@lo:400:kworker.0 Request processed in 96us (6375us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.907032:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5438 00000100:00100000:0.0:1782759765.907049:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5439 00000100:00100000:0.0:1782759765.907055:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233088512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.907085:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233088512:12345-0@lo:400:kworker.0 Request processed in 30us (6401us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.907091:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5439 00000100:00100000:0.0:1782759765.907102:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5440 00000100:00100000:0.0:1782759765.907107:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233089024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.907138:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233089024:12345-0@lo:400:kworker.0 Request processed in 31us (6418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.907143:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5440 00000100:00100000:0.0:1782759765.907154:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5441 00000100:00100000:0.0:1782759765.907160:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233088256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.907186:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3665:x1869355233088256:12345-0@lo:400:kworker.0 Request processed in 26us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.907191:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5441 00000100:00100000:0.0:1782759765.907201:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5442 00000100:00100000:0.0:1782759765.907206:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233088640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.907248:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233088640:12345-0@lo:400:kworker.0 Request processed in 43us (6278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.907253:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5442 00000100:00100000:0.0:1782759765.907263:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5443 00000100:00100000:0.0:1782759765.907269:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233089152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.907294:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233089152:12345-0@lo:400:kworker.0 Request processed in 26us (6291us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.907299:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5443 00000100:00080000:1.0:1782759765.907525:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759765.907529:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759765.909658:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233087872 00000100:00100000:1.0:1782759765.909670:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233087872 00000100:00100000:1.0:1782759765.909727:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3423 00000100:00100000:1.0:1782759765.909736:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233087872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759765.909808:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233087872:12345-0@lo:400:kworker.0 Request processed in 73us (9519us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759765.909815:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3423 00000100:00100000:2.0:1782759765.909955:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088896 00000100:00100000:2.0:1782759765.909960:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088896 00000100:00100000:2.0:1782759765.910039:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089408 00000100:00100000:2.0:1782759765.910042:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089408 00000100:00100000:0.0:1782759765.910107:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233088768 00000100:00100000:0.0:1782759765.910111:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233088768 00000100:00080000:1.0:1782759765.913662:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759765.913673:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759765.913851:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3189 00000100:00100000:2.0:1782759765.913875:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233088896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759765.913964:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233088896:12345-0@lo:400:kworker.0 Request processed in 104us (13555us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759765.913972:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3189 00000100:00100000:2.0:1782759765.913989:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3190 00000100:00100000:2.0:1782759765.913998:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233089408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759765.914026:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233089408:12345-0@lo:400:kworker.0 Request processed in 30us (13566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759765.914032:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3190 00000100:00100000:3.0:1782759765.916172:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233088000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916190:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233088512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916201:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233089024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916212:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233087872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916223:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233088384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916234:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233088896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916246:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233089408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916297:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233089280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759765.916353:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759765.916398:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233088256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759765.917634:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089280 00000100:00100000:2.0:1782759765.917645:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089280 00000100:00100000:2.0:1782759765.917729:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3191 00000100:00100000:2.0:1782759765.917741:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233089280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759765.917822:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233089280:12345-0@lo:400:kworker.0 Request processed in 84us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759765.917846:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3191 00000100:00100000:3.0:1782759765.917942:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233089280:0@lo:400:kworker.0 00000100:00080000:1.0:1782759765.918015:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759765.918099:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233088640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.918119:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233089152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.918344:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3192 00000100:00100000:0.0:1782759765.918353:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759765.918406:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233088768:12345-0@lo:400:kworker.0 Request processed in 54us (17579us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759765.918413:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3192 00000100:00100000:1.0:1782759765.920953:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233088768:0@lo:400:kworker.0 00010000:00010000:1.0:1782759765.962794:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759766.213249:0:158921:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3f3eb4e0 20000000:00000080:3.0:1782759766.213271:0:158921:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec93f2400 uarg=0000000000000000 00010000:00010000:3.0:1782759766.214836:0:158921:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759766.214863:0:158921:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759766.214885:0:158921:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759766.214896:0:158921:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759766.214917:0:158921:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759766.214938:0:158921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.214975:0:158921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.214984:0:158921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.215024:0:158921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.215041:0:158921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 23 pid: 6524 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759766.215057:0:158921:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158921:1869355233089536:0@lo:104: 00000100:00100000:3.0:1782759766.215130:0:158921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759766.215260:0:158921:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded8428900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759766.217804:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089536 00000100:00100000:1.0:1782759766.217821:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089536 00000100:00100000:0.0:1782759766.220828:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:0.0:1782759766.220844:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:158921:x1869355233089536:12345-0@lo:104: 00010000:00010000:0.0:1782759766.220866:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759766.220978:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759766.220984:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:158921:x1869355233089536:12345-0@lo:104: Request processed in 145us (5855us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759766.220990:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00010000:00010000:1.0:1782759766.221091:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759766.221099:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221107:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759766.221112:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221121:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759766.221129:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759766.221157:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759766.221207:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221213:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759766.221238:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221246:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60db8a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60db91 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221267:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759766.221269:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759766.221271:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759766.221299:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233089664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759766.221346:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759766.221403:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089664 00000100:00100000:1.0:1782759766.221411:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089664 00010000:00010000:1.0:1782759766.221445:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 24 pid: 6524 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759766.221471:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1782759766.221478:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233089664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759766.221490:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759766.221495:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 24 pid: 6524 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221505:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 24 pid: 6524 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221542:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221551:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221567:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221599:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221607:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221613:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221619:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759766.221623:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221630:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221639:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759766.221648:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759766.221677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233089664:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759766.221690:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1782759766.221725:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233089664:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759766.221823:0:158921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60db91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60db8a expref: 23 pid: 6524 timeout: 3956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759766.221834:0:158921:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:158921:1869355233089536:0@lo:104: 00010000:00010000:3.0:1782759766.221849:0:158921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.221858:0:158921:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.221864:0:158921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759766.221869:0:158921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc39 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 158921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759766.411465:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759766.411493:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233089792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759766.411603:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759766.411664:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089792 00000100:00100000:3.0:1782759766.411672:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089792 00000100:00100000:3.0:1782759766.411729:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:3.0:1782759766.411739:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233089792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759766.411769:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759766.411817:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233089792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759766.411824:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000100:00100000:3.0:1782759766.411868:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233089792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759766.412074:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759766.412084:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233089920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759766.412114:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759766.412136:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233089920 00000100:00100000:3.0:1782759766.412141:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233089920 00000100:00100000:3.0:1782759766.412172:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:3.0:1782759766.412179:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233089920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759766.412189:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759766.412220:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233089920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759766.412226:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:3.0:1782759766.412249:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233089920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759766.987422:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759767.441040:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759767.441062:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233090304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759767.441142:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759767.441204:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090304 00000100:00100000:0.0:1782759767.441212:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090304 00000100:00100000:0.0:1782759767.441264:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1782759767.441273:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233090304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759767.441302:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759767.441349:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233090304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759767.441356:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1782759767.441424:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233090304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759767.442118:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233090048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759767.442163:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759767.442198:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759767.442204:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233090176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759767.442225:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782759767.442264:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759767.442275:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090176 00000100:00100000:1.0:1782759767.442280:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090176 00000100:00100000:1.0:1782759767.442327:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00000100:00100000:1.0:1782759767.442335:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233090176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759767.442352:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 82331584 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759767.443018:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233090176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 681us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759767.443027:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00000100:00080000:1.0:1782759767.443080:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759767.443110:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233090176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759767.443208:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090048 00000100:00100000:0.0:1782759767.443214:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090048 00000100:00100000:0.0:1782759767.443272:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:0.0:1782759767.443281:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233090048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759767.443309:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759767.443362:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233090048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759767.443371:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1782759767.443507:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233090048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759767.784560:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759767.784623:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759767.784648:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759767.784671:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759767.784694:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759767.784719:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602752 00000100:00100000:0.0:1782759767.784727:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602752 00000100:00100000:0.0:1782759767.784782:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602624 00000100:00100000:0.0:1782759767.784785:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602624 00000100:00100000:0.0:1782759767.784805:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5444 00000100:00100000:0.0:1782759767.784814:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218602752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759767.784887:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218602752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759767.784895:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5444 00000100:00100000:0.0:1782759767.784910:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5445 00000100:00100000:0.0:1782759767.784916:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218602624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759767.784939:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218602624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759767.784944:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5445 00000100:00100000:0.0:1782759767.784960:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603008 00000100:00100000:0.0:1782759767.784964:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603008 00000100:00100000:0.0:1782759767.784989:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602880 00000100:00100000:0.0:1782759767.784991:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602880 00000100:00100000:0.0:1782759767.785009:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3193 00000100:00100000:0.0:1782759767.785014:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218603008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759767.785038:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218603008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759767.785043:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3193 00000100:00100000:0.0:1782759767.785054:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3194 00000100:00100000:0.0:1782759767.785059:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218602880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759767.785078:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218602880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759767.785084:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3194 00000100:00080000:0.0:1782759767.785104:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759767.785108:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759767.785110:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759767.785112:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759767.785355:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218602496 00000100:00100000:2.0:1782759767.785359:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218602496 00000100:00100000:2.0:1782759767.785413:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3424 00000100:00100000:2.0:1782759767.785422:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218602496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759767.785454:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218602496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759767.785460:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3424 10000000:01000000:1.0:1782759767.946711:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759767.946735:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759767.946740:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759767.946783:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759767.946796:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759767.946807:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759767.946831:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233090432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759767.946895:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759767.946944:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc46043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759767.947003:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090432 00000100:00100000:3.0:1782759767.947010:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090432 00000100:00100000:3.0:1782759767.947065:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3425 00000100:00100000:3.0:1782759767.947076:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233090432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759767.947090:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759767.947109:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dc40 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759767.947135:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759767.947146:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759767.947155:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7a00, rc 0) 00000100:00100000:3.0:1782759767.947199:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233090432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759767.947205:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3425 00000100:00100000:1.0:1782759767.947328:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233090432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759767.947352:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759767.947361:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759767.947380:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759767.947385:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759767.947393:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759768.014967:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759769.039149:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759769.132557:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759769.132843:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603264 00000100:00100000:3.0:1782759769.132855:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603264 00000100:00080000:1.0:1782759769.132919:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759769.132935:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3070 00000100:00100000:3.0:1782759769.132947:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114216:x1869355218603264:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:3.0:1782759769.132968:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759769.133036:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc4e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27719 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.133150:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.133164:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.133177:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.133469:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.133479:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.133487:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759769.133950:0:42628:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x19:0x0], index 0: 0 00010000:00010000:3.0:1782759769.134107:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60dc63 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134117:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60dc63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134125:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60dc63 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134158:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134166:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134172:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134179:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134186:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759769.134196:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134205:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134217:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cded3a3be00) 00010000:00010000:3.0:1782759769.134220:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759769.134225:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134231:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dc55 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759769.134244:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dc55a19d reply state 00000000816ec7fe transno 4294967742 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134255:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134260:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:3.0:1782759769.134263:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759769.134265:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759769.134306:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc4e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27719 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134324:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60dc63 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27719 expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.134488:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2a:0x0].0x0 (ffff8cded3a3bb00) 00010000:00010000:3.0:1782759769.134491:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759769.134499:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7600, rc 0) 00000100:00100000:3.0:1782759769.134571:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:114216:x1869355218603264:12345-192.168.202.31@tcp:101:dd.0 Request processed in 1627us (2023us total) trans 4294967742 rc 0/0 00000100:00100000:3.0:1782759769.134598:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3070 00000100:00100000:2.0:1782759769.142091:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759769.142320:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603392 00000100:00100000:3.0:1782759769.142340:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603392 00000100:00080000:1.0:1782759769.142420:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759769.142449:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 83 00000100:00100000:3.0:1782759769.142462:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218603392:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759769.142507:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1782759769.142516:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.142533:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:3.0:1782759769.142538:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759769.142544:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.142556:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.161944:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.161964:0:8452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.161991:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233090560:0@lo:101:ll_ost_io00_002.0 00000100:00100000:0.0:1782759769.162062:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.162124:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.162305:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090560 00000100:00100000:3.0:1782759769.162313:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090560 00000100:00100000:3.0:1782759769.162372:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1782759769.162381:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9333050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+6:8452:x1869355233090560:12345-0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759769.162408:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759769.162533:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dc78 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.162776:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.162787:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.162799:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7000, rc 0) 00000100:00100000:3.0:1782759769.162839:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9333050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233090560:12345-0@lo:101:ll_ost_io00_002.0 Request processed in 459us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.162846:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1782759769.162918:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233090560:0@lo:101:ll_ost_io00_002.0 00010000:00010000:3.0:1782759769.162935:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.162944:0:8452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.162963:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.162971:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00080000:2.0:1782759769.164551:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1782759769.168499:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967434 is committed 00002000:00010000:1.0:1782759769.168702:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:1.0:1782759769.168708:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1782759770 00002000:00010000:1.0:1782759769.168711:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1782759770 00002000:00010000:1.0:1782759769.168713:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1782759769.168728:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.168740:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.168750:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.168757:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759769.168761:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.168770:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.168789:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.168796:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759769.168882:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218603392:12345-192.168.202.31@tcp:4:dd.0 Request processed in 26419us (26796us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1782759769.168900:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 83 00000100:00100000:3.0:1782759769.173346:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759769.173868:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603520 00000100:00100000:1.0:1782759769.173878:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603520 00000100:00100000:1.0:1782759769.173942:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 84 00000100:00100000:1.0:1782759769.173952:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218603520:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759769.173995:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 1048576, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x800 00010000:00010000:1.0:1782759769.174003:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.174018:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:1.0:1782759769.174023:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759769.174029:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.174043:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.197693:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:1.0:1782759769.197751:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233090688:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759769.197807:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759769.197852:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759769.198179:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090688 00000100:00100000:2.0:1782759769.198186:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090688 00000100:00100000:2.0:1782759769.198244:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1782759769.198254:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233090688:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:2.0:1782759769.198281:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759769.198756:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233090688:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 503us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759769.198765:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1782759769.198852:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233090688:0@lo:601:ll_ost_io00_003.0 00010000:00010000:3.0:1782759769.198895:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:3.0:1782759769.198906:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000001:00080000:3.0:1782759769.212564:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967435 is committed 00002000:00010000:1.0:1782759769.212929:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1782759769.212936:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 2048 -> 4096 00010000:00010000:1.0:1782759769.212952:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.212983:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.212994:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.213002:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759769.213008:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.213018:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.213039:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.213047:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b89e5c93/0xd5b45c7f5c60dc86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759769.213147:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218603520:12345-192.168.202.31@tcp:4:dd.0 Request processed in 39190us (39805us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1782759769.213159:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 84 00000100:00100000:2.0:1782759769.219681:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.220456:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603648 00000100:00100000:0.0:1782759769.220469:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603648 00000100:00100000:0.0:1782759769.220649:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 85 00000100:00100000:0.0:1782759769.220662:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218603648:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759769.220711:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 2097152, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x1000 00010000:00010000:0.0:1782759769.220723:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.220739:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:0.0:1782759769.220744:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759769.220751:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.220768:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.233283:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00000100:00100000:0.0:1782759769.233337:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233090816:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759769.233403:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.233454:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.233920:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090816 00000100:00100000:3.0:1782759769.233928:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090816 00000100:00100000:3.0:1782759769.234275:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1782759769.234286:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233090816:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:3.0:1782759769.234314:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.234552:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233090816:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 268us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.234560:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1782759769.234676:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233090816:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759769.234707:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 0 00010000:00010000:0.0:1782759769.234718:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000001:00080000:1.0:1782759769.244484:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967436 is committed 00002000:00010000:0.0:1782759769.244728:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1782759769.244736:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 4096 -> 6144 00010000:00010000:0.0:1782759769.244755:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.244771:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.244782:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.244790:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759769.244796:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.244806:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.244831:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.244842:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.244959:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218603648:12345-192.168.202.31@tcp:4:dd.0 Request processed in 24296us (25284us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1782759769.244978:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 85 00000100:00100000:3.0:1782759769.251459:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.251615:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603776 00000100:00100000:0.0:1782759769.251628:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603776 00000100:00100000:0.0:1782759769.251704:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 86 00000100:00100000:0.0:1782759769.251715:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218603776:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759769.251765:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 3145728, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x1800 00010000:00010000:0.0:1782759769.251775:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.251791:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:0.0:1782759769.251796:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759769.251803:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.251820:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.261730:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:0.0:1782759769.261791:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233090944:0@lo:601:ll_ost_io00_000.0 00000100:00100000:0.0:1782759769.262015:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.262065:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.262174:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233090944 00000100:00100000:3.0:1782759769.262182:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233090944 00000100:00100000:3.0:1782759769.262232:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1782759769.262241:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233090944:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:3.0:1782759769.262272:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.262496:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233090944:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 256us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.262625:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1782759769.262923:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233090944:0@lo:601:ll_ost_io00_000.0 00010000:00010000:0.0:1782759769.262956:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:0.0:1782759769.262968:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000001:00080000:1.0:1782759769.270281:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967437 is committed 00002000:00010000:0.0:1782759769.270441:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1782759769.270548:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 6144 -> 8192 00010000:00010000:0.0:1782759769.270566:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.270608:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.270617:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.270624:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759769.270629:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.270640:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.270661:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.270669:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dc94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.270763:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218603776:12345-192.168.202.31@tcp:4:dd.0 Request processed in 19045us (19317us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1782759769.270773:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 86 00000100:00100000:1.0:1782759769.276531:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759769.276769:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218603904 00000100:00100000:3.0:1782759769.276779:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218603904 00000100:00100000:3.0:1782759769.276857:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 87 00000100:00100000:3.0:1782759769.276867:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218603904:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:3.0:1782759769.276913:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 4194304, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x2000 00010000:00010000:3.0:1782759769.276922:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.276938:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:3.0:1782759769.276942:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759769.276948:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.276962:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.286663:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:3.0:1782759769.286719:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233091072:0@lo:601:ll_ost_io00_002.0 00000100:00100000:3.0:1782759769.286780:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759769.286828:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.288143:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091072 00000100:00100000:3.0:1782759769.288157:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091072 00000100:00100000:3.0:1782759769.288221:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1782759769.288229:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233091072:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:3.0:1782759769.288265:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.288892:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233091072:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 661us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.288900:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1782759769.288944:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233091072:0@lo:601:ll_ost_io00_002.0 00010000:00010000:3.0:1782759769.288971:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:3.0:1782759769.288982:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000001:00080000:1.0:1782759769.296920:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967438 is committed 00002000:00010000:3.0:1782759769.297270:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:3.0:1782759769.297276:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 8192 -> 10240 00010000:00010000:3.0:1782759769.297291:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.297304:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.297313:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.297330:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759769.297335:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.297345:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.297373:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.297381:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dc9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.297734:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218603904:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20863us (21208us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1782759769.297744:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 87 00000100:00100000:2.0:1782759769.309342:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759769.309417:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604032 00000100:00100000:1.0:1782759769.309427:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604032 00000100:00100000:1.0:1782759769.309513:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 88 00000100:00100000:1.0:1782759769.309524:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218604032:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759769.309570:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 5242880, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x2800 00010000:00010000:1.0:1782759769.309607:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.309624:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:1.0:1782759769.309627:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759769.309632:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.309644:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.319135:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:3.0:1782759769.319210:0:125830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233091200:0@lo:601:ll_ost_io00_003.0 00000100:00100000:3.0:1782759769.319281:0:125830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759769.319695:0:125830:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494a240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759769.320669:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091200 00000100:00100000:0.0:1782759769.320679:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091200 00000100:00100000:0.0:1782759769.320747:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1782759769.320759:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233091200:12345-0@lo:601:ll_ost_io00_003.0 00040000:00010000:0.0:1782759769.320799:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.321171:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:125830:x1869355233091200:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 414us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.321179:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1782759769.321294:0:125830:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-MDT0000-lwp-OST0000_UUID:125830:1869355233091200:0@lo:601:ll_ost_io00_003.0 00010000:00010000:2.0:1782759769.321414:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:2.0:1782759769.321427:0:125830:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000001:00080000:1.0:1782759769.325184:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967439 is committed 00002000:00010000:2.0:1782759769.325672:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1782759769.325677:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 10240 -> 12288 00010000:00010000:2.0:1782759769.325690:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.325703:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.325711:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.325718:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759769.325722:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.325731:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.325749:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.325770:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa77f68d/0xd5b45c7f5c60dca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759769.325911:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218604032:12345-192.168.202.31@tcp:4:dd.0 Request processed in 16383us (16584us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1782759769.325921:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 88 00000100:00100000:1.0:1782759769.337466:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.338719:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604160 00000100:00100000:0.0:1782759769.338730:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604160 00000100:00100000:0.0:1782759769.338896:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 89 00000100:00100000:0.0:1782759769.338905:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218604160:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759769.338949:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 6291456, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x3000 00010000:00010000:0.0:1782759769.338957:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.338972:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:0.0:1782759769.338977:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759769.338982:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.338993:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.350867:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:0.0:1782759769.350926:0:8451:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233091328:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759769.350997:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.351104:0:8451:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.354052:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091328 00000100:00100000:3.0:1782759769.354064:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091328 00000100:00100000:3.0:1782759769.354602:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1782759769.354614:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233091328:12345-0@lo:601:ll_ost_io00_001.0 00040000:00010000:3.0:1782759769.354652:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.354882:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8451:x1869355233091328:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 270us (3884us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.354890:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1782759769.355042:0:8451:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-MDT0000-lwp-OST0000_UUID:8451:1869355233091328:0@lo:601:ll_ost_io00_001.0 00010000:00010000:0.0:1782759769.355081:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:0.0:1782759769.355093:0:8451:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000001:00080000:1.0:1782759769.361241:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967440 is committed 00002000:00010000:1.0:1782759769.364470:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1782759769.364481:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 12288 -> 14336 00010000:00010000:1.0:1782759769.364498:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.364511:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.364540:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.364547:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759769.364551:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.364559:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.364596:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.364604:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e82576c4/0xd5b45c7f5c60dca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759769.364738:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218604160:12345-192.168.202.31@tcp:4:dd.0 Request processed in 25828us (27288us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1782759769.364749:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 89 00000100:00100000:2.0:1782759769.372531:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.372622:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604288 00000100:00100000:0.0:1782759769.372634:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604288 00000100:00100000:0.0:1782759769.372709:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 90 00000100:00100000:0.0:1782759769.372718:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218604288:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759769.372762:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 7340032, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x3800 00010000:00010000:0.0:1782759769.372771:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.372787:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:0.0:1782759769.372791:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759769.372798:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.372811:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.384728:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:0.0:1782759769.384780:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233091456:0@lo:601:ll_ost_io00_000.0 00000100:00100000:0.0:1782759769.384836:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.384902:0:8450:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.385285:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091456 00000100:00100000:3.0:1782759769.385307:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091456 00000100:00100000:3.0:1782759769.385372:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1782759769.385383:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9330c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233091456:12345-0@lo:601:ll_ost_io00_000.0 00040000:00010000:3.0:1782759769.385423:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.385663:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9330c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:8450:x1869355233091456:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 283us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.385671:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1782759769.386211:0:8450:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-MDT0000-lwp-OST0000_UUID:8450:1869355233091456:0@lo:601:ll_ost_io00_000.0 00010000:00010000:0.0:1782759769.386244:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1782759769.386256:0:8450:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000001:00080000:2.0:1782759769.391734:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967441 is committed 00002000:00010000:0.0:1782759769.392120:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 7340032 -> 8388608 00002000:00010000:0.0:1782759769.392126:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 14336 -> 16384 00010000:00010000:0.0:1782759769.392140:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.392153:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.392163:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.392170:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759769.392176:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.392185:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.392203:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.392211:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.392304:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218604288:12345-192.168.202.31@tcp:4:dd.0 Request processed in 19583us (19779us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1782759769.392314:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 90 00000100:00100000:3.0:1782759769.400521:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.400612:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604416 00000100:00100000:0.0:1782759769.400623:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604416 00000100:00100000:0.0:1782759769.400698:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 91 00000100:00100000:0.0:1782759769.400709:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218604416:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759769.400757:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 8388608, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x4000 00010000:00010000:0.0:1782759769.400767:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.400783:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:0.0:1782759769.400787:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759769.400794:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.400814:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.412140:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:0.0:1782759769.412200:0:8452:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233091584:0@lo:601:ll_ost_io00_002.0 00000100:00100000:0.0:1782759769.412264:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759769.412367:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091584 00000100:00100000:3.0:1782759769.412376:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091584 00000100:00100000:0.0:1782759769.412376:0:8452:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.412454:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1782759769.412463:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233091584:12345-0@lo:601:ll_ost_io00_002.0 00040000:00010000:3.0:1782759769.412490:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759769.412714:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:8452:x1869355233091584:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 252us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.412722:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1782759769.413139:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49ab480 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233091712:0@lo:106: 00000100:00100000:1.0:1782759769.413169:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759769.415664:0:8452:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-MDT0000-lwp-OST0000_UUID:8452:1869355233091584:0@lo:601:ll_ost_io00_002.0 00010000:00010000:2.0:1782759769.415728:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:2.0:1782759769.415747:0:8452:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759769.416531:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759769.417250:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091712 00000100:00100000:3.0:1782759769.417259:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091712 00000100:00100000:3.0:1782759769.417355:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:3.0:1782759769.417365:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233091712:12345-0@lo:106: 00010000:00010000:3.0:1782759769.417378:0:18645:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759769.417387:0:18645:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:3.0:1782759769.418084:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233091712:12345-0@lo:106: Request processed in 720us (4913us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.418093:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:1.0:1782759769.418215:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49ab480 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233091712:0@lo:106: 00000001:00080000:0.0:1782759769.422722:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967442 is committed 00002000:00010000:2.0:1782759769.422890:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 8388608 -> 9437184 00002000:00010000:2.0:1782759769.422895:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 16384 -> 18432 00010000:00010000:2.0:1782759769.422912:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.422927:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.422937:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.422963:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759769.422978:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.422989:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.423010:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.423018:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe8f10a4/0xd5b45c7f5c60dcb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759769.423115:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218604416:12345-192.168.202.31@tcp:4:dd.0 Request processed in 22403us (22599us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1782759769.423125:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 91 00000100:00100000:3.0:1782759769.436727:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759769.437164:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604544 00000100:00100000:2.0:1782759769.437174:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604544 00000100:00100000:2.0:1782759769.437250:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 92 00000100:00100000:2.0:1782759769.437260:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218604544:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759769.437304:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 9437184, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x4800 00010000:00010000:2.0:1782759769.437313:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.437340:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:2.0:1782759769.437354:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759769.437360:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.437375:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759769.464142:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967443 is committed 00002000:00010000:2.0:1782759769.464756:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 9437184 -> 10485760 00002000:00010000:2.0:1782759769.464763:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 18432 -> 20480 00010000:00010000:2.0:1782759769.464778:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.464792:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.464802:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.464808:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759769.464814:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.464824:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.464844:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.464872:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759769.464982:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218604544:12345-192.168.202.31@tcp:4:dd.0 Request processed in 27718us (28260us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1782759769.464992:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 92 00000100:00100000:3.0:1782759769.465066:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759769.465085:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233091840:0@lo:601:ll_ost_io00_003.0 00000100:00100000:3.0:1782759769.465139:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759769.467726:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091840 00000100:00100000:2.0:1782759769.467740:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091840 00000100:00100000:2.0:1782759769.467809:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1782759769.467820:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233091840:12345-0@lo:601:ll_ost_io00_003.0 00000100:00100000:2.0:1782759769.468101:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233091840:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 283us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759769.468109:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1782759769.468197:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233091840:0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759769.481434:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759769.481639:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604672 00000100:00100000:2.0:1782759769.481650:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604672 00000100:00100000:2.0:1782759769.481742:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 93 00000100:00100000:2.0:1782759769.481754:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218604672:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759769.481809:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 10485760, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x5000 00010000:00010000:2.0:1782759769.481820:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.481839:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:2.0:1782759769.481845:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759769.481853:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.481887:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759769.504155:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967444 is committed 00000100:00100000:3.0:1782759769.504388:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233091968:0@lo:601:ll_ost_io00_001.0 00000100:00100000:3.0:1782759769.504466:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.504626:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233091968 00000100:00100000:0.0:1782759769.504635:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233091968 00000100:00100000:0.0:1782759769.504685:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1782759769.504695:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233091968:12345-0@lo:601:ll_ost_io00_001.0 00002000:00010000:2.0:1782759769.506975:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 10485760 -> 11534336 00002000:00010000:2.0:1782759769.506984:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 20480 -> 22528 00010000:00010000:2.0:1782759769.507000:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.507012:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.507020:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.507026:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759769.507030:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.507038:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.507055:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.507061:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60dcc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759769.507173:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218604672:12345-192.168.202.31@tcp:4:dd.0 Request processed in 25419us (25745us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1782759769.507182:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 93 00000100:00100000:0.0:1782759769.515243:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233091968:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 10537us (10764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.515261:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1782759769.515651:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233091968:0@lo:601:ll_ost_io00_001.0 00000100:00100000:1.0:1782759769.518158:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.518266:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604800 00000100:00100000:0.0:1782759769.518276:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604800 00000100:00100000:0.0:1782759769.518366:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 94 00000100:00100000:0.0:1782759769.518376:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218604800:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:0.0:1782759769.518436:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 11534336, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x5800 00010000:00010000:0.0:1782759769.518446:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.518463:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:0.0:1782759769.518468:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759769.518473:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.518487:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782759769.604113:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967445 is committed 00002000:00010000:0.0:1782759769.604337:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 11534336 -> 12582912 00002000:00010000:0.0:1782759769.604342:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 22528 -> 24576 00010000:00010000:0.0:1782759769.604357:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.604370:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.604380:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.604387:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759769.604401:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.604410:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.604436:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.604443:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb5d336b/0xd5b45c7f5c60dccc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.604548:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218604800:12345-192.168.202.31@tcp:4:dd.0 Request processed in 86168us (86395us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1782759769.604559:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 94 00000100:00100000:3.0:1782759769.604846:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759769.604863:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233092096:0@lo:601:ll_ost_io00_000.0 00000100:00100000:3.0:1782759769.604914:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.605060:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092096 00000100:00100000:0.0:1782759769.605067:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092096 00000100:00100000:0.0:1782759769.605110:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1782759769.605119:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233092096:12345-0@lo:601:ll_ost_io00_000.0 00000100:00100000:0.0:1782759769.605419:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233092096:12345-0@lo:601:ll_ost_io00_000.0 Request processed in 301us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.605427:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1782759769.610342:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233092096:0@lo:601:ll_ost_io00_000.0 00000100:00100000:1.0:1782759769.611105:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759769.611186:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218604928 00000100:00100000:2.0:1782759769.611194:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218604928 00000100:00100000:2.0:1782759769.611281:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 95 00000100:00100000:2.0:1782759769.611293:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218604928:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:2.0:1782759769.611353:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 12582912, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x6000 00010000:00010000:2.0:1782759769.611362:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.611378:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:2.0:1782759769.611382:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759769.611387:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.611410:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782759769.624869:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967446 is committed 00002000:00010000:0.0:1782759769.625077:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 12582912 -> 13631488 00002000:00010000:0.0:1782759769.625082:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 24576 -> 26624 00010000:00010000:0.0:1782759769.625095:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.625106:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.625114:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.625122:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759769.625126:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.625135:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.625154:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.625161:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4b43cd5/0xd5b45c7f5c60dcd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.625264:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218604928:12345-192.168.202.31@tcp:4:dd.0 Request processed in 13968us (14156us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1782759769.625275:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 95 00000100:00100000:3.0:1782759769.625353:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233092224:0@lo:601:ll_ost_io00_002.0 00000100:00100000:3.0:1782759769.625417:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759769.625817:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092224 00000100:00100000:0.0:1782759769.625824:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092224 00000100:00100000:0.0:1782759769.625941:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1782759769.625950:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233092224:12345-0@lo:601:ll_ost_io00_002.0 00000100:00100000:0.0:1782759769.626160:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233092224:12345-0@lo:601:ll_ost_io00_002.0 Request processed in 211us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.626168:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1782759769.626248:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233092224:0@lo:601:ll_ost_io00_002.0 00000100:00100000:2.0:1782759769.632008:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759769.632107:0:125830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218605056 00000100:00100000:1.0:1782759769.632117:0:125830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218605056 00000100:00100000:1.0:1782759769.632192:0:125830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 96 00000100:00100000:1.0:1782759769.632202:0:125830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218605056:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759769.632246:0:125830:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 13631488, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x6800 00010000:00010000:1.0:1782759769.632254:0:125830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.632270:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:1.0:1782759769.632274:0:125830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759769.632280:0:125830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.632294:0:125830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759769.640707:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967447 is committed 00002000:00010000:1.0:1782759769.640954:0:125830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 13631488 -> 14680064 00002000:00010000:1.0:1782759769.640960:0:125830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 26624 -> 28672 00010000:00010000:1.0:1782759769.640974:0:125830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.640988:0:125830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.640998:0:125830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.641014:0:125830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759769.641019:0:125830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.641028:0:125830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.641047:0:125830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.641054:0:125830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dcda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 125830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759769.641218:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233092352:0@lo:601:ll_ost_io00_003.0 00000100:00100000:0.0:1782759769.641273:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759769.641570:0:125830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218605056:12345-192.168.202.31@tcp:4:dd.0 Request processed in 9366us (9568us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1782759769.641607:0:125830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 96 00000100:00100000:1.0:1782759769.641636:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092352 00000100:00100000:1.0:1782759769.641643:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092352 00000100:00100000:1.0:1782759769.641686:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1782759769.641696:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3665:x1869355233092352:12345-0@lo:601:ll_ost_io00_003.0 00000100:00100000:1.0:1782759769.641914:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3665:x1869355233092352:12345-0@lo:601:ll_ost_io00_003.0 Request processed in 220us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759769.641921:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1782759769.641972:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233092352:0@lo:601:ll_ost_io00_003.0 00000100:00100000:3.0:1782759769.646774:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759769.646858:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218605184 00000100:00100000:1.0:1782759769.646866:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218605184 00000100:00100000:1.0:1782759769.646924:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 97 00000100:00100000:1.0:1782759769.646932:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218605184:12345-192.168.202.31@tcp:4:dd.0 00002000:00010000:1.0:1782759769.646971:0:8451:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 14680064, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x7000 00010000:00010000:1.0:1782759769.646980:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.646995:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:1.0:1782759769.646999:0:8451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759769.647005:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.647020:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759769.656743:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967448 is committed 00000100:00100000:3.0:1782759769.656927:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233092480:0@lo:601:ll_ost_io00_001.0 00000100:00100000:3.0:1782759769.656987:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1782759769.657136:0:8451:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 14680064 -> 15728640 00002000:00010000:1.0:1782759769.657140:0:8451:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 28672 -> 30720 00010000:00010000:1.0:1782759769.657151:0:8451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.657170:0:8451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.657176:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.657190:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759769.657193:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.657200:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.657213:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759769.657218:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0c350a4/0xd5b45c7f5c60dce1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759769.657280:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218605184:12345-192.168.202.31@tcp:4:dd.0 Request processed in 10346us (10511us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1782759769.657291:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 97 00000100:00100000:0.0:1782759769.657343:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092480 00000100:00100000:0.0:1782759769.657350:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092480 00000100:00100000:0.0:1782759769.657406:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1782759769.657415:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9332050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233092480:12345-0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759769.658662:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9332050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233092480:12345-0@lo:601:ll_ost_io00_001.0 Request processed in 1244us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.658672:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1782759769.658942:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233092480:0@lo:601:ll_ost_io00_001.0 00000100:00100000:0.0:1782759769.660117:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759769.660169:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218605440 00000100:00100000:2.0:1782759769.660177:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218605440 00000100:00100000:2.0:1782759769.660242:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 424 00000100:00100000:2.0:1782759769.660253:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:114216:x1869355218605440:12345-192.168.202.31@tcp:35:dd.0 00000001:00080000:2.0:1782759769.660661:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967743 00000100:00100000:2.0:1782759769.660745:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:114216:x1869355218605440:12345-192.168.202.31@tcp:35:dd.0 Request processed in 494us (631us total) trans 4294967744 rc 0/0 00000100:00100000:2.0:1782759769.660753:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 424 00000020:00080000:2.0:1782759769.660758:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782759769.667943:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759769.668045:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218605568 00000100:00100000:3.0:1782759769.668055:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218605568 00000100:00100000:3.0:1782759769.668143:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1114 00000100:00100000:3.0:1782759769.668151:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218605568:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759769.668180:0:8446:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759769.668202:0:8446:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27720 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782759769.668227:0:8446:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 15728640, mtime: 0x6a42c15a, atime: 0x0, ctime: 0x6a42c15a, blocks: 0x7800 00010000:00010000:3.0:1782759769.668244:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=3809s v=(0 0) 00010000:00010000:3.0:1782759769.668247:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759769.668254:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.668266:0:8446:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 8 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759769.668277:0:8446:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7800, rc 0) 00000100:00100000:3.0:1782759769.668335:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2405:x1869355218605568:12345-192.168.202.31@tcp:101:rm.0 Request processed in 184us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.668342:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1114 00000100:00100000:1.0:1782759769.670602:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759769.670665:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218605824 00000100:00100000:0.0:1782759769.670672:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218605824 00000100:00100000:0.0:1782759769.670722:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3071 00000100:00100000:0.0:1782759769.670731:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:114217:x1869355218605824:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:0.0:1782759769.670782:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759769.670805:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60dc63 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27719 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670818:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2a:0x0].0x0 (ffff8cded3a3bb00) 00010000:00010000:0.0:1782759769.670826:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759769.670844:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670854:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670860:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670870:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670874:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670878:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.670992:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671001:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671008:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759769.671244:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9752 00000004:00080000:0.0:1782759769.671252:0:6531:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3809947674068ns, next at 3810947672350ns, rc = 0 00010000:00010000:0.0:1782759769.671295:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671301:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671306:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671311:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671411:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671421:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671439:0:6531:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759769.671458:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671465:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671468:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759769.671471:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671475:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671476:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759769.671480:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759769.671481:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671484:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671488:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671489:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671497:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2a:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759769.671500:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782759769.671503:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671507:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2a:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759769.671509:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60dcfd lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671510:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782759769.671512:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 1/0,0 mode: --/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671517:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd04 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671524:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671529:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759769.671531:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759769.671531:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759769.671532:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759769.671537:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671542:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671547:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759769.671550:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671555:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671562:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759769.671564:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759769.671566:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671572:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dcef lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759769.671628:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d2e981b reply state 0000000017f129a5 transno 4294967745 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671640:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759769.671646:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:0.0:1782759769.671649:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759769.671652:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759769.671712:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+11:114217:x1869355218605824:12345-192.168.202.31@tcp:36:rm.0 Request processed in 981us (1140us total) trans 4294967745 rc 0/0 00000100:00100000:0.0:1782759769.671720:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3071 00000100:00100000:2.0:1782759769.994808:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233092736:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759769.994881:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759769.994939:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233092608:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1782759769.995090:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759769.995116:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092736 00000100:00100000:1.0:1782759769.995124:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092736 00000100:00100000:1.0:1782759769.995275:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092608 00000100:00100000:1.0:1782759769.995279:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092608 00000100:00100000:3.0:1782759769.995446:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233092864:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759769.995481:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759769.995512:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092864 00000100:00100000:3.0:1782759769.995516:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092864 00000100:00100000:3.0:1782759769.995558:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1782759769.995599:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233092864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759769.995635:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:3.0:1782759769.996097:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233092864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 516us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759769.996105:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:3.0:1782759769.996148:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233092864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759769.997738:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1782759769.997757:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233092736:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759769.997858:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233092736:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 109us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.997865:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1782759769.997887:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1782759769.997893:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233092608:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759769.997924:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233092608:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 30us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759769.997929:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1782759769.997993:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233092736:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1782759769.998006:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233092608:0@lo:601:lquota_wb_lustr.0 00010000:00010000:3.0:1782759770.060931:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759771.038854:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233093376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.038925:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.038965:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233093888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.038981:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.038991:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233094400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039003:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039019:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782759771.039022:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233092992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039040:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039054:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233093504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039068:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039077:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233094016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039087:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039095:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233094528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039107:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039121:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233093120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039135:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039144:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233093632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039155:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039167:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233094144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039187:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039204:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759771.039209:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233093248:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039228:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039243:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233093760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039261:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039274:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233094272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039295:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.039326:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093376 00000100:00100000:0.0:1782759771.039333:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093376 00000100:00100000:0.0:1782759771.039370:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093120 00000100:00100000:0.0:1782759771.039373:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093120 00000100:00100000:0.0:1782759771.039422:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093632 00000100:00100000:0.0:1782759771.039426:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093632 00000100:00100000:0.0:1782759771.039448:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094144 00000100:00100000:0.0:1782759771.039451:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094144 00000100:00100000:0.0:1782759771.039462:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093760 00000100:00100000:0.0:1782759771.039465:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093760 00000100:00100000:0.0:1782759771.039476:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094272 00000100:00100000:0.0:1782759771.039479:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094272 00000100:00100000:0.0:1782759771.039495:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5446 00000100:00100000:0.0:1782759771.039503:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233093376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.039561:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233093376:12345-0@lo:400:kworker.0 Request processed in 57us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.039568:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5446 00000100:00100000:2.0:1782759771.039804:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5447 00000100:00100000:2.0:1782759771.039829:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233093120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.039875:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233093120:12345-0@lo:400:kworker.0 Request processed in 62us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759771.039882:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5447 00000100:00100000:2.0:1782759771.039899:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5448 00000100:00100000:2.0:1782759771.039906:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.039932:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233093632:12345-0@lo:400:kworker.0 Request processed in 27us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759771.039937:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5448 00000100:00100000:2.0:1782759771.039948:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5449 00000100:00100000:2.0:1782759771.039955:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233094144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.039976:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233094144:12345-0@lo:400:kworker.0 Request processed in 23us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759771.039982:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5449 00000100:00100000:2.0:1782759771.039993:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5450 00000100:00100000:2.0:1782759771.039998:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233093760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.040022:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233093760:12345-0@lo:400:kworker.0 Request processed in 24us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759771.040027:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5450 00000100:00100000:2.0:1782759771.040039:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5451 00000100:00100000:2.0:1782759771.040046:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233094272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.040074:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233094272:12345-0@lo:400:kworker.0 Request processed in 29us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759771.040095:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5451 00000100:00080000:2.0:1782759771.040117:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759771.040121:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759771.040155:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233093760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.040166:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3743480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233094272:0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.040174:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233093120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.040183:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233093632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759771.040192:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233094144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.040458:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093888 00000100:00100000:0.0:1782759771.040462:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093888 00000100:00100000:0.0:1782759771.040496:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094400 00000100:00100000:0.0:1782759771.040498:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094400 00000100:00100000:0.0:1782759771.040511:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094016 00000100:00100000:0.0:1782759771.040513:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094016 00000100:00100000:0.0:1782759771.040525:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094528 00000100:00100000:0.0:1782759771.040528:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094528 00000100:00100000:0.0:1782759771.040542:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3195 00000100:00100000:0.0:1782759771.040549:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233093888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.040601:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233093888:12345-0@lo:400:kworker.0 Request processed in 54us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.040715:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093504 00000100:00100000:1.0:1782759771.040719:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093504 00000100:00100000:1.0:1782759771.040799:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233093248 00000100:00100000:1.0:1782759771.040802:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233093248 00000100:00100000:1.0:1782759771.040818:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484 00000100:00100000:1.0:1782759771.040825:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233093504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.040871:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233093504:12345-0@lo:400:kworker.0 Request processed in 48us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.040877:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484 00000100:00100000:1.0:1782759771.040890:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3485 00000100:00100000:1.0:1782759771.040895:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233093248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.040921:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233093248:12345-0@lo:400:kworker.0 Request processed in 27us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.040926:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3485 00000100:00100000:1.0:1782759771.040954:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233093248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.040995:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3196 00000100:00100000:1.0:1782759771.041000:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233094400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041022:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233094400:12345-0@lo:400:kworker.0 Request processed in 23us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.041026:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3196 00000100:00100000:1.0:1782759771.041034:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3197 00000100:00100000:1.0:1782759771.041037:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233094016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041051:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233094016:12345-0@lo:400:kworker.0 Request processed in 14us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.041055:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3197 00000100:00100000:1.0:1782759771.041060:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1782759771.041063:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233094528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041076:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233094528:12345-0@lo:400:kworker.0 Request processed in 13us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.041080:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3198 00000100:00100000:1.0:1782759771.041099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233092992 00000100:00100000:1.0:1782759771.041102:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233092992 00000100:00100000:1.0:1782759771.041119:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3426 00000100:00100000:1.0:1782759771.041122:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041143:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233092992:12345-0@lo:400:kworker.0 Request processed in 20us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759771.041146:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3426 00000100:00100000:1.0:1782759771.041190:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233092992:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041197:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233093504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041204:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233094016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041210:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233094528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041218:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233093376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041224:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233093888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759771.041229:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233094400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759771.041493:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3195 00000100:00080000:2.0:1782759771.041608:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759771.041612:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782759771.087981:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782759771.383851:0:159166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3811660269969ns, next at 3547591138841ns, rc = 0 00080000:00080000:0.0:1782759771.383959:0:159166:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782759771.384977:0:159166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3811661398532ns, next at 3810947672350ns, rc = 0 00080000:00080000:0.0:1782759771.384989:0:159166:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1782759771.386142:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00000004:00080000:1.0:1782759771.388436:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 97 committed 00000001:00080000:1.0:1782759771.388482:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967745 is committed 00000004:00080000:1.0:1782759771.388487:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 96 committed 00010000:00010000:0.0:1782759771.388638:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.388651:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759771.388900:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233094656:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1782759771.388966:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759771.388969:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.388976:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759771.388981:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.388989:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389004:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:0.0:1782759771.389007:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759771.389012:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389018:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60dc5c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389033:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389039:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389045:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389055:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759771.389058:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389064:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389071:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cded3a3b600) 00010000:00010000:0.0:1782759771.389073:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759771.389076:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.389081:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60dcf6 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759771.389234:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094656 00000100:00100000:3.0:1782759771.389241:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094656 00000100:00100000:3.0:1782759771.389282:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1782759771.389292:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233094656:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1782759771.389327:0:82628:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:25 count 1 00010000:00010000:3.0:1782759771.389344:0:82628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759771.389359:0:82628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759771.389366:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1782759771.389369:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782759771.389372:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759771.389411:0:82628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 7 pid: 8446 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759771.389441:0:82628:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 7 pid: 8446 timeout: 3911 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759771.389458:0:82628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:82628:1869355233094784:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759771.389601:0:82628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230180 going to sleep for 11 seconds 00000100:00100000:1.0:1782759771.394081:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759771.394160:0:82628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:82628:1869355233094784:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759771.394183:0:82628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759771.394418:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218605952 00000100:00100000:0.0:1782759771.394426:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218605952 00010000:00010000:0.0:1782759771.394480:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 8 pid: 8446 timeout: 3911 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759771.394518:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 867 00000100:00100000:0.0:1782759771.394528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2403:x1869355218605952:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759771.394543:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759771.394550:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 8 pid: 8446 timeout: 3911 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394562:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 8 pid: 8446 timeout: 3911 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394610:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b17245e8/0xd5b45c7f5c60dce8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27720 expref: 8 pid: 8446 timeout: 3911 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394628:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759771.394632:0:6516:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759771.394638:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394647:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394677:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759771.394694:0:82628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759771.394702:0:82628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759771.394732:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218605952:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 206us (660us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759771.394735:0:82628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759771.394739:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 867 00010000:00010000:1.0:1782759771.394743:0:82628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759771.394758:0:82628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782759771.394765:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759771.394771:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394778:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759771.394782:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394789:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394805:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394811:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007954b48e/0xd5b45c7f5c60dd0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759771.394826:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759771.394828:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759771.394829:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782759771.394873:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759771.394954:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233094656:12345-0@lo:6:osp-syn-0-1.0 Request processed in 5663us (5986us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1782759771.394962:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000004:00080000:2.0:1782759771.395058:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cdecd978e00/2, rc 0, transno 4294967449 00000100:00100000:2.0:1782759771.395070:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233094656:0@lo:6:osp-syn-0-1.0 00000004:00080000:0.0:1782759771.395263:0:159166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3811671685381ns, next at 3705288120531ns, rc = 0 00080000:00080000:0.0:1782759771.395273:0:159166:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1782759771.395363:0:159166:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3811671785196ns, next at 3792154732173ns, rc = 0 00080000:00080000:0.0:1782759771.395369:0:159166:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1782759771.396866:0:7461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 99 committed 00000004:00080000:2.0:1782759771.396963:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000100:00100000:3.0:1782759771.541755:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233094912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759771.541820:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759771.541879:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233095040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759771.541902:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759771.541932:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233094912 00000100:00100000:3.0:1782759771.541940:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233094912 00000100:00100000:3.0:1782759771.542146:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095040 00000100:00100000:3.0:1782759771.542150:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095040 00000100:00100000:3.0:1782759771.542351:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:3.0:1782759771.542360:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233094912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759771.542396:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759771.542440:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233094912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759771.542447:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00000100:00100000:3.0:1782759771.542470:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:3.0:1782759771.542476:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233095040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759771.542486:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759771.542510:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233095040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759771.542516:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00000100:00100000:3.0:1782759771.542770:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233095040:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759771.542796:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233094912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759771.683531:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759771.695130:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233095168:0@lo:601:kworker.0 00000100:00100000:0.0:1782759771.695256:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759771.695407:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095168 00000100:00100000:1.0:1782759771.695416:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095168 00000100:00100000:0.0:1782759771.695527:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1782759771.695536:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233095168:12345-0@lo:601:kworker.0 00000100:00100000:0.0:1782759771.695821:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0000_UUID+7:3664:x1869355233095168:12345-0@lo:601:kworker.0 Request processed in 286us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.695829:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1782759771.695894:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233095296:0@lo:106: 00000100:00100000:0.0:1782759771.695919:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759771.695942:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3da1900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759771.695956:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095296 00000100:00100000:0.0:1782759771.695959:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095296 00000100:00100000:0.0:1782759771.695985:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1782759771.695991:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233095296:12345-0@lo:106: 00010000:00010000:0.0:1782759771.696002:0:6513:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759771.696012:0:6513:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:0.0:1782759771.696048:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:6554:x1869355233095296:12345-0@lo:106: Request processed in 58us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.696055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1782759771.696103:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233095296:0@lo:106: 00000100:00100000:0.0:1782759771.696149:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233095168:0@lo:601:kworker.0 00010000:00010000:1.0:1782759771.696424:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759771.696434:0:8471:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759771.696442:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759771.696449:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759771.696501:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759771.699460:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759771.699470:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759771.699482:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802a00 already unused, calling callback (ffffffffc14b8e50) 00040000:00010000:3.0:1782759771.699486:0:9533:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759771.699497:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00040000:00010000:3.0:1782759771.699504:0:9533:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759771.699551:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759771.699558:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759771.699624:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233095424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759771.699693:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759771.699781:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095424 00000100:00100000:1.0:1782759771.699787:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095424 00000100:00100000:1.0:1782759771.699850:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1782759771.699860:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0000_UUID+7:3662:x1869355233095424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759771.699873:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759771.699889:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60dc7f lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc78 expref: 7 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759771.699946:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759771.699964:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cdedf802a00/0xd5b45c7f5c60dc78 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd5b45c7f5c60dc7f expref: -99 pid: 8452 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:3.0:1782759771.699980:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759771.699982:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759771.699984:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759771.703636:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759771.703816:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233095424:12345-0@lo:103:ldlm_bl.0 Request processed in 3951us (4115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759771.703830:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1782759771.703929:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233095424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759772.111656:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759772.554945:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233095680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759772.555021:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759772.555101:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095680 00000100:00100000:1.0:1782759772.555109:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095680 00000100:00100000:1.0:1782759772.555156:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:1.0:1782759772.555165:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233095680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759772.555195:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759772.555242:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233095680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759772.555249:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000100:00100000:1.0:1782759772.555296:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233095680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759772.555769:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759772.555778:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233095552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759772.555806:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759772.556706:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759772.556729:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233095808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759772.556768:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759772.557019:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095552 00000100:00100000:1.0:1782759772.557027:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095552 00000100:00100000:1.0:1782759772.557090:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3486 00000100:00100000:1.0:1782759772.557099:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233095552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759772.557128:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:1.0:1782759772.557175:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233095552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759772.557182:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3486 00000100:00100000:2.0:1782759772.557252:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095808 00000100:00100000:2.0:1782759772.557256:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095808 00000100:00100000:2.0:1782759772.557296:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:2.0:1782759772.557309:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233095808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759772.557325:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759772.557355:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233095808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759772.557361:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00000100:00100000:0.0:1782759772.557513:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233095808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759772.557999:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233095552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759772.894977:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759772.895027:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759772.895060:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759772.895086:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759772.895111:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759772.895240:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606208 00000100:00100000:0.0:1782759772.895250:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606208 00000100:00100000:0.0:1782759772.895306:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606336 00000100:00100000:0.0:1782759772.895310:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606336 00000100:00100000:0.0:1782759772.895333:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5452 00000100:00100000:0.0:1782759772.895343:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218606208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759772.895433:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218606208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 90us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759772.895441:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5452 00000100:00100000:0.0:1782759772.895458:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5453 00000100:00100000:1.0:1782759772.895731:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606464 00000100:00100000:1.0:1782759772.895735:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606464 00000100:00100000:1.0:1782759772.895766:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606592 00000100:00100000:1.0:1782759772.895768:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606592 00000100:00100000:1.0:1782759772.895792:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3199 00000100:00100000:1.0:1782759772.895799:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218606464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759772.895942:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3200 00000100:00100000:2.0:1782759772.895960:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218606592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759772.895991:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218606592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759772.895998:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3200 00000100:00100000:1.0:1782759772.897774:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218606464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 1965us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759772.897786:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3199 00000100:00100000:0.0:1782759772.897908:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218606336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759772.897954:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218606336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2490us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759772.897960:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5453 00000100:00080000:0.0:1782759772.897983:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759772.897988:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759772.897991:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759772.902980:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606080 00000100:00100000:3.0:1782759772.902997:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606080 00000100:00100000:3.0:1782759772.903073:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3427 00000100:00100000:3.0:1782759772.903084:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218606080:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759772.903875:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218606080:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 790us (8810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759772.903885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3427 00010000:00010000:0.0:1782759773.131015:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759774.157428:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759775.117507:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233095936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759775.117571:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759775.117622:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233095936 00000100:00100000:1.0:1782759775.117631:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233095936 00000100:00100000:1.0:1782759775.117712:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3487 00000100:00100000:1.0:1782759775.117722:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233095936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759775.117760:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759775.117947:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233095936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759775.117955:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3487 00000100:00100000:2.0:1782759775.122727:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233095936:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759775.179018:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759775.633227:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967449 is committed 00000100:00100000:1.0:1782759776.139990:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233096064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140106:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140166:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233096576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140200:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140221:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233097088:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140247:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140276:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233097600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140298:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140326:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759776.140356:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233096448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140390:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140411:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233096960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140435:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140681:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233097472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140767:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140811:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233096192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140840:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140859:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233096704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140883:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140902:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233097216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140925:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140947:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759776.140953:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233096320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.140978:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.140998:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233096832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.141020:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.141038:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233097344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.141060:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759776.141096:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096064 00000100:00100000:1.0:1782759776.141105:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096064 00000100:00100000:1.0:1782759776.141162:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3428 00000100:00100000:1.0:1782759776.141173:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233096064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.141232:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233096064:12345-0@lo:400:kworker.0 Request processed in 60us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.141251:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3428 00000100:00100000:0.0:1782759776.142868:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096448 00000100:00100000:0.0:1782759776.142882:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096448 00000100:00100000:0.0:1782759776.142923:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096192 00000100:00100000:0.0:1782759776.142925:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096192 00000100:00100000:0.0:1782759776.142936:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096704 00000100:00100000:0.0:1782759776.142938:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096704 00000100:00100000:1.0:1782759776.143038:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097216 00000100:00100000:1.0:1782759776.143043:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097216 00000100:00100000:0.0:1782759776.143082:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096832 00000100:00100000:0.0:1782759776.143086:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096832 00000100:00080000:2.0:1782759776.145715:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759776.145729:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759776.145953:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097344 00000100:00100000:1.0:1782759776.145967:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097344 00000100:00100000:1.0:1782759776.146003:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5454 00000100:00100000:1.0:1782759776.146015:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233096448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.146142:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233096448:12345-0@lo:400:kworker.0 Request processed in 130us (5750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.146151:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5454 00000100:00100000:1.0:1782759776.146174:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5455 00000100:00100000:1.0:1782759776.146182:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233096192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.146357:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233096192:12345-0@lo:400:kworker.0 Request processed in 175us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.146364:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5455 00000100:00100000:1.0:1782759776.146378:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5456 00000100:00100000:1.0:1782759776.146385:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233096704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.146420:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233096704:12345-0@lo:400:kworker.0 Request processed in 36us (5537us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.146426:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5456 00000100:00100000:1.0:1782759776.146438:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5457 00000100:00080000:2.0:1782759776.146556:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759776.146612:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233097216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.146650:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233097216:12345-0@lo:400:kworker.0 Request processed in 206us (5723us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.146656:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5457 00000100:00100000:1.0:1782759776.146687:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5458 00000100:00100000:1.0:1782759776.146694:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233097344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.146841:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233097344:12345-0@lo:400:kworker.0 Request processed in 147us (5779us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.146848:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5458 00000100:00100000:1.0:1782759776.146880:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096576 00000100:00100000:1.0:1782759776.146886:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096576 00000100:00100000:1.0:1782759776.146949:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096320 00000100:00100000:1.0:1782759776.146953:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096320 00000100:00100000:1.0:1782759776.146968:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3488 00000100:00100000:1.0:1782759776.146974:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233096576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147014:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233096576:12345-0@lo:400:kworker.0 Request processed in 40us (6813us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.147021:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3488 00000100:00100000:1.0:1782759776.147032:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3489 00000100:00100000:1.0:1782759776.147037:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233096320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147067:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233096320:12345-0@lo:400:kworker.0 Request processed in 31us (6089us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.147072:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3489 00000100:00100000:1.0:1782759776.147142:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233096448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147158:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233096064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147169:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233096576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147426:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097088 00000100:00100000:1.0:1782759776.147433:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097088 00000100:00100000:1.0:1782759776.147619:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097600 00000100:00100000:1.0:1782759776.147624:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097600 00000100:00100000:1.0:1782759776.147653:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233096960 00000100:00100000:1.0:1782759776.147657:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233096960 00000100:00100000:1.0:1782759776.147670:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097472 00000100:00100000:1.0:1782759776.147673:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097472 00000100:00100000:1.0:1782759776.147689:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1782759776.147696:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233097088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147825:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233097088:12345-0@lo:400:kworker.0 Request processed in 129us (7576us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.147833:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3201 00000100:00100000:1.0:1782759776.147848:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3202 00000100:00100000:1.0:1782759776.147853:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233097600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147882:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233097600:12345-0@lo:400:kworker.0 Request processed in 30us (7584us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.147888:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3202 00000100:00100000:1.0:1782759776.147897:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1782759776.147902:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233096960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147924:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233096960:12345-0@lo:400:kworker.0 Request processed in 23us (7490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.147929:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3203 00000100:00100000:1.0:1782759776.147937:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1782759776.147942:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233097472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.147965:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233097472:12345-0@lo:400:kworker.0 Request processed in 23us (7199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759776.147970:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3204 00000100:00100000:1.0:1782759776.148008:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967449 gen 2 00000004:00080000:1.0:1782759776.148015:0:3663:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cdecd978e00, transno 4294967449 00000100:00100000:1.0:1782759776.148040:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233096960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.148056:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233097472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.148069:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233097088:0@lo:400:kworker.0 00000100:00100000:1.0:1782759776.148080:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233097600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759776.148479:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233096192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759776.148494:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233096704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759776.148508:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233097216:0@lo:400:kworker.0 00000100:00100000:3.0:1782759776.148540:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233096320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759776.148552:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233097344:0@lo:400:kworker.0 00000100:00100000:0.0:1782759776.149112:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5459 00000100:00100000:0.0:1782759776.149124:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233096832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759776.149206:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233096832:12345-0@lo:400:kworker.0 Request processed in 85us (8185us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759776.149213:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5459 00000100:00100000:0.0:1782759776.149254:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233096832:0@lo:400:kworker.0 00000100:00080000:2.0:1782759776.151523:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759776.155060:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782759776.204618:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759776.654648:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759776.654679:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759776.654788:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759776.654894:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097728 00000100:00100000:2.0:1782759776.654904:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097728 00000100:00100000:2.0:1782759776.654980:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:2.0:1782759776.654992:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233097728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759776.655049:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759776.655109:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233097728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759776.655118:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00000100:00100000:2.0:1782759776.655180:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233097728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759776.655438:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759776.655450:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233097856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759776.655486:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759776.655913:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097856 00000100:00100000:2.0:1782759776.655920:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097856 00000100:00100000:2.0:1782759776.655970:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:2.0:1782759776.655980:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233097856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759776.656007:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759776.656061:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233097856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759776.656069:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00000100:00100000:0.0:1782759776.656217:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233097856:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759777.242761:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759777.675699:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233098112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759777.675805:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759777.675889:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759777.675898:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233097984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759777.675928:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759777.675999:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233097984 00000100:00100000:0.0:1782759777.676009:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233097984 00000100:00100000:0.0:1782759777.676087:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000100:00100000:0.0:1782759777.676097:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233097984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759777.676139:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759777.676197:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233097984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759777.676205:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00000100:00100000:3.0:1782759777.676278:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233098240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759777.676304:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233097984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759777.676319:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759777.679309:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098112 00000100:00100000:2.0:1782759777.679891:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098240 00000100:00100000:2.0:1782759777.679901:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098240 00000100:00100000:2.0:1782759777.680011:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:2.0:1782759777.680024:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233098240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759777.680073:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759777.680193:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233098240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759777.680202:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00000100:00100000:3.0:1782759777.680794:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233098240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759777.680896:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098112 00000100:00100000:1.0:1782759777.680961:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490 00000100:00100000:1.0:1782759777.680969:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233098112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759777.681004:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:1.0:1782759777.681076:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233098112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759777.681083:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490 00000100:00100000:3.0:1782759777.681482:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233098112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759778.021184:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759778.021230:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759778.021266:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759778.021284:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759778.021307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759778.021349:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606976 00000100:00100000:2.0:1782759778.021646:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606976 00000100:00100000:2.0:1782759778.021732:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606848 00000100:00100000:2.0:1782759778.021736:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606848 00000100:00100000:2.0:1782759778.021765:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5460 00000100:00100000:2.0:1782759778.021789:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218606976:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759778.021820:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218606720 00000100:00100000:0.0:1782759778.021825:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218606720 00000100:00100000:0.0:1782759778.021861:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3429 00000100:00100000:0.0:1782759778.021869:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218606720:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759778.021892:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218606976:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 118us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759778.021895:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2404:x1869355218606720:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759778.021901:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5460 00000100:00100000:2.0:1782759778.021920:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5461 00000100:00100000:2.0:1782759778.021928:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218606848:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759778.021952:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218606848:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759778.021958:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5461 00000100:00100000:2.0:1782759778.021979:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607232 00000100:00100000:2.0:1782759778.021982:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607232 00000100:00100000:2.0:1782759778.022013:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607104 00000100:00100000:2.0:1782759778.022016:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607104 00000100:00100000:2.0:1782759778.022039:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3205 00000100:00100000:2.0:1782759778.022047:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218607232:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759778.022081:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3429 00000100:00100000:2.0:1782759778.022096:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218607232:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759778.022130:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3205 00000100:00100000:2.0:1782759778.022155:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3206 00000100:00100000:2.0:1782759778.022793:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218607104:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759778.022839:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218607104:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 677us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759778.022847:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3206 00000100:00080000:2.0:1782759778.022883:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759778.022888:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759778.022890:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759778.022893:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759778.251209:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759779.278917:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1782759780.014009:0:159444:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782759780.014024:0:159444:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1782759780.020020:0:159445:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782759780.020036:0:159445:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1782759780.243663:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233098368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759780.243765:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759780.243882:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098368 00000100:00100000:1.0:1782759780.243891:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098368 00000100:00100000:1.0:1782759780.243966:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3491 00000100:00100000:1.0:1782759780.243977:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233098368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759780.244024:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759780.244091:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233098368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759780.252815:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233098368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759780.253971:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3491 00010000:00010000:1.0:1782759780.299413:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759781.233864:0:159505:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff649f6770 20000000:00000080:2.0:1782759781.233886:0:159505:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec12ea000 uarg=0000000000000000 00010000:00010000:2.0:1782759781.234110:0:159505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759781.234126:0:159505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759781.234149:0:159505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759781.234161:0:159505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759781.234175:0:159505:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759781.234194:0:159505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759781.234212:0:159505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759781.234358:0:159505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759781.234398:0:159505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759781.234487:0:159505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 23 pid: 6526 timeout: 3971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759781.234504:0:159505:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159505:1869355233098496:0@lo:104: 00000100:00100000:2.0:1782759781.234568:0:159505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759781.234872:0:159505:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759781.234904:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098496 00000100:00100000:1.0:1782759781.234911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098496 00000100:00100000:1.0:1782759781.235004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:1.0:1782759781.235012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:159505:x1869355233098496:12345-0@lo:104: 00010000:00010000:1.0:1782759781.235024:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759781.235087:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759781.235093:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:159505:x1869355233098496:12345-0@lo:104: Request processed in 83us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759781.235100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:2.0:1782759781.235161:0:159505:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159505:1869355233098496:0@lo:104: 00010000:00010000:2.0:1782759781.235190:0:159505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235244:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759781.235261:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235267:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759781.235270:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235278:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759781.235285:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759781.235298:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759781.235337:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235344:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759781.235365:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235371:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60dc40 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dc47 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235385:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759781.235392:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759781.235394:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759781.235416:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233098624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759781.235451:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.235486:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098624 00000100:00100000:3.0:1782759781.235489:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098624 00010000:00010000:3.0:1782759781.235506:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 24 pid: 6526 timeout: 3971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759781.235525:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1782759781.235531:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233098624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759781.235541:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759781.235545:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 24 pid: 6526 timeout: 3971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235554:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 24 pid: 6526 timeout: 3971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235567:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dc47 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dc40 expref: 24 pid: 6526 timeout: 3971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235609:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235617:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235630:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235638:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235651:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235658:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235663:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759781.235666:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235674:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235685:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759781.235693:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759781.235720:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233098624:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.235726:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:3.0:1782759781.235755:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233098624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759781.236111:0:159505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759781.236133:0:159505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759781.236139:0:159505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dd12 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759781.261077:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233098752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261152:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261202:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233099264:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261236:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261263:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233099776:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261282:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261324:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782759781.261330:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233099136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261355:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261372:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233099648:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261393:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261406:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233100160:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261426:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261452:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233098880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261474:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261491:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233099392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261511:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261526:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233099904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261546:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261561:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759781.261566:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233099008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261610:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261625:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233099520:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261644:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261660:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233100032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261678:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759781.261708:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098752 00000100:00100000:3.0:1782759781.261716:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098752 00000100:00100000:3.0:1782759781.261753:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099264 00000100:00100000:3.0:1782759781.261756:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099264 00000100:00100000:3.0:1782759781.261778:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099776 00000100:00100000:3.0:1782759781.261780:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099776 00000100:00100000:3.0:1782759781.261801:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099392 00000100:00100000:3.0:1782759781.261803:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099392 00000100:00100000:3.0:1782759781.261814:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099904 00000100:00100000:3.0:1782759781.261816:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099904 00000100:00100000:3.0:1782759781.261825:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099008 00000100:00100000:3.0:1782759781.261827:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099008 00000100:00100000:3.0:1782759781.261840:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5462 00000100:00100000:3.0:1782759781.261848:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233098752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261898:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233098752:12345-0@lo:400:kworker.0 Request processed in 50us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.261904:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5462 00000100:00100000:3.0:1782759781.261921:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5463 00000100:00100000:3.0:1782759781.261927:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233099264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261953:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233099264:12345-0@lo:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.261959:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5463 00000100:00100000:3.0:1782759781.261970:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5464 00000100:00100000:3.0:1782759781.261976:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233099776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.261999:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233099776:12345-0@lo:400:kworker.0 Request processed in 24us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262005:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5464 00000100:00100000:3.0:1782759781.262015:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5465 00000100:00100000:3.0:1782759781.262021:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233099392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262050:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233099392:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262056:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5465 00000100:00100000:3.0:1782759781.262067:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5466 00000100:00100000:3.0:1782759781.262079:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233099904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262103:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233099904:12345-0@lo:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262109:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5466 00000100:00100000:3.0:1782759781.262118:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5467 00000100:00100000:3.0:1782759781.262123:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233099008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262143:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233099008:12345-0@lo:400:kworker.0 Request processed in 20us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262149:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5467 00000100:00100000:3.0:1782759781.262170:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099136 00000100:00100000:3.0:1782759781.262173:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099136 00000100:00100000:3.0:1782759781.262208:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233098880 00000100:00100000:3.0:1782759781.262211:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233098880 00000100:00100000:3.0:1782759781.262223:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492 00000100:00100000:3.0:1782759781.262228:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233099136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262256:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233099136:12345-0@lo:400:kworker.0 Request processed in 28us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262262:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492 00000100:00100000:3.0:1782759781.262272:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493 00000100:00100000:3.0:1782759781.262277:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233098880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262319:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233098880:12345-0@lo:400:kworker.0 Request processed in 41us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262324:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493 00000100:00100000:3.0:1782759781.262340:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099648 00000100:00100000:3.0:1782759781.262343:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099648 00000100:00100000:3.0:1782759781.262365:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100160 00000100:00100000:3.0:1782759781.262368:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100160 00000100:00100000:3.0:1782759781.262385:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233099520 00000100:00100000:3.0:1782759781.262387:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233099520 00000100:00100000:3.0:1782759781.262397:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100032 00000100:00100000:3.0:1782759781.262399:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100032 00000100:00100000:3.0:1782759781.262410:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3207 00000100:00100000:3.0:1782759781.262416:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233099648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262447:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233099648:12345-0@lo:400:kworker.0 Request processed in 31us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262454:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3207 00000100:00100000:3.0:1782759781.262463:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3208 00000100:00100000:3.0:1782759781.262469:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233100160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262494:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233100160:12345-0@lo:400:kworker.0 Request processed in 25us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262501:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3208 00000100:00100000:3.0:1782759781.262510:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3209 00000100:00100000:3.0:1782759781.262516:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233099520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262538:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233099520:12345-0@lo:400:kworker.0 Request processed in 23us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262544:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3209 00000100:00100000:3.0:1782759781.262553:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3210 00000100:00100000:3.0:1782759781.262558:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233100032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262607:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233100032:12345-0@lo:400:kworker.0 Request processed in 48us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759781.262613:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3210 00000100:00080000:3.0:1782759781.262655:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759781.262659:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759781.262662:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759781.262671:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759781.262703:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233099136:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262716:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233099648:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262726:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233100160:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262736:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233098752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262746:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233099264:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262755:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233099776:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262810:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233099008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262821:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233099520:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262830:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233100032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262841:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233098880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262851:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233099392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759781.262860:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233099904:0@lo:400:kworker.0 00010000:00010000:3.0:1782759781.331971:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759781.774473:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233100288:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759781.774552:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759781.774640:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233100416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759781.774667:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759781.774705:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100288 00000100:00100000:2.0:1782759781.774712:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100288 00000100:00100000:2.0:1782759781.774767:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100416 00000100:00100000:2.0:1782759781.774770:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100416 00000100:00100000:2.0:1782759781.774794:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:2.0:1782759781.774818:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233100288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759781.774847:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759781.774894:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233100288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759781.774901:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00000100:00100000:2.0:1782759781.774918:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1782759781.774926:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233100416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759781.774936:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759781.774963:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233100416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759781.774969:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1782759781.775018:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233100416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759781.775052:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233100288:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759782.346797:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759782.794771:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759782.794983:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233100544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759782.795053:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759782.795160:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100544 00000100:00100000:1.0:1782759782.795169:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100544 00000100:00100000:1.0:1782759782.795376:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00000100:00100000:1.0:1782759782.795387:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233100544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759782.795418:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759782.795467:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233100544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759782.795474:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:2.0:1782759782.795539:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233100672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759782.795568:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759782.795941:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759782.795948:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233100800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759782.795977:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759782.796009:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100800 00000100:00100000:2.0:1782759782.796014:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100800 00000100:00100000:2.0:1782759782.796066:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494 00000100:00100000:2.0:1782759782.796073:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233100800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759782.796097:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:2.0:1782759782.796132:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233100800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759782.796151:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494 00000100:00100000:2.0:1782759782.796194:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233100800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759782.796346:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100672 00000100:00100000:0.0:1782759782.796351:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100672 00000100:00100000:0.0:1782759782.796386:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:0.0:1782759782.796393:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233100672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759782.796407:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759782.796443:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233100672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759782.796449:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00000100:00100000:0.0:1782759782.796564:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233100544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759782.798388:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233100672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759783.134547:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759783.134635:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759783.134668:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607360 00000100:00100000:1.0:1782759783.134679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607360 00000100:00100000:2.0:1782759783.134727:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759783.134757:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3430 00000100:00100000:1.0:1782759783.134768:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218607360:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759783.134776:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759783.135075:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218607360:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 309us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759783.135084:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3430 00000100:00100000:2.0:1782759783.139627:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759783.139680:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607872 00000100:00100000:2.0:1782759783.139690:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607872 00000100:00100000:2.0:1782759783.139761:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607744 00000100:00100000:2.0:1782759783.139765:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607744 00000100:00100000:2.0:1782759783.139793:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3211 00000100:00100000:2.0:1782759783.139805:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218607872:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759783.139876:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218607872:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 74us (5149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759783.139885:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3211 00000100:00100000:2.0:1782759783.139902:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3212 00000100:00100000:2.0:1782759783.139911:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218607744:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759783.139937:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218607744:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759783.139944:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3212 00000100:00100000:2.0:1782759783.139962:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607616 00000100:00100000:2.0:1782759783.139966:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607616 00000100:00100000:2.0:1782759783.140013:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218607488 00000100:00100000:2.0:1782759783.140017:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218607488 00000100:00100000:2.0:1782759783.140041:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5468 00000100:00100000:2.0:1782759783.140049:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218607616:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759783.140082:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218607616:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (5448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759783.140088:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5468 00000100:00100000:2.0:1782759783.140100:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5469 00000100:00100000:2.0:1782759783.140108:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218607488:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759783.140132:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218607488:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (5361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759783.140139:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5469 00000100:00080000:2.0:1782759783.140158:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759783.140162:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759783.140165:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759783.140166:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:1.0:1782759783.248569:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759783.248588:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759783.248601:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759783.248661:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.248683:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.248696:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759783.248723:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233100928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759783.248801:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759783.248853:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc5787600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759783.248881:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233100928 00000100:00100000:1.0:1782759783.248888:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233100928 00000100:00100000:1.0:1782759783.248936:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1782759783.248944:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233100928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759783.248957:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759783.248971:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dd19 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.248997:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.249008:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.249016:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759783.249054:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233100928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759783.249070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3431 00000100:00100000:1.0:1782759783.249120:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233100928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759783.249134:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.249143:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759783.249162:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759783.249167:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759783.249174:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759783.381991:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759784.235401:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759784.235442:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608000 00000100:00100000:0.0:1782759784.235451:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608000 00000100:00100000:0.0:1782759784.235505:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3072 00000100:00100000:0.0:1782759784.235692:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114587:x1869355218608000:12345-192.168.202.31@tcp:101:ls.0 00010000:00010000:0.0:1782759784.235716:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759784.235791:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dd27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27727 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.236994:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dd2e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.237013:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dd2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.237027:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dd2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759784.237082:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00000004:00200000:0.0:1782759784.237087:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759784.237107:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dd2e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.237138:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dd27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27727 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.237165:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dd2e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27727 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.237174:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759784.237177:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759784.237180:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802600, rc 0) 00000100:00100000:0.0:1782759784.237240:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:114587:x1869355218608000:12345-192.168.202.31@tcp:101:ls.0 Request processed in 1726us (1847us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759784.237250:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3072 00000100:00100000:2.0:1782759784.309222:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759784.311708:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608256 00000100:00100000:0.0:1782759784.311723:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608256 00000100:00100000:0.0:1782759784.311800:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3073 00000100:00100000:0.0:1782759784.311811:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:114589:x1869355218608256:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782759784.311833:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759784.311836:0:42628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782759784.311869:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802600/0xd5b45c7f5c60dd2e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27727 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.311890:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2900) 00010000:00010000:0.0:1782759784.311911:0:42628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759784.311928:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dd35 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2772e expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312058:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312072:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312082:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312094:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312101:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312107:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759784.312170:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00010000:00010000:0.0:1782759784.312183:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312191:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312197:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312204:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312210:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759784.312214:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312221:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312230:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759784.312233:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759784.312236:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312242:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60dd3c lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312252:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312279:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312285:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312290:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759784.312293:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312299:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312306:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc24d2c00) 00010000:00010000:0.0:1782759784.312309:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759784.312312:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312318:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60dd43 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312344:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dd35 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2772e expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312354:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2b00) 00010000:00010000:0.0:1782759784.312356:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759784.312360:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60dd35 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2772e expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759784.312375:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803c00, rc 0) 00000100:00100000:0.0:1782759784.312448:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114589:x1869355218608256:12345-192.168.202.31@tcp:101:dd.0 Request processed in 638us (3233us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759784.312456:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3073 00000100:00100000:2.0:1782759784.361147:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759784.361604:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608384 00000100:00100000:3.0:1782759784.361615:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608384 00000100:00100000:3.0:1782759784.361669:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3074 00000100:00100000:3.0:1782759784.361679:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114592:x1869355218608384:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:3.0:1782759784.361700:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759784.361724:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd4a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27735 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361810:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361825:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361836:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361848:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361855:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361861:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361916:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361924:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361930:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361937:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361943:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759784.361953:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361961:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361974:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4200) 00010000:00010000:3.0:1782759784.361976:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759784.361981:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.361987:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60dd51 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362001:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362006:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362012:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362016:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759784.362019:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362024:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362031:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759784.362034:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759784.362042:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362048:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dd58 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362078:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd4a lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27735 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362087:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4200) 00010000:00010000:3.0:1782759784.362089:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759784.362092:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd4a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27735 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759784.362103:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6c00, rc 0) 00000100:00100000:3.0:1782759784.362262:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114592:x1869355218608384:12345-192.168.202.31@tcp:101:rm.0 Request processed in 498us (1039us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759784.362278:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3074 00000100:00100000:1.0:1782759784.370497:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759784.371460:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608512 00000100:00100000:3.0:1782759784.371471:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608512 00000100:00100000:2.0:1782759784.371733:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3075 00000100:00100000:2.0:1782759784.371748:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114592:x1869355218608512:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759784.371771:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759784.371794:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60dd5f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2773c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371866:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371898:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371911:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371926:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371933:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371940:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.371998:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372006:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372013:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372020:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372027:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759784.372032:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372040:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372061:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500100) 00010000:00010000:2.0:1782759784.372064:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759784.372068:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372076:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60dd66 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372090:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372095:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372100:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372105:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759784.372107:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372112:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372119:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc3500300) 00010000:00010000:2.0:1782759784.372121:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759784.372123:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372128:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60dd6d lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372258:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60dd5f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2773c expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372279:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500100) 00010000:00010000:2.0:1782759784.372281:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759784.372286:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60dd5f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2773c expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759784.372300:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648a00, rc 0) 00000100:00100000:2.0:1782759784.372373:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114592:x1869355218608512:12345-192.168.202.31@tcp:101:rm.0 Request processed in 629us (1889us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759784.372389:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3075 00010000:00010000:3.0:1782759784.394791:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759785.354848:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759785.354874:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233101056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759785.354943:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759785.355009:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101056 00000100:00100000:1.0:1782759785.355017:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101056 00000100:00100000:1.0:1782759785.355082:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495 00000100:00100000:1.0:1782759785.355094:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233101056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759785.355134:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759785.355188:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233101056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759785.355195:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495 00000100:00100000:1.0:1782759785.355283:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233101056:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759785.420156:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759786.384985:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233101312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.385062:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759786.385328:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233101184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.385408:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.386646:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233101824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.386706:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.386739:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233102336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.386755:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.386770:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759786.386775:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233101440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.386790:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.386800:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233101952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.386812:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.386821:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233102464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.386846:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.386878:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101312 00000100:00100000:2.0:1782759786.386883:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101312 00000100:00100000:2.0:1782759786.386923:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101824 00000100:00100000:2.0:1782759786.386925:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101824 00000100:00100000:2.0:1782759786.386938:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102336 00000100:00100000:2.0:1782759786.386939:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102336 00000100:00100000:2.0:1782759786.386948:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101952 00000100:00100000:2.0:1782759786.386949:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101952 00000100:00100000:2.0:1782759786.386958:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102464 00000100:00100000:2.0:1782759786.386959:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102464 00000100:00100000:2.0:1782759786.386968:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5470 00000100:00100000:2.0:1782759786.387450:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233101312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387513:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233101312:12345-0@lo:400:kworker.0 Request processed in 538us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.387520:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5470 00000100:00100000:2.0:1782759786.387539:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5471 00000100:00100000:2.0:1782759786.387547:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233101824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387573:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233101824:12345-0@lo:400:kworker.0 Request processed in 28us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.387599:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5471 00000100:00100000:2.0:1782759786.387613:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5472 00000100:00100000:2.0:1782759786.387621:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233102336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387648:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233102336:12345-0@lo:400:kworker.0 Request processed in 30us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.387654:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5472 00000100:00100000:2.0:1782759786.387667:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5473 00000100:00100000:2.0:1782759786.387674:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233101952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387711:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233101952:12345-0@lo:400:kworker.0 Request processed in 38us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.387717:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5473 00000100:00100000:2.0:1782759786.387728:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5474 00000100:00100000:2.0:1782759786.387735:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233102464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387761:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233102464:12345-0@lo:400:kworker.0 Request processed in 27us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.387767:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5474 00000100:00100000:2.0:1782759786.387792:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101440 00000100:00100000:2.0:1782759786.387796:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101440 00000100:00100000:2.0:1782759786.387848:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496 00000100:00100000:2.0:1782759786.387859:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233101440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387898:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233101440:12345-0@lo:400:kworker.0 Request processed in 42us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.387907:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496 00000100:00100000:0.0:1782759786.387929:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101184 00000100:00080000:2.0:1782759786.387935:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759786.387941:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759786.387942:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101184 00000100:00100000:2.0:1782759786.387972:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233101440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.387990:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233101952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.388004:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233102464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759786.388014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3432 00000100:00100000:2.0:1782759786.388019:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233101824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759786.388028:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233101184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.388034:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233102336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.388051:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233101312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759786.388120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233101184:12345-0@lo:400:kworker.0 Request processed in 94us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759786.388133:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3432 00000100:00100000:3.0:1782759786.388824:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233101568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759786.388877:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.388927:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101568 00000100:00100000:2.0:1782759786.388936:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101568 00000100:00100000:2.0:1782759786.388980:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5475 00000100:00100000:2.0:1782759786.388993:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233101568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759786.389009:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233102080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.389063:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+7:3664:x1869355233101568:12345-0@lo:400:kworker.0 Request processed in 72us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759786.389065:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.389078:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5475 00000100:00100000:3.0:1782759786.389108:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233102592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759786.389135:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759786.389174:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233101568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759786.389381:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102080 00000100:00100000:3.0:1782759786.389386:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102080 00000100:00100000:3.0:1782759786.389981:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102592 00000100:00100000:3.0:1782759786.389986:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102592 00000100:00100000:1.0:1782759786.390072:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233101184:0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.390083:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233101696:0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.390131:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759786.390160:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233101696 00000100:00100000:1.0:1782759786.390165:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233101696 00000100:00100000:1.0:1782759786.390223:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497 00000100:00100000:1.0:1782759786.390236:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233101696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.390238:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3213 00000100:00100000:2.0:1782759786.390274:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233102080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.390310:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233101696:12345-0@lo:400:kworker.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759786.390319:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497 00000100:00100000:2.0:1782759786.390378:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233102080:12345-0@lo:400:kworker.0 Request processed in 115us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759786.390384:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233101696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.390393:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3213 00000100:00100000:1.0:1782759786.390411:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233102208:0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.390446:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759786.390471:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233102720:0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.390493:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759786.390519:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102208 00000100:00100000:1.0:1782759786.390523:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102208 00000100:00100000:2.0:1782759786.390598:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102720 00000100:00100000:2.0:1782759786.390605:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102720 00000100:00080000:0.0:1782759786.390842:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759786.390849:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759786.391074:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3214 00000100:00100000:3.0:1782759786.391083:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233102592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759786.391128:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233102592:12345-0@lo:400:kworker.0 Request processed in 48us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759786.391134:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3214 00000100:00100000:1.0:1782759786.391330:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3215 00000100:00100000:1.0:1782759786.391337:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233102208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.391370:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233102208:12345-0@lo:400:kworker.0 Request processed in 34us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759786.391391:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3215 00000100:00100000:3.0:1782759786.391474:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233102080:0@lo:400:kworker.0 00000100:00100000:3.0:1782759786.391491:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233102592:0@lo:400:kworker.0 00000100:00100000:1.0:1782759786.391632:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233102208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.396334:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3216 00000100:00100000:2.0:1782759786.396405:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233102720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759786.396537:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233102720:12345-0@lo:400:kworker.0 Request processed in 190us (6043us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.396543:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3216 00000100:00100000:1.0:1782759786.400363:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233102720:0@lo:400:kworker.0 00010000:00010000:3.0:1782759786.444517:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759786.891000:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233102848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759786.891097:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.891192:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759786.891199:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233102976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759786.891229:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759786.891284:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102848 00000100:00100000:2.0:1782759786.891293:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102848 00000100:00100000:2.0:1782759786.891377:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233102976 00000100:00100000:2.0:1782759786.891381:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233102976 00000100:00100000:2.0:1782759786.891407:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:2.0:1782759786.891418:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233102848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759786.891461:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759786.891522:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233102848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759786.891531:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00000100:00100000:0.0:1782759786.891725:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:0.0:1782759786.891735:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233102976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759786.891748:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759786.891781:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233102976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759786.891787:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:2.0:1782759786.893106:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233102976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759786.893120:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233102848:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759787.467856:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759787.915484:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233103104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759787.915680:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233103360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759787.915727:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759787.915797:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103360 00000100:00100000:2.0:1782759787.915816:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103360 00000100:00100000:2.0:1782759787.915877:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1782759787.915887:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233103360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759787.915921:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:2.0:1782759787.915962:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233103360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759787.915969:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1782759787.915993:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233103232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759787.916015:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759787.916044:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103232 00000100:00100000:2.0:1782759787.916055:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103232 00000100:00100000:2.0:1782759787.916092:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00000100:00100000:2.0:1782759787.916098:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233103232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759787.916117:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759787.916146:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233103232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759787.916151:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:3.0:1782759787.918722:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759787.918804:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233103360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759787.921708:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233103232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759787.923157:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103104 00000100:00100000:2.0:1782759787.923246:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103104 00000100:00100000:2.0:1782759787.923313:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1782759787.923324:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233103104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759787.923418:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759787.924457:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233103104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1131us (5736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759787.924467:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:3.0:1782759787.927561:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233103104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759788.263682:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759788.263723:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759788.263745:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759788.263766:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759788.263789:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759788.263818:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608640 00000100:00100000:2.0:1782759788.263828:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608640 00000100:00100000:2.0:1782759788.263888:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3433 00000100:00100000:2.0:1782759788.263899:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218608640:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759788.263967:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218608640:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759788.263975:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3433 00000100:00100000:2.0:1782759788.264015:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608896 00000100:00100000:2.0:1782759788.264019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608896 00000100:00100000:2.0:1782759788.264051:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218608768 00000100:00100000:2.0:1782759788.264054:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218608768 00000100:00100000:2.0:1782759788.264073:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5476 00000100:00100000:2.0:1782759788.264081:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218608896:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759788.264112:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218608896:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759788.264118:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5476 00000100:00100000:2.0:1782759788.264130:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5477 00000100:00100000:2.0:1782759788.264138:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218608768:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759788.264176:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218608768:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759788.264183:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5477 00000100:00100000:2.0:1782759788.264201:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609152 00000100:00100000:2.0:1782759788.264203:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609152 00000100:00100000:2.0:1782759788.264245:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609024 00000100:00100000:2.0:1782759788.264249:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609024 00000100:00100000:2.0:1782759788.264405:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3217 00000100:00100000:2.0:1782759788.264419:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218609152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759788.264451:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218609152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759788.264458:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3217 00000100:00100000:2.0:1782759788.264472:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3218 00000100:00100000:2.0:1782759788.264481:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218609024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759788.264505:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218609024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759788.264521:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3218 00000100:00080000:2.0:1782759788.265059:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759788.265065:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759788.265068:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759788.265070:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1782759788.283498:0:159825:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782759788.283511:0:159825:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1782759788.394788:0:159836:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782759788.394799:0:159836:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1782759788.490994:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759789.300326:0:159893:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff171ad9d0 20000000:00000080:3.0:1782759789.300343:0:159893:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4ab2800 uarg=0000000000000000 00010000:00010000:3.0:1782759789.301083:0:159893:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759789.301098:0:159893:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759789.301117:0:159893:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759789.301128:0:159893:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759789.301140:0:159893:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759789.301218:0:159893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759789.301257:0:159893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759789.301266:0:159893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759789.301300:0:159893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759789.301312:0:159893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 23 pid: 6526 timeout: 3979 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759789.301326:0:159893:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159893:1869355233103488:0@lo:104: 00000100:00100000:3.0:1782759789.301531:0:159893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759789.301636:0:159893:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44be0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759789.302236:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759789.302254:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103488 00000100:00100000:2.0:1782759789.302261:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103488 00000100:00100000:2.0:1782759789.302362:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1782759789.302374:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:159893:x1869355233103488:12345-0@lo:104: 00010000:00010000:2.0:1782759789.302503:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759789.302636:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759789.302642:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:159893:x1869355233103488:12345-0@lo:104: Request processed in 272us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759789.302650:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00100000:3.0:1782759789.302745:0:159893:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:159893:1869355233103488:0@lo:104: 00010000:00010000:3.0:1782759789.302767:0:159893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759789.302926:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759789.302933:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759789.302941:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759789.302945:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759789.302953:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759789.302961:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759789.302968:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759789.303005:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759789.303012:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759789.303057:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233103616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759789.303093:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759789.303175:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103616 00000100:00100000:0.0:1782759789.303180:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103616 00010000:00010000:0.0:1782759789.303201:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 24 pid: 6526 timeout: 3979 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759789.303243:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1782759789.303252:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233103616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759789.303263:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759789.303269:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 24 pid: 6526 timeout: 3979 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303278:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 24 pid: 6526 timeout: 3979 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303292:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60dd20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd19 expref: 24 pid: 6526 timeout: 3979 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303306:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303314:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303326:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303333:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303340:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303346:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303355:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759789.303359:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303366:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303390:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759789.303400:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759789.303615:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759789.303623:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412400/0xd5b45c7f5c60dd19 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dd20 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759789.303648:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759789.303650:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759789.303651:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759789.303783:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233103616:12345-0@lo:103:ldlm_bl.0 Request processed in 532us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759789.303790:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1782759789.303835:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233103616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759789.303859:0:159893:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759789.303867:0:159893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759789.303883:0:159893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dd74 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 159893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759789.519928:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759790.475414:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233103744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759790.475487:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759790.475759:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103744 00000100:00100000:1.0:1782759790.475767:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103744 00000100:00100000:1.0:1782759790.475838:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499 00000100:00100000:1.0:1782759790.475847:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233103744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759790.475882:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759790.475940:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233103744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759790.475948:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499 00000100:00100000:3.0:1782759790.476024:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233103744:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759790.538781:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759790.924359:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759790.924366:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759790.924379:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759790.924426:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759790.924438:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759790.924449:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759790.924472:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233103872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759790.924529:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759790.924612:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759790.924803:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233103872 00000100:00100000:3.0:1782759790.924811:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233103872 00000100:00100000:3.0:1782759790.924861:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3434 00000100:00100000:3.0:1782759790.924868:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233103872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759790.924881:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759790.924894:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dd7b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759790.924915:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759790.924924:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759790.924934:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6200, rc 0) 00000100:00100000:3.0:1782759790.924966:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233103872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759790.924972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3434 00000100:00100000:0.0:1782759790.926246:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233103872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759790.926270:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759790.926282:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759790.926302:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759790.926307:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759790.926314:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759791.499149:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233104128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499235:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.499280:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233104640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499304:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.499326:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233105152:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499346:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.499370:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759791.499376:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233104256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499412:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.499427:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233104768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499449:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.499463:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233105280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499481:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.499507:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104128 00000100:00100000:2.0:1782759791.499514:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104128 00000100:00100000:2.0:1782759791.499615:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3500 00000100:00100000:2.0:1782759791.499625:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233104128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499682:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233104128:12345-0@lo:400:kworker.0 Request processed in 58us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.499689:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3500 00000100:00100000:2.0:1782759791.499723:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104640 00000100:00100000:2.0:1782759791.499726:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104640 00000100:00100000:2.0:1782759791.499757:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105152 00000100:00100000:2.0:1782759791.499759:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105152 00000100:00100000:2.0:1782759791.499777:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104256 00000100:00100000:2.0:1782759791.499779:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104256 00000100:00100000:2.0:1782759791.499796:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5478 00000100:00100000:2.0:1782759791.499802:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233104640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499834:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233104640:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.499840:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5478 00000100:00100000:2.0:1782759791.499852:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5479 00000100:00100000:2.0:1782759791.499859:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233105152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499883:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233105152:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.499899:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5479 00000100:00100000:2.0:1782759791.499910:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5480 00000100:00100000:2.0:1782759791.499917:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233104256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.499943:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233104256:12345-0@lo:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.499948:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5480 00000100:00100000:2.0:1782759791.499972:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104768 00000100:00100000:2.0:1782759791.499976:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104768 00000100:00100000:2.0:1782759791.499999:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105280 00000100:00100000:2.0:1782759791.500002:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105280 00000100:00100000:2.0:1782759791.500017:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3219 00000100:00100000:2.0:1782759791.500024:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233104768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500055:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233104768:12345-0@lo:400:kworker.0 Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.500061:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3219 00000100:00100000:2.0:1782759791.500071:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3220 00000100:00100000:2.0:1782759791.500078:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233105280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500101:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233105280:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759791.500107:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3220 00000100:00080000:2.0:1782759791.500128:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759791.500132:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759791.500135:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759791.500176:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233104256:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500187:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233104768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500222:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233105280:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500234:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233104128:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500242:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233104640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.500251:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233105152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759791.500820:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233104000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759791.500874:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759791.500970:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233104512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759791.500997:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759791.504938:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233105024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759791.505003:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759791.505654:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233104384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.505714:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759791.505752:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233104896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.505777:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104000 00000100:00100000:1.0:1782759791.505779:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.505786:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104000 00000100:00100000:1.0:1782759791.505797:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233105408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.505817:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759791.505841:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104512 00000100:00100000:2.0:1782759791.505844:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104512 00000100:00100000:1.0:1782759791.505848:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104896 00000100:00100000:1.0:1782759791.505851:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104896 00000100:00100000:2.0:1782759791.505871:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5481 00000100:00100000:1.0:1782759791.505878:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105408 00000100:00100000:2.0:1782759791.505881:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233104000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.505881:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105408 00000100:00100000:1.0:1782759791.505900:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3221 00000100:00100000:1.0:1782759791.505906:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233104896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.505957:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233104896:12345-0@lo:400:kworker.0 Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759791.505964:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3221 00000100:00100000:1.0:1782759791.505979:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3222 00000100:00100000:1.0:1782759791.505985:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233105408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.506012:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233105408:12345-0@lo:400:kworker.0 Request processed in 27us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759791.506017:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3222 00000100:00100000:2.0:1782759791.506042:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233104000:12345-0@lo:400:kworker.0 Request processed in 164us (5167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759791.506042:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5482 00000100:00100000:1.0:1782759791.506048:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233104512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759791.506049:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5481 00000100:00100000:1.0:1782759791.506074:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233104512:12345-0@lo:400:kworker.0 Request processed in 27us (5076us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759791.506080:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5482 00000100:00100000:1.0:1782759791.506118:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233104896:0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.506137:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233105408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759791.506265:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233104000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759791.506276:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233104512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.506433:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105024 00000100:00100000:1.0:1782759791.506438:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105024 00000100:00100000:1.0:1782759791.506474:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5483 00000100:00100000:1.0:1782759791.506480:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233105024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759791.506515:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233105024:12345-0@lo:400:kworker.0 Request processed in 35us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759791.506521:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5483 00000100:00100000:0.0:1782759791.506601:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233104384 00000100:00100000:3.0:1782759791.506605:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233105024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759791.506605:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233104384 00000100:00100000:0.0:1782759791.506652:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501 00000100:00100000:0.0:1782759791.506660:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233104384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759791.506715:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233104384:12345-0@lo:400:kworker.0 Request processed in 46us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759791.506721:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501 00000100:00100000:1.0:1782759791.506832:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233104384:0@lo:400:kworker.0 00000100:00080000:2.0:1782759791.506955:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759791.506960:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759791.506963:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759791.565813:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759792.011192:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233105536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759792.011304:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759792.011407:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759792.011417:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233105664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759792.011445:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759792.011798:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105536 00000100:00100000:0.0:1782759792.011816:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105536 00000100:00100000:0.0:1782759792.011876:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105664 00000100:00100000:0.0:1782759792.011880:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105664 00000100:00100000:0.0:1782759792.011903:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1782759792.011913:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233105536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759792.011958:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759792.012021:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233105536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759792.012028:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00000100:00100000:0.0:1782759792.012047:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1782759792.012052:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233105664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759792.012062:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759792.012092:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233105664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759792.012098:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00000100:00100000:0.0:1782759792.012148:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233105536:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759792.012183:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233105664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759792.588166:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759792.735926:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759792.735976:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609408 00000100:00100000:1.0:1782759792.735990:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609408 00000100:00100000:1.0:1782759792.736080:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3076 00000100:00100000:1.0:1782759792.736093:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114801:x1869355218609408:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782759792.736118:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759792.736155:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60dd89 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27743 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736312:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736338:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736354:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736368:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736373:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736377:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759792.736440:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x26:0x0]: returning size 4096 00010000:00010000:1.0:1782759792.736454:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736459:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736463:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736467:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736471:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759792.736475:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736488:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736500:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f6800) 00010000:00010000:1.0:1782759792.736511:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759792.736515:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736520:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412000/0xd5b45c7f5c60dd90 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736534:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736539:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736545:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736549:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759792.736552:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736558:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736594:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6c00) 00010000:00010000:1.0:1782759792.736597:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759792.736600:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 2/0,0 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736614:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60dd97 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736651:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60dd89 lrc: 1/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27743 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736663:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f6800) 00010000:00010000:1.0:1782759792.736665:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759792.736669:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60dd89 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27743 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759792.736681:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413600, rc 0) 00000100:00100000:1.0:1782759792.736754:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114801:x1869355218609408:12345-192.168.202.31@tcp:101:dd.0 Request processed in 664us (842us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759792.736761:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3076 00000100:00080000:1.0:1782759792.736789:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759793.034772:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233105792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759793.034864:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759793.035021:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233105920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759793.035060:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759793.040339:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105920 00000100:00100000:0.0:1782759793.040363:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105920 00000100:00100000:0.0:1782759793.040508:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502 00000100:00100000:0.0:1782759793.040530:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233105920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759793.040606:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759793.040726:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233105920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 200us (5665us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759793.040735:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502 00000100:00100000:3.0:1782759793.041891:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233106048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759793.042119:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759793.042182:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233105792 00000100:00100000:3.0:1782759793.042189:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233105792 00000100:00100000:3.0:1782759793.042253:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106048 00000100:00100000:3.0:1782759793.042255:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106048 00000100:00100000:3.0:1782759793.042293:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:3.0:1782759793.042302:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233105792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759793.042337:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759793.042390:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233105792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (7526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759793.042464:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:1.0:1782759793.042725:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1782759793.042737:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233106048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759793.042751:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759793.042793:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233106048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759793.042798:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233105792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759793.042800:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00080000:1.0:1782759793.042816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759793.042834:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233106048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759793.042981:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233105920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759793.375800:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759793.375854:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759793.375886:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759793.375909:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759793.375939:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759793.375973:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609792 00000100:00100000:0.0:1782759793.375986:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609792 00000100:00100000:0.0:1782759793.376054:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609664 00000100:00100000:0.0:1782759793.376058:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609664 00000100:00100000:0.0:1782759793.376112:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5484 00000100:00100000:0.0:1782759793.376124:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218609792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759793.376235:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218609792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 113us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759793.376244:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5484 00000100:00100000:0.0:1782759793.376266:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5485 00000100:00100000:0.0:1782759793.376273:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218609664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759793.376303:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218609664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759793.376314:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5485 00000100:00100000:0.0:1782759793.376335:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610048 00000100:00100000:0.0:1782759793.376338:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610048 00000100:00100000:0.0:1782759793.376371:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609920 00000100:00100000:0.0:1782759793.376374:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609920 00000100:00100000:0.0:1782759793.376399:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3223 00000100:00100000:0.0:1782759793.376405:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218610048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759793.376437:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218610048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759793.376444:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3223 00000100:00100000:0.0:1782759793.376457:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3224 00000100:00100000:0.0:1782759793.376464:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218609920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759793.376489:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218609920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759793.376495:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3224 00000100:00080000:0.0:1782759793.376523:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759793.376527:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759793.376531:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759793.379373:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218609536 00000100:00100000:3.0:1782759793.379404:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218609536 00000100:00100000:3.0:1782759793.379602:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3435 00000100:00100000:3.0:1782759793.379615:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218609536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759793.379718:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218609536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 105us (3933us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759793.379726:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3435 00010000:00010000:1.0:1782759793.611766:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759793.671997:0:160089:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd966e9da0 20000000:00000080:3.0:1782759793.672023:0:160089:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4ab2c00 uarg=0000000000000000 00010000:00010000:2.0:1782759793.675720:0:160089:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759793.675753:0:160089:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759793.675778:0:160089:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759793.675790:0:160089:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759793.675814:0:160089:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759793.675851:0:160089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759793.675872:0:160089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759793.675882:0:160089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759793.675928:0:160089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759793.675944:0:160089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 23 pid: 6526 timeout: 3983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759793.675962:0:160089:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160089:1869355233106176:0@lo:104: 00000100:00100000:2.0:1782759793.676053:0:160089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759793.676231:0:160089:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccda80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759793.676317:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106176 00000100:00100000:1.0:1782759793.676327:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106176 00000100:00100000:1.0:1782759793.676392:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1782759793.676412:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:160089:x1869355233106176:12345-0@lo:104: 00010000:00010000:1.0:1782759793.676427:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759793.676503:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759793.676510:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:160089:x1869355233106176:12345-0@lo:104: Request processed in 101us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759793.676517:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1782759793.676624:0:160089:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160089:1869355233106176:0@lo:104: 00010000:00010000:3.0:1782759793.676652:0:160089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.676781:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759793.676790:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.676798:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759793.676802:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.676812:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759793.676821:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759793.676827:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759793.676919:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.676927:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759793.676962:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.676970:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412600/0xd5b45c7f5c60dd7b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dd82 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.676989:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759793.676991:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759793.676993:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759793.677030:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759793.677045:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233106304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759793.677088:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759793.677338:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106304 00000100:00100000:0.0:1782759793.677345:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106304 00010000:00010000:0.0:1782759793.677369:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 24 pid: 6526 timeout: 3983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759793.677400:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1782759793.677408:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233106304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759793.677421:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759793.677426:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 24 pid: 6526 timeout: 3983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677436:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 24 pid: 6526 timeout: 3983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677451:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60dd82 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dd7b expref: 24 pid: 6526 timeout: 3983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677466:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677474:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677488:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677496:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677503:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677509:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677515:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759793.677520:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677529:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677549:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759793.677564:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759793.677635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233106304:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759793.677643:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1782759793.677675:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233106304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759793.677740:0:160089:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759793.677748:0:160089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759793.677755:0:160089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60dd9e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759794.635067:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759794.875082:0:160137:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1c96ba30 20000000:00000080:0.0:1782759794.875100:0:160137:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedb965000 uarg=0000000000000000 00010000:00010000:0.0:1782759794.875312:0:160137:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759794.875328:0:160137:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759794.875349:0:160137:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759794.875359:0:160137:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759794.875372:0:160137:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759794.875392:0:160137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875408:0:160137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875419:0:160137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875426:0:160137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875432:0:160137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875438:0:160137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875445:0:160137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759794.875449:0:160137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875457:0:160137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875470:0:160137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875477:0:160137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759794.875483:0:160137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802600/0xd5b45c7f5c60dda5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759795.530714:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759795.530721:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759795.530727:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759795.530774:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759795.530786:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759795.530798:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759795.530823:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233106432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759795.530900:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759795.530996:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759795.533679:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106432 00000100:00100000:2.0:1782759795.533694:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106432 00000100:00100000:2.0:1782759795.533804:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3436 00000100:00100000:2.0:1782759795.533815:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233106432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759795.533841:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759795.533860:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ddac expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759795.533889:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759795.533900:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759795.533910:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649a00, rc 0) 00000100:00100000:2.0:1782759795.533989:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233106432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759795.533997:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3436 00000100:00100000:1.0:1782759795.535454:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233106432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759795.535482:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759795.535496:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759795.535538:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759795.535545:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759795.535552:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759795.594884:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759795.594910:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233106560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759795.594991:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759795.595217:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106560 00000100:00100000:3.0:1782759795.595238:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106560 00000100:00100000:3.0:1782759795.595316:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:3.0:1782759795.595326:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233106560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759795.595363:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:3.0:1782759795.595426:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233106560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759795.595434:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00100000:2.0:1782759795.595563:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233106560:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759795.659664:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759796.619204:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233107072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619288:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759796.619357:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233107584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619382:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759796.619397:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233108096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619413:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759796.619442:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782759796.619448:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233106944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619467:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759796.619481:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233107456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619497:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759796.619510:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233107968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619525:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759796.619559:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107072 00000100:00100000:3.0:1782759796.619566:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107072 00000100:00100000:3.0:1782759796.619635:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107456 00000100:00100000:3.0:1782759796.619637:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107456 00000100:00100000:3.0:1782759796.619658:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107968 00000100:00100000:3.0:1782759796.619660:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107968 00000100:00100000:3.0:1782759796.619688:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5486 00000100:00100000:3.0:1782759796.619696:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233107072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.619982:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+7:3663:x1869355233107072:12345-0@lo:400:kworker.0 Request processed in 286us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.619989:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5486 00000100:00100000:3.0:1782759796.620004:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5487 00000100:00100000:3.0:1782759796.620009:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233107456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.620031:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233107456:12345-0@lo:400:kworker.0 Request processed in 22us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.620036:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5487 00000100:00100000:3.0:1782759796.620053:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5488 00000100:00100000:3.0:1782759796.620058:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233107968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.620079:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233107968:12345-0@lo:400:kworker.0 Request processed in 21us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.620084:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5488 00000100:00100000:3.0:1782759796.620101:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107584 00000100:00100000:3.0:1782759796.620103:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107584 00000100:00100000:3.0:1782759796.620126:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108096 00000100:00100000:3.0:1782759796.620129:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108096 00000100:00100000:3.0:1782759796.620143:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3225 00000100:00100000:3.0:1782759796.620148:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233107584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.620185:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233107584:12345-0@lo:400:kworker.0 Request processed in 37us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.620190:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3225 00000100:00100000:3.0:1782759796.620200:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3226 00000100:00100000:3.0:1782759796.620205:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233108096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.620224:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233108096:12345-0@lo:400:kworker.0 Request processed in 20us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.620229:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3226 00000100:00100000:3.0:1782759796.620247:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106944 00000100:00100000:3.0:1782759796.620250:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106944 00000100:00100000:0.0:1782759796.620567:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233106816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.620627:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759796.620652:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233107328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.620669:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759796.620678:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233107840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.620697:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759796.620719:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1782759796.620725:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233106688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.620748:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759796.620765:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233107200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.620784:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759796.622769:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106816 00000100:00100000:2.0:1782759796.622783:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106816 00000100:00100000:2.0:1782759796.622838:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107328 00000100:00100000:2.0:1782759796.622841:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107328 00000100:00100000:2.0:1782759796.622856:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107840 00000100:00100000:2.0:1782759796.622859:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107840 00000100:00100000:2.0:1782759796.622878:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5489 00000100:00100000:2.0:1782759796.622887:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233106816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759796.622969:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233106816:12345-0@lo:400:kworker.0 Request processed in 83us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759796.622994:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5489 00000100:00100000:2.0:1782759796.623012:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5490 00000100:00100000:2.0:1782759796.623021:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233107328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759796.623051:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233107328:12345-0@lo:400:kworker.0 Request processed in 34us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759796.623057:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5490 00000100:00100000:2.0:1782759796.623068:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5491 00000100:00100000:2.0:1782759796.623076:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233107840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759796.623103:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233107840:12345-0@lo:400:kworker.0 Request processed in 29us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759796.623109:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5491 00000100:00080000:2.0:1782759796.623128:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759796.623133:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759796.623136:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759796.623139:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759796.628461:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233107712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.628531:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759796.628570:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233108224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.628610:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759796.628666:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233106816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.628682:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233107328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.628694:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233107840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.628759:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233106688 00000100:00100000:0.0:1782759796.628765:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233106688 00000100:00100000:0.0:1782759796.628816:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3437 00000100:00100000:0.0:1782759796.628825:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233106688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.628880:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233106688:12345-0@lo:400:kworker.0 Request processed in 55us (8129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759796.628887:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3437 00000100:00100000:0.0:1782759796.628922:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107712 00000100:00100000:0.0:1782759796.628925:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107712 00000100:00100000:0.0:1782759796.628958:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108224 00000100:00100000:0.0:1782759796.628961:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108224 00000100:00100000:0.0:1782759796.628988:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1782759796.628994:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233107712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.629027:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233107712:12345-0@lo:400:kworker.0 Request processed in 34us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759796.629033:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3227 00000100:00100000:0.0:1782759796.629044:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3228 00000100:00100000:0.0:1782759796.629051:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233108224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.629080:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233108224:12345-0@lo:400:kworker.0 Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759796.629086:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3228 00000100:00100000:0.0:1782759796.629117:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233106688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.629128:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233107712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759796.629137:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233108224:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630181:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233107200 00000100:00100000:3.0:1782759796.630193:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233107200 00000100:00100000:3.0:1782759796.630355:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233107456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630370:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233107968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630384:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233107072:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630417:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233107584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630428:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233108096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630499:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:3.0:1782759796.630510:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233106944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630610:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233106944:12345-0@lo:400:kworker.0 Request processed in 101us (11140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.630628:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:3.0:1782759796.630656:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233106944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.630678:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505 00000100:00100000:3.0:1782759796.630685:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233107200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759796.631057:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233107200:12345-0@lo:400:kworker.0 Request processed in 372us (10270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759796.631064:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505 00000100:00080000:2.0:1782759796.631231:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759796.631238:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759796.631369:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233107200:0@lo:400:kworker.0 00010000:00010000:3.0:1782759796.694690:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759797.136353:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233108352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759797.136424:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759797.136534:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108352 00000100:00100000:1.0:1782759797.136542:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108352 00000100:00100000:1.0:1782759797.136612:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:1.0:1782759797.136622:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233108352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759797.136650:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759797.136889:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233108352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759797.136896:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00000100:00100000:3.0:1782759797.140053:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759797.140078:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233108480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759797.140167:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759797.140225:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108480 00000100:00100000:3.0:1782759797.140244:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108480 00000100:00100000:3.0:1782759797.140295:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:3.0:1782759797.140304:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233108480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759797.140325:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759797.140365:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233108480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759797.140388:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00000100:00100000:3.0:1782759797.140432:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233108480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759797.144821:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233108352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759797.710933:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759798.156623:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233108608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759798.156755:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759798.156818:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759798.156824:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233108736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759798.156850:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759798.156877:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108608 00000100:00100000:3.0:1782759798.156883:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108608 00000100:00100000:3.0:1782759798.156934:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506 00000100:00100000:3.0:1782759798.156940:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233108608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759798.156969:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:3.0:1782759798.157008:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233108608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759798.157016:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506 00000100:00100000:3.0:1782759798.157042:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108736 00000100:00100000:3.0:1782759798.157046:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108736 00000100:00100000:3.0:1782759798.157145:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1782759798.157162:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233108736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759798.157182:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759798.157221:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233108736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759798.157227:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00000100:00100000:3.0:1782759798.157339:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233108736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759798.157372:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233108608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759798.157506:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759798.157518:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233108864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759798.157550:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1782759798.157597:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759798.157609:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108864 00000100:00100000:2.0:1782759798.157613:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108864 00000100:00100000:2.0:1782759798.157654:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:2.0:1782759798.157662:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233108864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759798.157674:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759798.157708:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233108864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759798.157721:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000100:00080000:2.0:1782759798.157740:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759798.157759:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233108864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759798.317371:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759798.317441:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610176 00000100:00100000:2.0:1782759798.317451:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610176 00000100:00100000:2.0:1782759798.317526:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3077 00000100:00100000:2.0:1782759798.317543:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114885:x1869355218610176:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:2.0:1782759798.317564:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759798.317737:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60ddba lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2774a expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317814:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317830:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317844:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317857:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317864:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317872:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317930:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317938:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317945:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317951:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317957:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759798.317961:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317968:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317980:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759798.317984:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759798.317988:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.317995:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ddc1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318008:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318014:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318026:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318032:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759798.318035:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318041:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318048:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc3500100) 00010000:00010000:2.0:1782759798.318051:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759798.318054:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318059:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60ddc8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318094:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60ddba lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2774a expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318104:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500600) 00010000:00010000:2.0:1782759798.318106:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759798.318110:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60ddba lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2774a expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759798.318123:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649400, rc 0) 00000100:00100000:2.0:1782759798.318246:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114885:x1869355218610176:12345-192.168.202.31@tcp:101:rm.0 Request processed in 711us (884us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759798.318261:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3077 00000100:00080000:0.0:1782759798.318400:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759798.323392:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759798.324611:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610304 00000100:00100000:0.0:1782759798.324636:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610304 00000100:00100000:0.0:1782759798.324708:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3078 00000100:00100000:0.0:1782759798.324719:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114885:x1869355218610304:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:0.0:1782759798.324741:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759798.324765:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60ddcf lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27751 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324833:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324851:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324862:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324875:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324882:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324889:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324928:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324936:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324942:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324949:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324955:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759798.324960:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324967:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324979:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2500) 00010000:00010000:0.0:1782759798.324982:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759798.324987:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.324993:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60ddd6 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325003:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325009:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325015:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325021:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759798.325024:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325030:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325037:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc24d2d00) 00010000:00010000:0.0:1782759798.325040:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759798.325043:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325048:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60dddd lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325084:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60ddcf lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27751 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325094:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc24d2500) 00010000:00010000:0.0:1782759798.325096:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759798.325100:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803e00/0xd5b45c7f5c60ddcf lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27751 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759798.325113:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803e00, rc 0) 00000100:00100000:0.0:1782759798.325201:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:114885:x1869355218610304:12345-192.168.202.31@tcp:101:rm.0 Request processed in 483us (1817us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759798.325209:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3078 00000100:00100000:1.0:1782759798.504251:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759798.504295:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759798.504321:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610432 00000100:00100000:1.0:1782759798.504325:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759798.504331:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610432 00000100:00100000:1.0:1782759798.504353:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759798.504381:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610688 00000100:00100000:1.0:1782759798.504385:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610688 00000100:00100000:2.0:1782759798.504391:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3438 00000100:00100000:2.0:1782759798.504401:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218610432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759798.504420:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610816 00000100:00100000:1.0:1782759798.504423:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610816 00000100:00100000:1.0:1782759798.504441:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3229 00000100:00100000:1.0:1782759798.504447:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218610688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759798.504484:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218610432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759798.504492:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3438 00000100:00100000:3.0:1782759798.504516:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610560 00000100:00100000:3.0:1782759798.504521:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610560 00000100:00100000:3.0:1782759798.504550:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5492 00000100:00100000:3.0:1782759798.504557:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218610560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759798.504558:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3230 00000100:00100000:2.0:1782759798.504565:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218610816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:0.0:1782759798.504688:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759798.504701:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759798.504704:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759798.506841:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218610688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 2381us (2501us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759798.506877:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3229 00000100:00100000:3.0:1782759798.510934:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218610560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 6364us (6625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759798.510951:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5492 00000100:00100000:2.0:1782759798.513077:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218610816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 8502us (8712us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759798.513093:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3230 00010000:00010000:1.0:1782759798.730748:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759799.754838:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759800.715501:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759800.715525:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233108992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759800.715628:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759800.715703:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233108992 00000100:00100000:0.0:1782759800.715711:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233108992 00000100:00100000:0.0:1782759800.715769:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507 00000100:00100000:0.0:1782759800.715778:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233108992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759800.715815:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:0.0:1782759800.715863:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233108992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759800.715870:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507 00000100:00100000:0.0:1782759800.715913:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233108992:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759800.779963:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759801.755198:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233109504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755290:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755349:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233110016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755378:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755394:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233110528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755417:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755442:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1782759801.755449:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233109120:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755481:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755516:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233109632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755547:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755564:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233110144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755779:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755798:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233110656:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755820:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755845:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233109248:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755870:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755887:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233109760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755907:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755923:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233110272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755944:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.755963:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759801.755970:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233109376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.755992:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.756009:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233109888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756030:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.756047:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233110400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756067:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759801.756101:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109504 00000100:00100000:0.0:1782759801.756107:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109504 00000100:00100000:0.0:1782759801.756158:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109248 00000100:00100000:0.0:1782759801.756162:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109248 00000100:00100000:0.0:1782759801.756174:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109760 00000100:00100000:0.0:1782759801.756177:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109760 00000100:00100000:0.0:1782759801.756198:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110272 00000100:00100000:0.0:1782759801.756201:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110272 00000100:00100000:0.0:1782759801.756222:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109888 00000100:00100000:0.0:1782759801.756225:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109888 00000100:00100000:0.0:1782759801.756240:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110400 00000100:00100000:0.0:1782759801.756243:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110400 00000100:00100000:0.0:1782759801.756260:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5493 00000100:00100000:0.0:1782759801.756269:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233109504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756325:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:3662:x1869355233109504:12345-0@lo:400:kworker.0 Request processed in 57us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756333:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5493 00000100:00100000:0.0:1782759801.756350:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5494 00000100:00100000:0.0:1782759801.756356:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233109248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756388:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233109248:12345-0@lo:400:kworker.0 Request processed in 32us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756395:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5494 00000100:00100000:0.0:1782759801.756407:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5495 00000100:00100000:0.0:1782759801.756413:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233109760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756443:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233109760:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756450:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5495 00000100:00100000:0.0:1782759801.756461:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5496 00000100:00100000:0.0:1782759801.756467:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233110272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756495:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233110272:12345-0@lo:400:kworker.0 Request processed in 28us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756501:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5496 00000100:00100000:0.0:1782759801.756512:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5497 00000100:00100000:0.0:1782759801.756518:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233109888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756543:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233109888:12345-0@lo:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756550:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5497 00000100:00100000:0.0:1782759801.756561:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5498 00000100:00100000:0.0:1782759801.756568:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233110400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756625:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233110400:12345-0@lo:400:kworker.0 Request processed in 58us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756631:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5498 00000100:00100000:0.0:1782759801.756651:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110016 00000100:00100000:0.0:1782759801.756655:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110016 00000100:00100000:0.0:1782759801.756682:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110528 00000100:00100000:0.0:1782759801.756685:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110528 00000100:00100000:0.0:1782759801.756698:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110144 00000100:00100000:0.0:1782759801.756701:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110144 00000100:00100000:0.0:1782759801.756711:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110656 00000100:00100000:0.0:1782759801.756714:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110656 00000100:00100000:0.0:1782759801.756726:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3231 00000100:00100000:0.0:1782759801.756733:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233110016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756765:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233110016:12345-0@lo:400:kworker.0 Request processed in 33us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756772:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3231 00000100:00100000:0.0:1782759801.756783:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3232 00000100:00100000:0.0:1782759801.756790:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233110528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756818:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233110528:12345-0@lo:400:kworker.0 Request processed in 29us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756824:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3232 00000100:00100000:0.0:1782759801.756835:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3233 00000100:00100000:0.0:1782759801.756841:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233110144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756871:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233110144:12345-0@lo:400:kworker.0 Request processed in 30us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756877:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3233 00000100:00100000:0.0:1782759801.756888:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3234 00000100:00100000:0.0:1782759801.756894:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233110656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.756920:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233110656:12345-0@lo:400:kworker.0 Request processed in 26us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.756926:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3234 00000100:00100000:0.0:1782759801.757152:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109120 00000100:00100000:0.0:1782759801.757156:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109120 00000100:00100000:0.0:1782759801.757185:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3439 00000100:00100000:0.0:1782759801.757191:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233109120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.757222:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233109120:12345-0@lo:400:kworker.0 Request processed in 31us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.757231:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3439 00000100:00100000:0.0:1782759801.757256:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109632 00000100:00100000:0.0:1782759801.757260:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109632 00000100:00100000:0.0:1782759801.757297:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233109376 00000100:00100000:0.0:1782759801.757300:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233109376 00000100:00100000:0.0:1782759801.757312:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508 00000100:00100000:0.0:1782759801.757317:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233109632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.757347:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233109632:12345-0@lo:400:kworker.0 Request processed in 30us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.757353:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508 00000100:00100000:0.0:1782759801.757363:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3509 00000100:00100000:0.0:1782759801.757368:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233109376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759801.757391:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233109376:12345-0@lo:400:kworker.0 Request processed in 24us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759801.757397:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3509 00000100:00080000:1.0:1782759801.761001:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759801.761012:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759801.761016:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759801.761019:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759801.761090:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233109376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761132:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233109888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761148:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233110400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761161:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233109248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761173:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233109760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761184:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233110272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761242:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233109120:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761257:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233109632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761270:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233110144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761293:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233110656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761305:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233109504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761317:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233110016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759801.761330:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233110528:0@lo:400:kworker.0 00010000:00010000:1.0:1782759801.803225:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1782759801.936219:0:160460:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1782759801.936230:0:160460:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:1.0:1782759801.983400:0:160466:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782759801.983411:0:160466:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1782759802.251314:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233110784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759802.251396:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759802.253147:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233110912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759802.253524:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759802.258199:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110784 00000100:00100000:2.0:1782759802.258212:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110784 00000100:00100000:2.0:1782759802.258281:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233110912 00000100:00100000:2.0:1782759802.258285:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233110912 00000100:00100000:2.0:1782759802.258315:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1782759802.258325:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233110784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759802.258361:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759802.258443:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233110784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (7046us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759802.258451:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1782759802.258478:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1782759802.258487:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233110912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759802.258498:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759802.258530:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233110912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (5006us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759802.258536:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:2.0:1782759802.258907:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233110784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759802.258949:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233110912:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782759802.827314:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759802.932005:0:160525:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcce83af70 20000000:00000080:0.0:1782759802.932024:0:160525:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4543000 uarg=0000000000000000 00010000:00010000:0.0:1782759802.932243:0:160525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759802.932259:0:160525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759802.932284:0:160525:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759802.932296:0:160525:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759802.932312:0:160525:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759802.932331:0:160525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759802.932350:0:160525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759802.932360:0:160525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759802.932818:0:160525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759802.932834:0:160525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 23 pid: 6525 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759802.932852:0:160525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160525:1869355233111040:0@lo:104: 00000100:00100000:0.0:1782759802.932918:0:160525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759802.932970:0:160525:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759802.933056:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111040 00000100:00100000:2.0:1782759802.933063:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111040 00000100:00100000:2.0:1782759802.933122:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:2.0:1782759802.933130:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:160525:x1869355233111040:12345-0@lo:104: 00010000:00010000:2.0:1782759802.933141:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.933212:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759802.933219:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:160525:x1869355233111040:12345-0@lo:104: Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759802.933226:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1782759802.933425:0:160525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160525:1869355233111040:0@lo:104: 00010000:00010000:0.0:1782759802.933443:0:160525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759802.934352:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759802.934363:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759802.934372:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759802.934376:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759802.934446:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759802.934453:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759802.934459:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759802.934562:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759802.934623:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759802.934658:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759802.934661:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233111168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759802.934673:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412000/0xd5b45c7f5c60ddac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ddb3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759802.934710:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759802.934767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111168 00000100:00100000:2.0:1782759802.934774:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111168 00010000:00010000:2.0:1782759802.934805:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 24 pid: 6525 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759802.934836:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1782759802.934847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee5716450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233111168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759802.934859:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759802.934872:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 24 pid: 6525 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934883:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 24 pid: 6525 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934897:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddb3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddac expref: 24 pid: 6525 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934912:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934921:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934935:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934943:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934950:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934956:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934961:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759802.934965:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934971:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.934999:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759802.935012:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759802.935021:0:160525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759802.935031:0:160525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759802.935039:0:160525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803a00/0xd5b45c7f5c60dde4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759802.935053:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee5716450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233111168:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759802.935062:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1782759802.935156:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233111168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759802.935208:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759802.935210:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759802.935212:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759803.275345:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759803.275370:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233111296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759803.275441:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759803.275516:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111296 00000100:00100000:0.0:1782759803.275524:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111296 00000100:00100000:0.0:1782759803.275747:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:0.0:1782759803.275758:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233111296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759803.275789:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759803.275833:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233111296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759803.275840:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00080000:0.0:1782759803.275860:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759803.275894:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233111296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759803.276271:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233111424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759803.276307:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759803.276489:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111424 00000100:00100000:0.0:1782759803.276494:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111424 00000100:00100000:0.0:1782759803.276544:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510 00000100:00100000:0.0:1782759803.276551:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233111424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759803.276601:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446117376 avail 1299877888 00000100:00100000:0.0:1782759803.276640:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233111424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759803.276648:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510 00000100:00100000:2.0:1782759803.276797:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233111552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759803.276825:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759803.276857:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111552 00000100:00100000:2.0:1782759803.276860:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111552 00000100:00100000:2.0:1782759803.276900:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:2.0:1782759803.276906:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233111552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759803.276918:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759803.276945:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233111552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759803.276951:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000100:00100000:2.0:1782759803.276982:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233111552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759803.277210:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233111424:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1782759803.277260:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759803.614224:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759803.614274:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759803.614305:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759803.614338:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759803.614371:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218611328 00000100:00100000:3.0:1782759803.614381:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218611328 00000100:00100000:3.0:1782759803.614448:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3235 00000100:00100000:3.0:1782759803.614459:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218611328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759803.614531:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218611328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759803.614539:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3235 00000100:00100000:3.0:1782759803.614562:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218611072 00000100:00100000:3.0:1782759803.614565:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218611072 00000100:00100000:3.0:1782759803.614623:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218611200 00000100:00100000:3.0:1782759803.614626:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218611200 00000100:00100000:3.0:1782759803.614661:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5499 00000100:00100000:3.0:1782759803.614683:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218611072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759803.614715:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2404:x1869355218611072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759803.614723:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5499 00000100:00100000:3.0:1782759803.614735:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5500 00000100:00100000:3.0:1782759803.614742:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218611200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759803.614766:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218611200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759803.614998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218610944 00000100:00100000:2.0:1782759803.615003:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218610944 00000100:00100000:2.0:1782759803.615038:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3440 00000100:00100000:2.0:1782759803.615047:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218610944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759803.615082:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218610944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759803.615089:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3440 00000100:00080000:2.0:1782759803.615657:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759803.615663:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759803.615665:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759803.615765:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5500 00000100:00100000:3.0:1782759803.617684:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759803.625973:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218611456 00000100:00100000:1.0:1782759803.625987:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218611456 00000100:00100000:1.0:1782759803.626271:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3236 00000100:00100000:1.0:1782759803.626283:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218611456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759803.626368:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218611456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 89us (8691us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759803.626376:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3236 00000100:00080000:2.0:1782759803.627572:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759803.850961:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759804.235109:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759804.235117:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759804.235122:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759804.235169:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759804.235202:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759804.235214:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759804.235240:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233111680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759804.235336:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759804.235395:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111680 00000100:00100000:1.0:1782759804.235400:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759804.235402:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111680 00000100:00100000:2.0:1782759804.235472:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3441 00000100:00100000:2.0:1782759804.235484:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233111680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759804.235498:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759804.235513:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ddeb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759804.235536:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759804.235547:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759804.235564:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649a00, rc 0) 00000100:00100000:2.0:1782759804.235630:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233111680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759804.235637:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3441 00000100:00100000:1.0:1782759804.236043:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233111680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759804.236058:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759804.236068:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759804.236086:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759804.236090:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759804.236106:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759804.884282:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759805.837203:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759805.837228:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233111808:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759805.837306:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759805.837426:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233111808 00000100:00100000:2.0:1782759805.837435:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233111808 00000100:00100000:2.0:1782759805.837511:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511 00000100:00100000:2.0:1782759805.837522:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233111808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759805.837568:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759805.837647:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233111808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759805.837654:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511 00000100:00100000:2.0:1782759805.837697:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233111808:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759805.901454:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759806.139497:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759806.139536:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218611584 00000100:00100000:2.0:1782759806.139545:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218611584 00000100:00100000:2.0:1782759806.139653:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3079 00000100:00100000:2.0:1782759806.139672:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115094:x1869355218611584:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759806.139692:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759806.139716:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ddf9 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27758 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139779:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139793:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139805:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139817:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139824:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139846:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139883:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139888:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139892:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139896:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139899:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759806.139902:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139906:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139915:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500f00) 00010000:00010000:2.0:1782759806.139917:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759806.139919:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139923:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de00 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139931:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139938:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139942:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139945:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759806.139946:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139950:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139954:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc3500a00) 00010000:00010000:2.0:1782759806.139955:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759806.139957:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139960:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60de07 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139986:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ddf9 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27758 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.139995:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500f00) 00010000:00010000:2.0:1782759806.139997:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759806.140000:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ddf9 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27758 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.140022:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759806.140199:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115094:x1869355218611584:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 536us (707us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759806.140206:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3079 00000100:00080000:2.0:1782759806.140230:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759806.145490:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.149427:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218611840 00000100:00100000:1.0:1782759806.149445:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218611840 00000100:00100000:1.0:1782759806.149506:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3080 00000100:00100000:1.0:1782759806.149514:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115094:x1869355218611840:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759806.149535:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759806.149559:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60de0e lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2775f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.149679:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.149694:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.149706:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.149719:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.149726:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.149732:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151357:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151372:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151379:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759806.151402:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x2d:0x0]: returning size 0 00010000:00010000:1.0:1782759806.151431:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151436:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151439:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151443:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151447:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759806.151450:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151455:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151463:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f6600) 00010000:00010000:1.0:1782759806.151465:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759806.151468:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151471:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de15 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759806.151482:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad5f3053 reply state 0000000018a66c03 transno 4294967746 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151496:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151500:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759806.151502:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759806.151504:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759806.151536:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60de0e lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151550:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.151557:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc34f6e00) 00010000:00010000:1.0:1782759806.151559:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759806.151561:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412600, rc 0) 00000100:00100000:1.0:1782759806.151643:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115094:x1869355218611840:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2129us (6162us total) trans 4294967746 rc 0/0 00000100:00100000:1.0:1782759806.151650:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3080 00000100:00100000:0.0:1782759806.156405:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.156851:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218612096 00000100:00100000:3.0:1782759806.156859:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218612096 00000100:00100000:3.0:1782759806.156906:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3081 00000100:00100000:3.0:1782759806.156913:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115094:x1869355218612096:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759806.156934:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759806.156952:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60de31 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27766 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.157050:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.157065:0:8593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.157074:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.157136:0:8593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.157151:0:8593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 9 pid: 6532 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.157162:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355233111936:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759806.157319:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44be480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759806.175006:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.175038:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218612224 00000100:00100000:3.0:1782759806.175047:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218612224 00010000:00010000:3.0:1782759806.175097:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 5/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 10 pid: 6532 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.175138:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 872 00000100:00100000:3.0:1782759806.175148:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218612224:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759806.175165:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759806.175171:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 5/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 10 pid: 6532 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.175232:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 10 pid: 6532 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.175257:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc34f6e00) 00010000:00010000:3.0:1782759806.175261:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.175285:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.175293:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.175314:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759806.176464:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218612224:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 1311us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.176473:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 872 00010000:00010000:3.0:1782759806.176616:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412600/0xd5b45c7f5c60de23 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2775f expref: 9 pid: 6532 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.176633:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355233111936:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759806.176714:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.176725:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.176731:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759806.176754:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x2d:0x0]: returning size 0 00010000:00010000:3.0:1782759806.176979:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.176988:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177009:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177015:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759806.177020:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177029:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177042:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc34f6e00) 00010000:00010000:3.0:1782759806.177046:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759806.177050:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177055:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60de38 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177123:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60de31 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27766 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177133:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4100) 00010000:00010000:3.0:1782759806.177135:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759806.177139:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60de31 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27766 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759806.177151:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6000, rc 0) 00000100:00100000:3.0:1782759806.177195:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115094:x1869355218612096:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 20282us (20797us total) trans 4294967747 rc 301/301 00000100:00100000:3.0:1782759806.177212:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3081 00000100:00100000:3.0:1782759806.181292:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.182850:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218612480 00000100:00100000:0.0:1782759806.182865:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218612480 00000100:00100000:0.0:1782759806.182930:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 428 00000100:00100000:0.0:1782759806.182942:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115094:x1869355218612480:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759806.183196:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115094:x1869355218612480:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 256us (1913us total) trans 4294967748 rc 0/0 00000100:00100000:0.0:1782759806.183205:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 428 00000100:00100000:0.0:1782759806.191524:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.197199:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218612736 00000100:00100000:1.0:1782759806.197213:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218612736 00000100:00100000:1.0:1782759806.197298:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 429 00000100:00100000:1.0:1782759806.197309:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec9331450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115094:x1869355218612736:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759806.197956:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec9331450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:115094:x1869355218612736:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 645us (6438us total) trans 4294967749 rc 0/0 00000100:00100000:1.0:1782759806.197964:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 429 00000100:00100000:3.0:1782759806.224688:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759806.224820:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218612992 00000100:00100000:2.0:1782759806.224830:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218612992 00000100:00100000:2.0:1782759806.224891:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3082 00000100:00100000:2.0:1782759806.224902:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:115095:x1869355218612992:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:2.0:1782759806.224928:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759806.224955:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de46 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2776d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225115:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225129:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225140:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225150:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225168:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225193:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225265:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225274:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225281:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759806.225376:0:6533:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1782759806.225380:0:6533:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 0 -> 1782759807 00000004:00010000:2.0:1782759806.225382:0:6533:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 0 -> 1782759807 00000004:00010000:2.0:1782759806.225385:0:6533:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 0 -> 1782759807 00000004:00010000:2.0:1782759806.225387:0:6533:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1782759806.225391:0:6533:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1782759806.225398:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225406:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225412:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225418:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225424:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759806.225433:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225440:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225453:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc3500f00) 00010000:00010000:2.0:1782759806.225457:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759806.225461:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225468:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648a00/0xd5b45c7f5c60de4d lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225481:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225486:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225491:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225497:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759806.225500:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225505:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225512:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759806.225514:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759806.225521:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225527:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648400/0xd5b45c7f5c60de54 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225567:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649400/0xd5b45c7f5c60de46 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225618:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.225627:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:2.0:1782759806.225629:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1782759806.225631:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759806.225705:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:115095:x1869355218612992:12345-192.168.202.31@tcp:101:dd.0 Request processed in 804us (1026us total) trans 4294967750 rc 0/0 00000100:00100000:2.0:1782759806.225713:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3082 00000100:00100000:3.0:1782759806.228770:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.228870:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218613120 00000100:00100000:1.0:1782759806.228892:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218613120 00000100:00100000:1.0:1782759806.228948:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3083 00000100:00100000:1.0:1782759806.228958:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:115095:x1869355218613120:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:1.0:1782759806.228995:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759806.229022:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60de69 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27774 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.229056:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de70 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.229070:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de70 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.229089:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de70 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.229203:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413a00/0xd5b45c7f5c60de69 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27774 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.229221:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de70 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27774 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.229230:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:1.0:1782759806.229233:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782759806.229236:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759806.229302:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:115095:x1869355218613120:12345-192.168.202.31@tcp:101:dd.0 Request processed in 345us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.229309:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3083 00000100:00100000:3.0:1782759806.233384:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.233475:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218613376 00000100:00100000:1.0:1782759806.233496:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218613376 00000100:00100000:1.0:1782759806.233571:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3084 00000100:00100000:1.0:1782759806.233605:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:115095:x1869355218613376:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:1.0:1782759806.233725:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.233742:0:12673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.233751:0:12673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.233785:0:12673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.233799:0:12673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 13 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759806.233812:0:12673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12673:1869355233112064:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759806.234657:0:12673:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759806.237786:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.237969:0:12673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12673:1869355233112064:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759806.238005:0:12673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759806.238342:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218613504 00000100:00100000:2.0:1782759806.238350:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218613504 00010000:00010000:2.0:1782759806.238399:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 14 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759806.238467:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 873 00000100:00100000:2.0:1782759806.238477:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2402:x1869355218613504:12345-192.168.202.31@tcp:102:ldlm_bl.0 00010000:00010000:2.0:1782759806.238496:0:7472:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 14 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.238506:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 14 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.238531:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 14 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.238539:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:2.0:1782759806.238543:0:7472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1782759806.238546:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.238556:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.238562:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759806.238711:0:7472:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 14 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759806.238772:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2402:x1869355218613504:12345-192.168.202.31@tcp:102:ldlm_bl.0 Request processed in 297us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759806.238780:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 873 00010000:00010000:1.0:1782759806.239975:0:12673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.239997:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759806.240179:0:12673:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1782759806.240183:0:12673:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.240185:0:12673:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.240417:0:12673:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.240420:0:12673:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1782759806.240428:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c747eeab reply state 000000005a8ebeb2 transno 4294967751 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.240446:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.240454:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:1.0:1782759806.240456:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759806.240458:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759806.240632:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:115095:x1869355218613376:12345-192.168.202.31@tcp:36:dd.0 Request processed in 7026us (7254us total) trans 4294967751 rc 0/0 00000100:00100000:1.0:1782759806.240642:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3084 00000100:00100000:3.0:1782759806.243048:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.243143:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218613632 00000100:00100000:0.0:1782759806.243154:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218613632 00002000:00010000:0.0:1782759806.243208:0:6546:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000405:0x2d:0x0] 00002000:00100000:0.0:1782759806.243213:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddcc52e680 with x1869355218613632 00000100:00100000:0.0:1782759806.243253:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 10 00000100:00100000:0.0:1782759806.243264:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2403:x1869355218613632:12345-192.168.202.31@tcp:10:dd.0 00000004:00010000:0.0:1782759806.243467:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1782759806.243472:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.243474:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.243476:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.243478:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782759806.243556:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:2403:x1869355218613632:12345-192.168.202.31@tcp:10:dd.0 Request processed in 292us (516us total) trans 4294967752 rc 0/0 00000100:00100000:0.0:1782759806.243563:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 10 00002000:00010000:0.0:1782759806.243567:0:6546:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000405:0x2d:0x0] 00002000:00100000:0.0:1782759806.243569:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddcc52e680 with x1869355218613632 00000100:00100000:3.0:1782759806.271689:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759806.271901:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218613760 00000100:00100000:2.0:1782759806.271914:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218613760 00002000:00100000:2.0:1782759806.271988:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddcc52ca80 x1869355218613760/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.272000:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddcc52ca80 with x1869355218613760 00000100:00100000:2.0:1782759806.272043:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 11 00000100:00100000:2.0:1782759806.272054:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:2402:x1869355218613760:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:0.0:1782759806.286760:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759806.286781:0:6544:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000 ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759806.286808:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233112192:0@lo:101:mdt_io00_000.0 00000100:00100000:0.0:1782759806.286870:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759806.286911:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782759806.287337:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112192 00000100:00100000:1.0:1782759806.287344:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112192 00000100:00100000:1.0:1782759806.287391:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1782759806.287400:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+7:6544:x1869355233112192:12345-0@lo:101:mdt_io00_000.0 00010000:00010000:1.0:1782759806.287415:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759806.287428:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60de7e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.287722:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.287753:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.287772:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413e00, rc 0) 00000100:00100000:1.0:1782759806.287822:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233112192:12345-0@lo:101:mdt_io00_000.0 Request processed in 424us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.287829:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1782759806.287885:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233112320:0@lo:106: 00000100:00100000:1.0:1782759806.287913:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.287940:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803600 going to sleep for 11 seconds 00000100:00100000:1.0:1782759806.287955:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112320 00000100:00100000:1.0:1782759806.287959:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112320 00000100:00100000:1.0:1782759806.288127:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1782759806.288136:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233112320:12345-0@lo:106: 00010000:00010000:1.0:1782759806.288146:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 4/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.288154:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 4/1,0 mode: --/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759806.288280:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233112320:12345-0@lo:106: Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.288288:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:1.0:1782759806.288333:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd5c00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233112320:0@lo:106: 00000100:00100000:0.0:1782759806.289934:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233112192:0@lo:101:mdt_io00_000.0 00010000:00010000:0.0:1782759806.289959:0:6544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759806.289975:0:6544:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 4/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759806.290142:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759806.290153:0:6544:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000004:00010000:0.0:1782759806.292345:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 0 -> 1048576 00000004:00010000:0.0:1782759806.292354:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.292357:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.292359:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.292362:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:0.0:1782759806.292448:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2402:x1869355218613760:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20391us (20766us total) trans 4294967753 rc 0/0 00000100:00100000:0.0:1782759806.292459:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 11 00002000:00100000:0.0:1782759806.292472:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddcc52ca80 x1869355218613760/t4294967753(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.292481:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddcc52ca80 with x1869355218613760 00000100:00100000:2.0:1782759806.295941:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.296188:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218613888 00000100:00100000:3.0:1782759806.296198:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218613888 00000100:00100000:3.0:1782759806.296262:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3085 00000100:00100000:3.0:1782759806.296271:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:115095:x1869355218613888:12345-192.168.202.31@tcp:44:dd.0 00000001:00080000:2.0:1782759806.298487:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967753 is committed 00010000:00010000:1.0:1782759806.298608:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298637:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298645:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298651:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759806.298656:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298664:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298681:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759806.298685:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759806.298689:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298696:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60de1c lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298722:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298728:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298735:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298739:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759806.298750:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298756:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298765:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:1.0:1782759806.298767:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759806.298770:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759806.298776:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60de77 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.298971:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:115095:x1869355218613888:12345-192.168.202.31@tcp:44:dd.0 Request processed in 2696us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.298992:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3085 00000100:00100000:1.0:1782759806.302930:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.303036:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614016 00000100:00100000:0.0:1782759806.303047:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614016 00000100:00100000:0.0:1782759806.303320:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3086 00000100:00100000:0.0:1782759806.303331:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218614016:12345-192.168.202.31@tcp:16:dd.0 00000100:00100000:0.0:1782759806.303462:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218614016:12345-192.168.202.31@tcp:16:dd.0 Request processed in 132us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.303470:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3086 00000100:00100000:0.0:1782759806.326093:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.326181:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614144 00000100:00100000:3.0:1782759806.326201:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614144 00002000:00100000:3.0:1782759806.326251:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cded3b87480 x1869355218614144/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:3.0:1782759806.326263:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cded3b87480 with x1869355218614144 00000100:00100000:3.0:1782759806.326297:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 12 00000100:00100000:3.0:1782759806.326308:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218614144:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:3.0:1782759806.338721:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1782759806.338795:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233112448:0@lo:601:mdt_io00_001.0 00000100:00100000:3.0:1782759806.338858:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759806.339027:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759806.341764:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112448 00000100:00100000:0.0:1782759806.341779:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112448 00000100:00100000:0.0:1782759806.341838:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1782759806.341849:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233112448:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:0.0:1782759806.341884:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759806.342292:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233112448:12345-0@lo:601:mdt_io00_001.0 Request processed in 442us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.342301:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1782759806.342455:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233112448:0@lo:601:mdt_io00_001.0 00010000:00010000:2.0:1782759806.342491:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1782759806.342504:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000004:00010000:2.0:1782759806.350834:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 1048576 -> 2097152 00000004:00010000:2.0:1782759806.350842:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.350844:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.350846:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.350848:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 2048 -> 4096 00000100:00100000:2.0:1782759806.350932:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218614144:12345-192.168.202.31@tcp:4:dd.0 Request processed in 24620us (24852us total) trans 4294967754 rc 0/0 00000100:00100000:2.0:1782759806.350942:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 12 00002000:00100000:2.0:1782759806.350953:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cded3b87480 x1869355218614144/t4294967754(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.350960:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cded3b87480 with x1869355218614144 00000100:00100000:1.0:1782759806.356714:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.356785:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614272 00000100:00100000:3.0:1782759806.356793:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614272 00000100:00100000:3.0:1782759806.356840:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3087 00000100:00100000:3.0:1782759806.356849:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218614272:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759806.360536:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967754 is committed 00000100:00100000:3.0:1782759806.360770:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218614272:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3916us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.360780:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3087 00000100:00100000:0.0:1782759806.382033:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759806.382206:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614400 00000100:00100000:2.0:1782759806.382217:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614400 00002000:00100000:2.0:1782759806.382276:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cded3b86680 x1869355218614400/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.382288:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cded3b86680 with x1869355218614400 00000100:00100000:2.0:1782759806.382342:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 13 00000100:00100000:2.0:1782759806.382354:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218614400:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:0.0:1782759806.396802:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00000100:00100000:0.0:1782759806.396861:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233112576:0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759806.396920:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759806.396967:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759806.397056:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112576 00000100:00100000:3.0:1782759806.397064:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112576 00000100:00100000:3.0:1782759806.397145:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1782759806.397155:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233112576:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:3.0:1782759806.397186:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.397399:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233112576:12345-0@lo:601:mdt_io00_000.0 Request processed in 245us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.397407:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1782759806.398047:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b85f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233112576:0@lo:601:mdt_io00_000.0 00010000:00010000:0.0:1782759806.398093:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 2 lru_type: 1 00010000:00010000:0.0:1782759806.398106:0:6544:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000004:00010000:0.0:1782759806.401157:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 2097152 -> 3145728 00000004:00010000:0.0:1782759806.401168:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.401171:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.401173:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.401176:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 4096 -> 6144 00000100:00100000:0.0:1782759806.403222:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218614400:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20860us (21191us total) trans 4294967755 rc 0/0 00000100:00100000:0.0:1782759806.403238:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 13 00002000:00100000:0.0:1782759806.403257:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cded3b86680 x1869355218614400/t4294967755(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.403268:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cded3b86680 with x1869355218614400 00000100:00100000:2.0:1782759806.406750:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.406858:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614528 00000100:00100000:0.0:1782759806.406868:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614528 00000100:00100000:0.0:1782759806.407112:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3088 00000100:00100000:0.0:1782759806.407126:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218614528:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759806.409982:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967755 is committed 00000100:00100000:0.0:1782759806.410510:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218614528:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3382us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.410524:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3088 00000100:00100000:1.0:1782759806.437164:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759806.437449:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614656 00000100:00100000:2.0:1782759806.437460:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614656 00002000:00100000:2.0:1782759806.437523:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc3ca8a80 x1869355218614656/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.437534:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc3ca8a80 with x1869355218614656 00000100:00100000:2.0:1782759806.437572:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 14 00000100:00100000:2.0:1782759806.437618:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218614656:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:2.0:1782759806.461271:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00000100:00100000:2.0:1782759806.461329:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233112704:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759806.461395:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759806.461464:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759806.461570:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112704 00000100:00100000:0.0:1782759806.461594:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112704 00000100:00100000:0.0:1782759806.461649:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1782759806.461658:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233112704:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:0.0:1782759806.461687:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759806.461895:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233112704:12345-0@lo:601:mdt_io00_001.0 Request processed in 237us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.461906:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1782759806.461957:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233112704:0@lo:601:mdt_io00_001.0 00010000:00010000:0.0:1782759806.461981:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 3 lru_type: 1 00010000:00010000:0.0:1782759806.461992:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000004:00010000:0.0:1782759806.465451:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 3145728 -> 4194304 00000004:00010000:0.0:1782759806.465462:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.465465:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.465467:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.465470:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 6144 -> 8192 00000100:00100000:0.0:1782759806.465602:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218614656:12345-192.168.202.31@tcp:4:dd.0 Request processed in 27963us (28423us total) trans 4294967756 rc 0/0 00000100:00100000:0.0:1782759806.465614:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 14 00002000:00100000:0.0:1782759806.465627:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc3ca8a80 x1869355218614656/t4294967756(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.465637:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc3ca8a80 with x1869355218614656 00000100:00100000:2.0:1782759806.475912:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.476014:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614784 00000100:00100000:0.0:1782759806.476024:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614784 00000100:00100000:0.0:1782759806.476093:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3089 00000100:00100000:0.0:1782759806.476104:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218614784:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759806.479156:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967756 is committed 00000100:00100000:0.0:1782759806.479422:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218614784:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3314us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.479438:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3089 00000100:00100000:2.0:1782759806.506273:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.506695:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218614912 00000100:00100000:0.0:1782759806.506706:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218614912 00002000:00100000:0.0:1782759806.506768:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87c380 x1869355218614912/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.506779:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87c380 with x1869355218614912 00000100:00100000:0.0:1782759806.506818:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 15 00000100:00100000:0.0:1782759806.506827:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218614912:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:1.0:1782759806.519429:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00000100:00100000:1.0:1782759806.519483:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233112832:0@lo:601:mdt_io00_000.0 00000100:00100000:1.0:1782759806.519685:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.519788:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759806.521177:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112832 00000100:00100000:0.0:1782759806.521188:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112832 00000100:00100000:0.0:1782759806.521288:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1782759806.521298:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233112832:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:0.0:1782759806.521331:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759806.521689:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233112832:12345-0@lo:601:mdt_io00_000.0 Request processed in 392us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.521698:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1782759806.521780:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233112832:0@lo:601:mdt_io00_000.0 00010000:00010000:2.0:1782759806.521818:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 4 lru_type: 1 00010000:00010000:2.0:1782759806.521830:0:6544:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000004:00010000:2.0:1782759806.523568:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 4194304 -> 5242880 00000004:00010000:2.0:1782759806.523596:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.523599:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.523602:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.523604:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 8192 -> 10240 00000100:00100000:2.0:1782759806.523690:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218614912:12345-192.168.202.31@tcp:4:dd.0 Request processed in 16858us (17422us total) trans 4294967757 rc 0/0 00000100:00100000:2.0:1782759806.523702:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 15 00002000:00100000:2.0:1782759806.523715:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87c380 x1869355218614912/t4294967757(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.523725:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87c380 with x1869355218614912 00000100:00100000:2.0:1782759806.526391:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.526531:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615040 00000100:00100000:1.0:1782759806.526552:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615040 00000100:00100000:1.0:1782759806.526646:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3090 00000100:00100000:1.0:1782759806.526657:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218615040:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759806.530657:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967757 is committed 00000100:00100000:1.0:1782759806.530857:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218615040:12345-192.168.202.31@tcp:16:dd.0 Request processed in 4197us (4468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.530885:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3090 00000100:00100000:3.0:1782759806.564787:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.564898:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615168 00000100:00100000:0.0:1782759806.564909:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615168 00002000:00100000:0.0:1782759806.564960:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4826680 x1869355218615168/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.564970:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4826680 with x1869355218615168 00000100:00100000:0.0:1782759806.565004:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 16 00000100:00100000:0.0:1782759806.565014:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218615168:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:1.0:1782759806.584845:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00000100:00100000:1.0:1782759806.584907:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233112960:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759806.584981:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.585053:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803600 going to sleep for 11 seconds 00000100:00100000:2.0:1782759806.587448:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233112960 00000100:00100000:2.0:1782759806.587464:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233112960 00000100:00100000:2.0:1782759806.587532:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1782759806.587553:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3beec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233112960:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:2.0:1782759806.587612:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759806.587844:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3beec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233112960:12345-0@lo:601:mdt_io00_001.0 Request processed in 294us (2862us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759806.587852:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1782759806.587908:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233112960:0@lo:601:mdt_io00_001.0 00010000:00010000:1.0:1782759806.587999:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 5 lru_type: 1 00010000:00010000:1.0:1782759806.588025:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000004:00010000:1.0:1782759806.594441:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 5242880 -> 6291456 00000004:00010000:1.0:1782759806.594451:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.594453:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.594456:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.594459:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 10240 -> 12288 00000100:00100000:1.0:1782759806.594545:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218615168:12345-192.168.202.31@tcp:4:dd.0 Request processed in 29526us (29761us total) trans 4294967758 rc 0/0 00000100:00100000:1.0:1782759806.594556:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 16 00002000:00100000:1.0:1782759806.594568:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4826680 x1869355218615168/t4294967758(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759806.594595:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4826680 with x1869355218615168 00000100:00100000:2.0:1782759806.607251:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.607341:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615296 00000100:00100000:3.0:1782759806.607352:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615296 00000100:00100000:3.0:1782759806.607420:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3091 00000100:00100000:3.0:1782759806.607430:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218615296:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759806.612594:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967758 is committed 00000100:00100000:2.0:1782759806.613279:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218615296:12345-192.168.202.31@tcp:16:dd.0 Request processed in 5845us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759806.613304:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3091 00000100:00100000:2.0:1782759806.653918:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.654031:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615424 00000100:00100000:1.0:1782759806.654042:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615424 00002000:00100000:1.0:1782759806.654117:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87ce00 x1869355218615424/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759806.654128:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87ce00 with x1869355218615424 00000100:00100000:1.0:1782759806.654165:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 17 00000100:00100000:1.0:1782759806.654174:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218615424:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:1.0:1782759806.670711:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00000100:00100000:1.0:1782759806.670768:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233113088:0@lo:601:mdt_io00_000.0 00000100:00100000:1.0:1782759806.670831:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.670889:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e52540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759806.671158:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113088 00000100:00100000:3.0:1782759806.671165:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113088 00000100:00100000:3.0:1782759806.671274:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1782759806.671284:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233113088:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:3.0:1782759806.671313:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.671634:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233113088:12345-0@lo:601:mdt_io00_000.0 Request processed in 351us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.671642:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1782759806.675279:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233113088:0@lo:601:mdt_io00_000.0 00010000:00010000:2.0:1782759806.675328:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 6 lru_type: 1 00010000:00010000:2.0:1782759806.675340:0:6544:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000004:00010000:2.0:1782759806.677512:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 6291456 -> 7340032 00000004:00010000:2.0:1782759806.677519:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.677522:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.677525:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.677527:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 12288 -> 14336 00000100:00100000:2.0:1782759806.677841:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218615424:12345-192.168.202.31@tcp:4:dd.0 Request processed in 23663us (23927us total) trans 4294967759 rc 0/0 00000100:00100000:2.0:1782759806.677852:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 17 00002000:00100000:2.0:1782759806.677864:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87ce00 x1869355218615424/t4294967759(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.677875:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87ce00 with x1869355218615424 00000100:00100000:0.0:1782759806.680364:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.680438:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615552 00000100:00100000:3.0:1782759806.680447:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615552 00000100:00100000:3.0:1782759806.680497:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3092 00000100:00100000:3.0:1782759806.680506:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218615552:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759806.683939:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967759 is committed 00000100:00100000:3.0:1782759806.684159:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218615552:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3647us (3797us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.684171:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3092 00000100:00100000:3.0:1782759806.706988:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.707851:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615680 00000100:00100000:1.0:1782759806.708719:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615680 00002000:00100000:1.0:1782759806.708778:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4825f80 x1869355218615680/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759806.708790:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4825f80 with x1869355218615680 00000100:00100000:1.0:1782759806.708871:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 18 00000100:00100000:1.0:1782759806.708882:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218615680:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:1.0:1782759806.725412:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00000100:00100000:1.0:1782759806.725472:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233113216:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759806.725680:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.725803:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e52540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759806.726561:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113216 00000100:00100000:2.0:1782759806.726571:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113216 00000100:00100000:2.0:1782759806.726666:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1782759806.726677:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233113216:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:2.0:1782759806.726718:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759806.726951:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233113216:12345-0@lo:601:mdt_io00_001.0 Request processed in 276us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759806.726960:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1782759806.727165:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233113216:0@lo:601:mdt_io00_001.0 00010000:00010000:0.0:1782759806.727203:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 7 lru_type: 1 00010000:00010000:0.0:1782759806.727215:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000004:00010000:0.0:1782759806.729389:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 7340032 -> 8388608 00000004:00010000:0.0:1782759806.729400:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.729403:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.729405:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.729407:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 14336 -> 16384 00000100:00100000:0.0:1782759806.729497:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218615680:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20612us (22514us total) trans 4294967760 rc 0/0 00000100:00100000:0.0:1782759806.729507:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 18 00002000:00100000:0.0:1782759806.729520:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4825f80 x1869355218615680/t4294967760(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.729530:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4825f80 with x1869355218615680 00000100:00100000:2.0:1782759806.735839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.735948:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615808 00000100:00100000:3.0:1782759806.735959:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615808 00000100:00100000:3.0:1782759806.736172:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3093 00000100:00100000:3.0:1782759806.736192:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218615808:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759806.739040:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967760 is committed 00000100:00100000:3.0:1782759806.739249:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218615808:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3060us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.739261:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3093 00000100:00100000:1.0:1782759806.779980:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759806.780288:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218615936 00000100:00100000:2.0:1782759806.780299:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218615936 00002000:00100000:2.0:1782759806.780367:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc3cab480 x1869355218615936/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.780379:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc3cab480 with x1869355218615936 00000100:00100000:2.0:1782759806.780417:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 19 00000100:00100000:2.0:1782759806.780429:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218615936:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:0.0:1782759806.813617:0:6544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:0.0:1782759806.813676:0:6544:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233113344:0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759806.813735:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759806.813792:0:6544:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b58480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759806.814210:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113344 00000100:00100000:3.0:1782759806.814230:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113344 00000100:00100000:3.0:1782759806.814290:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1782759806.814299:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233113344:12345-0@lo:601:mdt_io00_000.0 00040000:00010000:3.0:1782759806.814332:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759806.814564:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6544:x1869355233113344:12345-0@lo:601:mdt_io00_000.0 Request processed in 266us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.814572:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1782759806.814651:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a7100 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233113472:0@lo:106: 00000100:00100000:3.0:1782759806.814679:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759806.814705:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44bed80 going to sleep for 11 seconds 00000100:00100000:3.0:1782759806.814719:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113472 00000100:00100000:3.0:1782759806.814723:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113472 00000100:00100000:3.0:1782759806.814754:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1782759806.814760:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233113472:12345-0@lo:106: 00010000:00010000:3.0:1782759806.814771:0:18645:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:3.0:1782759806.814780:0:18645:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00000100:00100000:3.0:1782759806.814833:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233113472:12345-0@lo:106: Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.814840:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:3.0:1782759806.814883:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a7100 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233113472:0@lo:106: 00000100:00100000:0.0:1782759806.815055:0:6544:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b84380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0000-lwp-MDT0001_UUID:6544:1869355233113344:0@lo:601:mdt_io00_000.0 00010000:00010000:0.0:1782759806.815086:0:6544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 8 lru_type: 1 00010000:00010000:0.0:1782759806.815098:0:6544:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000004:00010000:0.0:1782759806.818071:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 8388608 -> 9437184 00000004:00010000:0.0:1782759806.818090:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.818093:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.818095:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759806.818097:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 16384 -> 18440 00000100:00100000:0.0:1782759806.818368:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218615936:12345-192.168.202.31@tcp:4:dd.0 Request processed in 37938us (38393us total) trans 4294967761 rc 0/0 00000100:00100000:0.0:1782759806.818379:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 19 00002000:00100000:0.0:1782759806.818391:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc3cab480 x1869355218615936/t4294967761(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.818401:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc3cab480 with x1869355218615936 00000100:00100000:1.0:1782759806.821439:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.821533:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616064 00000100:00100000:0.0:1782759806.821543:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616064 00000100:00100000:0.0:1782759806.824608:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3094 00000100:00100000:0.0:1782759806.824634:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218616064:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759806.826496:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967761 is committed 00000100:00100000:0.0:1782759806.826749:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218616064:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2121us (5313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.826760:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3094 00000100:00100000:2.0:1782759806.845848:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.845949:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616192 00000100:00100000:0.0:1782759806.845960:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616192 00002000:00100000:0.0:1782759806.846084:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87d180 x1869355218616192/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.846095:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87d180 with x1869355218616192 00000100:00100000:0.0:1782759806.846172:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 20 00000100:00100000:0.0:1782759806.846181:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218616192:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1782759806.860505:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759806.860537:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233113600:0@lo:601:mdt_io00_001.0 00000100:00100000:0.0:1782759806.860625:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.860937:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113600 00000100:00100000:1.0:1782759806.860947:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113600 00000100:00100000:1.0:1782759806.860998:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1782759806.861007:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233113600:12345-0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759806.861277:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233113600:12345-0@lo:601:mdt_io00_001.0 Request processed in 270us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.861285:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1782759806.861403:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233113728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861431:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.861452:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233114240:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861473:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.861486:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233114752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861502:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.861517:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759806.861521:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233113856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861537:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.861549:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233114368:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861567:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.861604:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233114880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861622:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.861644:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113728 00000100:00100000:1.0:1782759806.861647:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113728 00000100:00100000:1.0:1782759806.861672:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3442 00000100:00100000:1.0:1782759806.861693:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233113728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861724:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233113728:12345-0@lo:400:kworker.0 Request processed in 32us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.861729:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3442 00000100:00100000:1.0:1782759806.861752:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114240 00000100:00100000:1.0:1782759806.861755:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114240 00000100:00100000:1.0:1782759806.861781:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114752 00000100:00100000:1.0:1782759806.861783:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114752 00000100:00100000:1.0:1782759806.861793:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113856 00000100:00100000:1.0:1782759806.861794:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113856 00000100:00100000:1.0:1782759806.861803:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114368 00000100:00100000:1.0:1782759806.861804:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114368 00000100:00100000:1.0:1782759806.861813:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114880 00000100:00100000:1.0:1782759806.861815:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114880 00000100:00100000:1.0:1782759806.861825:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5501 00000100:00100000:1.0:1782759806.861830:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233114240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861870:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233114240:12345-0@lo:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.861876:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5501 00000100:00100000:1.0:1782759806.861885:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5502 00000100:00100000:1.0:1782759806.861890:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233114752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861909:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233114752:12345-0@lo:400:kworker.0 Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.861914:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5502 00000100:00100000:1.0:1782759806.861922:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5503 00000100:00100000:1.0:1782759806.861927:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233113856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861944:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233113856:12345-0@lo:400:kworker.0 Request processed in 18us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.861954:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5503 00000100:00100000:1.0:1782759806.861963:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5504 00000100:00100000:1.0:1782759806.861968:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233114368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.861992:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233114368:12345-0@lo:400:kworker.0 Request processed in 24us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.861998:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5504 00000100:00100000:1.0:1782759806.862006:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5505 00000100:00100000:1.0:1782759806.862012:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233114880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862034:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233114880:12345-0@lo:400:kworker.0 Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.862039:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5505 00000100:00080000:1.0:1782759806.862063:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759806.862067:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759806.862087:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233113984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862115:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.862130:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233114496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862149:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.862165:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233115008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862183:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.862235:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233113600:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759806.862252:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759806.862257:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233114112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862280:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.862297:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233114624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862324:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.862341:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233115136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862361:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759806.862386:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114496 00000100:00100000:1.0:1782759806.862391:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114496 00000100:00100000:1.0:1782759806.862423:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115008 00000100:00100000:1.0:1782759806.862426:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115008 00000100:00100000:1.0:1782759806.862437:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114624 00000100:00100000:1.0:1782759806.862440:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114624 00000100:00100000:1.0:1782759806.862452:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115136 00000100:00100000:1.0:1782759806.862454:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115136 00000100:00100000:1.0:1782759806.862467:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3237 00000100:00100000:1.0:1782759806.862472:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233114496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862510:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233114496:12345-0@lo:400:kworker.0 Request processed in 37us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.862515:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3237 00000100:00100000:1.0:1782759806.862526:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3238 00000100:00100000:1.0:1782759806.862531:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233115008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862553:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233115008:12345-0@lo:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.862557:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3238 00000100:00100000:1.0:1782759806.862567:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1782759806.862572:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233114624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862622:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233114624:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.862628:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3239 00000100:00100000:1.0:1782759806.862640:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3240 00000100:00100000:1.0:1782759806.862651:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233115136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862678:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233115136:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.862683:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3240 00000100:00080000:1.0:1782759806.862712:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759806.862715:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759806.862733:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233113856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862743:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233114368:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862752:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233114880:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862761:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233113728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862769:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233114240:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862778:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233114752:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862818:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233114624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862827:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233115136:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862835:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233114496:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862842:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233115008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862894:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233113984 00000100:00100000:1.0:1782759806.862897:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233113984 00000100:00100000:1.0:1782759806.862931:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233114112 00000100:00100000:1.0:1782759806.862934:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233114112 00000100:00100000:1.0:1782759806.862945:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512 00000100:00100000:1.0:1782759806.862951:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.862995:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233113984:12345-0@lo:400:kworker.0 Request processed in 44us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.863002:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512 00000100:00100000:1.0:1782759806.863013:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513 00000100:00100000:1.0:1782759806.863020:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233114112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.863047:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233114112:12345-0@lo:400:kworker.0 Request processed in 27us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.863052:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513 00000100:00100000:1.0:1782759806.863092:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233114112:0@lo:400:kworker.0 00000100:00100000:1.0:1782759806.863104:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233113984:0@lo:400:kworker.0 00000004:00010000:1.0:1782759806.866728:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 9437184 -> 10485760 00000004:00010000:1.0:1782759806.866739:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.866743:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.866746:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.866748:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 18440 -> 20488 00000100:00100000:1.0:1782759806.866845:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218616192:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20659us (21000us total) trans 4294967762 rc 0/0 00000100:00100000:1.0:1782759806.866857:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 20 00002000:00100000:1.0:1782759806.866870:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87d180 x1869355218616192/t4294967762(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759806.866880:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87d180 with x1869355218616192 00000100:00100000:2.0:1782759806.869851:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.869926:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616320 00000100:00100000:1.0:1782759806.869937:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616320 00000100:00100000:1.0:1782759806.870101:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3095 00000100:00100000:1.0:1782759806.870139:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218616320:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759806.871720:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967762 is committed 00000100:00100000:1.0:1782759806.871902:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218616320:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1763us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.877680:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3095 00000100:00100000:2.0:1782759806.896943:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759806.897140:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616448 00000100:00100000:0.0:1782759806.897150:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616448 00002000:00100000:0.0:1782759806.897213:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87ca80 x1869355218616448/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759806.897225:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87ca80 with x1869355218616448 00000100:00100000:0.0:1782759806.897258:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 21 00000100:00100000:0.0:1782759806.897267:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218616448:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1782759806.916680:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759806.916701:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233115264:0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759806.916765:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759806.916824:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115264 00000100:00100000:0.0:1782759806.916831:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115264 00000100:00100000:0.0:1782759806.916874:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1782759806.916883:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233115264:12345-0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759806.917087:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233115264:12345-0@lo:601:mdt_io00_000.0 Request processed in 193us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759806.917097:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1782759806.917153:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233115264:0@lo:601:mdt_io00_000.0 00010000:00010000:0.0:1782759806.923382:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1782759806.923478:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 10485760 -> 11534336 00000004:00010000:2.0:1782759806.923484:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.923486:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.923488:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:2.0:1782759806.923490:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 20488 -> 22536 00000100:00100000:2.0:1782759806.923917:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218616448:12345-192.168.202.31@tcp:4:dd.0 Request processed in 26645us (26978us total) trans 4294967763 rc 0/0 00000100:00100000:2.0:1782759806.923928:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 21 00002000:00100000:2.0:1782759806.923956:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdedf87ca80 x1869355218616448/t4294967763(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759806.923964:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdedf87ca80 with x1869355218616448 00000100:00100000:2.0:1782759806.927711:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.927809:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616576 00000100:00100000:1.0:1782759806.927819:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616576 00000100:00100000:1.0:1782759806.927925:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3096 00000100:00100000:1.0:1782759806.927935:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218616576:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759806.929812:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967763 is committed 00000100:00100000:1.0:1782759806.930010:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218616576:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2064us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.930022:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3096 00000100:00100000:3.0:1782759806.949684:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759806.949786:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616704 00000100:00100000:1.0:1782759806.949795:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616704 00002000:00100000:1.0:1782759806.949843:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdec48a7100 x1869355218616704/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/0 e 0 to 0 dl 1782759817 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759806.949854:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdec48a7100 with x1869355218616704 00000100:00100000:1.0:1782759806.949930:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 22 00000100:00100000:1.0:1782759806.949941:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218616704:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1782759806.969303:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233115392:0@lo:601:mdt_io00_001.0 00000100:00100000:0.0:1782759806.969380:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1782759806.969526:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 11534336 -> 12582912 00000004:00010000:1.0:1782759806.969531:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.969534:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.969536:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759806.969539:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 22536 -> 24584 00000100:00100000:1.0:1782759806.969627:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218616704:12345-192.168.202.31@tcp:4:dd.0 Request processed in 19685us (19950us total) trans 4294967764 rc 0/0 00000100:00100000:1.0:1782759806.969653:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 22 00002000:00100000:1.0:1782759806.969665:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdec48a7100 x1869355218616704/t4294967764(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:212/0 lens 488/448 e 0 to 0 dl 1782759817 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759806.969675:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdec48a7100 with x1869355218616704 00000100:00100000:3.0:1782759806.969875:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115392 00000100:00100000:3.0:1782759806.969883:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115392 00000100:00100000:3.0:1782759806.969931:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1782759806.969941:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233115392:12345-0@lo:601:mdt_io00_001.0 00000100:00100000:3.0:1782759806.976920:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233115392:12345-0@lo:601:mdt_io00_001.0 Request processed in 6971us (7529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759806.976936:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:2.0:1782759806.977288:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759806.978456:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616832 00000100:00100000:3.0:1782759806.978469:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616832 00000100:00100000:3.0:1782759806.978540:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3097 00000100:00100000:3.0:1782759806.978550:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218616832:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759806.980627:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967764 is committed 00000100:00100000:1.0:1782759806.980861:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218616832:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2307us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759806.980872:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3097 00000100:00100000:0.0:1782759806.986488:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233115392:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759807.009168:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759807.009265:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218616960 00000100:00100000:2.0:1782759807.009275:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218616960 00002000:00100000:2.0:1782759807.009340:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4ac9f80 x1869355218616960/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:213/0 lens 488/0 e 0 to 0 dl 1782759818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759807.009351:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4ac9f80 with x1869355218616960 00000100:00100000:2.0:1782759807.009386:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 23 00000100:00100000:2.0:1782759807.009397:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218616960:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:0.0:1782759807.020545:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759807.020567:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233115520:0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759807.020654:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759807.020725:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115520 00000100:00100000:0.0:1782759807.020732:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115520 00000100:00100000:0.0:1782759807.020780:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:0.0:1782759807.020789:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233115520:12345-0@lo:601:mdt_io00_000.0 00000100:00100000:0.0:1782759807.020991:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233115520:12345-0@lo:601:mdt_io00_000.0 Request processed in 202us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759807.020999:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:3.0:1782759807.021054:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233115520:0@lo:601:mdt_io00_000.0 00000004:00010000:0.0:1782759807.027716:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 12582912 -> 13631488 00000004:00010000:0.0:1782759807.027726:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759807.027729:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759807.027731:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:0.0:1782759807.027733:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 24584 -> 26632 00000100:00100000:0.0:1782759807.027828:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218616960:12345-192.168.202.31@tcp:4:dd.0 Request processed in 18427us (18663us total) trans 4294967765 rc 0/0 00000100:00100000:0.0:1782759807.027839:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 23 00002000:00100000:0.0:1782759807.027854:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4ac9f80 x1869355218616960/t4294967765(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:213/0 lens 488/448 e 0 to 0 dl 1782759818 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759807.027864:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4ac9f80 with x1869355218616960 00000100:00100000:1.0:1782759807.030695:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759807.030785:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617088 00000100:00100000:2.0:1782759807.030795:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617088 00000100:00100000:2.0:1782759807.030861:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3098 00000100:00100000:2.0:1782759807.030873:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218617088:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759807.033406:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967765 is committed 00000100:00100000:2.0:1782759807.033608:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218617088:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2702us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759807.033622:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3098 00000100:00100000:3.0:1782759807.055172:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759807.055388:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617216 00000100:00100000:1.0:1782759807.055399:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617216 00002000:00100000:1.0:1782759807.055453:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdec48a7b80 x1869355218617216/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:213/0 lens 488/0 e 0 to 0 dl 1782759818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759807.055465:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdec48a7b80 with x1869355218617216 00000100:00100000:1.0:1782759807.055500:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 24 00000100:00100000:1.0:1782759807.055509:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218617216:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:2.0:1782759807.067865:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759807.067888:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233115648:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759807.067942:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759807.068173:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115648 00000100:00100000:1.0:1782759807.068179:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115648 00000100:00100000:1.0:1782759807.068229:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1782759807.068239:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233115648:12345-0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759807.068490:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233115648:12345-0@lo:601:mdt_io00_001.0 Request processed in 253us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759807.068495:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:2.0:1782759807.068978:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233115648:0@lo:601:mdt_io00_001.0 00000004:00010000:1.0:1782759807.070654:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 13631488 -> 14680064 00000004:00010000:1.0:1782759807.070678:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759807.070681:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759807.070684:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759807.070687:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 26632 -> 28680 00000100:00100000:1.0:1782759807.070772:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218617216:12345-192.168.202.31@tcp:4:dd.0 Request processed in 15259us (15615us total) trans 4294967766 rc 0/0 00000100:00100000:1.0:1782759807.070783:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 24 00002000:00100000:1.0:1782759807.070796:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cdec48a7b80 x1869355218617216/t4294967766(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:213/0 lens 488/448 e 0 to 0 dl 1782759818 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759807.070805:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cdec48a7b80 with x1869355218617216 00000100:00100000:3.0:1782759807.074796:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759807.074940:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617344 00000100:00100000:0.0:1782759807.074949:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617344 00000100:00100000:0.0:1782759807.075019:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3099 00000100:00100000:0.0:1782759807.075029:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218617344:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759807.076646:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967766 is committed 00000100:00100000:1.0:1782759807.077306:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218617344:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2271us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759807.077318:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3099 00000100:00100000:0.0:1782759807.097121:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759807.097563:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617472 00000100:00100000:2.0:1782759807.097575:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617472 00002000:00100000:2.0:1782759807.097837:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4ae3100 x1869355218617472/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:213/0 lens 488/0 e 0 to 0 dl 1782759818 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759807.097850:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4ae3100 with x1869355218617472 00000100:00100000:2.0:1782759807.097885:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 25 00000100:00100000:2.0:1782759807.097894:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218617472:12345-192.168.202.31@tcp:4:dd.0 00000100:00100000:1.0:1782759807.115165:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233115776:0@lo:601:mdt_io00_000.0 00000100:00100000:1.0:1782759807.115243:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759807.116399:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233115776 00000100:00100000:2.0:1782759807.116412:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233115776 00000100:00100000:2.0:1782759807.116487:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1782759807.116500:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233115776:12345-0@lo:601:mdt_io00_000.0 00000100:00100000:2.0:1782759807.116770:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233115776:12345-0@lo:601:mdt_io00_000.0 Request processed in 272us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759807.116777:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1782759807.116986:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233115776:0@lo:601:mdt_io00_000.0 00000004:00010000:1.0:1782759807.117841:0:6544:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb size from disk: 14680064 -> 15728640 00000004:00010000:1.0:1782759807.117847:0:6544:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb mtime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759807.117850:0:6544:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb atime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759807.117852:0:6544:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb ctime from disk: 1782759807 -> 1782759807 00000004:00010000:1.0:1782759807.117855:0:6544:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2d:0x0] updating lvb blocks from disk: 28680 -> 30728 00000100:00100000:1.0:1782759807.118379:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218617472:12345-192.168.202.31@tcp:4:dd.0 Request processed in 20482us (21263us total) trans 4294967767 rc 0/0 00000100:00100000:1.0:1782759807.118389:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 25 00002000:00100000:1.0:1782759807.118413:0:6544:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_000: refresh rw locks for [0x240000405:0x2d:0x0] req@ffff8cddc4ae3100 x1869355218617472/t4294967767(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:213/0 lens 488/448 e 0 to 0 dl 1782759818 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759807.118423:0:6544:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4ae3100 with x1869355218617472 00000100:00100000:3.0:1782759807.121507:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759807.121608:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617600 00000100:00100000:1.0:1782759807.121618:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617600 00000100:00100000:1.0:1782759807.121680:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3100 00000100:00100000:1.0:1782759807.121690:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218617600:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759807.124026:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967767 is committed 00000100:00100000:1.0:1782759807.124515:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218617600:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2821us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759807.124528:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3100 00000100:00100000:0.0:1782759807.131527:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759807.131630:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617856 00000100:00100000:3.0:1782759807.131641:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617856 00000100:00100000:3.0:1782759807.131707:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 445 00000100:00100000:3.0:1782759807.131719:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:115095:x1869355218617856:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:3.0:1782759807.131987:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115095:x1869355218617856:12345-192.168.202.31@tcp:35:dd.0 Request processed in 269us (470us total) trans 4294967768 rc 0/0 00000100:00100000:3.0:1782759807.132010:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 445 00000100:00100000:2.0:1782759807.153766:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759807.153989:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218617984 00000100:00100000:1.0:1782759807.154001:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218617984 00000100:00100000:1.0:1782759807.154122:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3101 00000100:00100000:1.0:1782759807.154134:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115096:x1869355218617984:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759807.154173:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759807.154503:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60de8c lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2777b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.154601:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.154617:0:6532:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 9 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.154626:0:6532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 4/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.154661:0:6532:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 9 pid: 6533 timeout: 3946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.154691:0:6532:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 9 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759807.154705:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1869355233115904:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759807.154803:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e52540 going to sleep for 11 seconds 00000100:00100000:0.0:1782759807.158499:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759807.159382:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6532:1869355233115904:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759807.159411:0:6532:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759807.160423:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218618112 00000100:00100000:3.0:1782759807.160433:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218618112 00010000:00010000:3.0:1782759807.160477:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 10 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759807.160801:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 874 00000100:00100000:3.0:1782759807.160812:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218618112:12345-192.168.202.31@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1782759807.160833:0:9534:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 10 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.160844:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 10 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.160856:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x48/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 10 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.160864:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:3.0:1782759807.160867:0:9534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 59 00010000:00010000:3.0:1782759807.160871:0:9534:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.160880:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.160886:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 4/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.160943:0:9534:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x48/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 10 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759807.161011:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218618112:12345-192.168.202.31@tcp:102:ldlm_bl.0 Request processed in 200us (2520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759807.161020:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 874 00010000:00010000:1.0:1782759807.161551:0:6532:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.161561:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759807.161637:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759807.161660:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.161696:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60de8c lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2777b expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.161721:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2777b expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.161729:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:1.0:1782759807.161731:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759807.161743:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412400, rc 0) 00000100:00100000:1.0:1782759807.161787:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115096:x1869355218617984:12345-192.168.202.31@tcp:101:rm.0 Request processed in 7656us (8031us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759807.161794:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3101 00000100:00100000:0.0:1782759807.166160:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759807.166255:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218618240 00000100:00100000:1.0:1782759807.166266:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218618240 00000100:00100000:1.0:1782759807.166366:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3102 00000100:00100000:1.0:1782759807.166379:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115096:x1869355218618240:12345-192.168.202.31@tcp:101:rm.0 00010000:00010000:1.0:1782759807.166399:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759807.166424:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60de9a lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27782 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166487:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166500:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166511:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166522:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166542:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166550:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166654:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60deaf lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166678:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60deaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166685:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60deaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759807.166730:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759807.166751:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60deaf lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166764:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166770:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166775:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166781:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166787:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759807.166791:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166798:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166810:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f6400) 00010000:00010000:1.0:1782759807.166813:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759807.166823:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166831:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60dea1 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166845:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166851:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166856:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166861:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759807.166863:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166869:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166876:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f6500) 00010000:00010000:1.0:1782759807.166878:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759807.166880:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166886:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60dea8 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166914:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60de9a lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27782 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166940:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60deaf lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27782 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759807.166947:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:1.0:1782759807.166949:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759807.166951:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412e00, rc 0) 00000100:00100000:1.0:1782759807.167010:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:115096:x1869355218618240:12345-192.168.202.31@tcp:101:rm.0 Request processed in 634us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759807.167018:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3102 00000100:00100000:0.0:1782759807.172139:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759807.172228:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218618368 00000100:00100000:3.0:1782759807.172238:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218618368 00000100:00100000:3.0:1782759807.172316:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 416 00000100:00100000:3.0:1782759807.172326:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2403:x1869355218618368:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759807.172344:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759807.172369:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412e00/0xd5b45c7f5c60deaf lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27782 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.172389:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:3.0:1782759807.172394:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759807.172457:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218618368:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759807.172465:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 416 00000100:00100000:2.0:1782759807.252864:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759807.252948:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218618624 00000100:00100000:3.0:1782759807.252957:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218618624 00000100:00100000:3.0:1782759807.253018:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3103 00000100:00100000:3.0:1782759807.253027:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115096:x1869355218618624:12345-192.168.202.31@tcp:36:rm.0 00010000:00010000:3.0:1782759807.253184:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782759807.253234:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648c00/0xd5b45c7f5c60de5b lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x48/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2776d expref: 9 pid: 6533 timeout: 3947 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253277:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5412400/0xd5b45c7f5c60de93 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2777b expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253290:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60de70 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2d:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27774 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253300:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc3500a00) 00010000:00010000:3.0:1782759807.253322:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759807.253344:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253357:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253397:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253410:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253417:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253423:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253507:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253515:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253527:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253832:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253842:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253850:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253858:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253864:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253870:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253883:0:12673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782759807.253901:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253907:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253913:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253919:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759807.253929:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253937:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253945:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759807.253948:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1782759807.253951:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253958:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60dec4 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253971:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253977:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253983:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253989:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.253994:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759807.253996:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.254002:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.254019:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4700) 00010000:00010000:3.0:1782759807.254021:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759807.254024:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.254030:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60deb6 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759807.254043:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000365bb45 reply state 00000000c87c0d36 transno 4294967769 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.254053:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759807.254060:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f4f00) 00010000:00010000:3.0:1782759807.254062:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759807.254064:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782759807.254269:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115096:x1869355218618624:12345-192.168.202.31@tcp:36:rm.0 Request processed in 1240us (1412us total) trans 4294967769 rc 0/0 00000100:00100000:3.0:1782759807.254277:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3103 00010000:00010000:0.0:1782759807.255662:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759807.255674:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759807.255683:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759807.255687:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759807.255697:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759807.255712:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2d:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:0.0:1782759807.255715:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782759807.255719:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 1/0,0 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759807.255729:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7a00/0xd5b45c7f5c60decb lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759807.255764:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759807.255766:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759807.255768:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759807.370950:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759807.370976:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233116032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759807.371069:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759807.371317:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116032 00000100:00100000:2.0:1782759807.371326:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116032 00000100:00100000:2.0:1782759807.371397:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:2.0:1782759807.371408:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233116032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759807.371442:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759807.371496:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233116032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759807.371503:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00000100:00100000:2.0:1782759807.371562:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233116032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759807.371776:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759807.371786:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233116160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759807.371818:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759807.371887:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116160 00000100:00100000:1.0:1782759807.371892:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116160 00000100:00100000:1.0:1782759807.371924:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:1.0:1782759807.371932:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233116160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759807.371943:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759807.371974:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233116160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759807.371979:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:0.0:1782759807.372095:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233116160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759807.584186:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233116288:0@lo:601:kworker.0 00000100:00100000:0.0:1782759807.584261:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759807.587843:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116288 00000100:00100000:3.0:1782759807.587863:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116288 00000100:00100000:3.0:1782759807.587994:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1782759807.588006:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233116288:12345-0@lo:601:kworker.0 00000100:00100000:3.0:1782759807.588500:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233116288:12345-0@lo:601:kworker.0 Request processed in 495us (4238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759807.588521:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1782759807.588647:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233116416:0@lo:106: 00000100:00100000:0.0:1782759807.588687:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759807.588722:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4b580c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759807.588756:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116416 00000100:00100000:0.0:1782759807.588760:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116416 00000100:00100000:0.0:1782759807.588791:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1782759807.588798:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233116416:12345-0@lo:106: 00010000:00010000:0.0:1782759807.588810:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:0.0:1782759807.588821:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:0.0:1782759807.588863:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233116416:12345-0@lo:106: Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759807.588872:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:0.0:1782759807.588918:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233116416:0@lo:106: 00000100:00100000:2.0:1782759807.589480:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233116288:0@lo:601:kworker.0 00010000:00010000:3.0:1782759807.946744:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759808.396604:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759808.396626:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233116544:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759808.396695:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759808.396743:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116544 00000100:00100000:2.0:1782759808.396763:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116544 00000100:00100000:2.0:1782759808.396827:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:2.0:1782759808.396845:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233116544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759808.396875:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759808.396919:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233116544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759808.396925:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:2.0:1782759808.396963:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759808.396970:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233116672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759808.397010:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759808.397034:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116672 00000100:00100000:2.0:1782759808.397037:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116672 00000100:00100000:2.0:1782759808.397085:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514 00000100:00100000:2.0:1782759808.397092:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233116672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759808.397123:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18243584 pending 0 free 1446117376 avail 1299877888 00000100:00100000:2.0:1782759808.397363:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233116672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 271us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759808.397369:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514 00000100:00100000:2.0:1782759808.397808:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233116544:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782759808.398553:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759808.398674:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233116672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759808.400845:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233116800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759808.400907:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759808.400963:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116800 00000100:00100000:1.0:1782759808.400970:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116800 00000100:00100000:1.0:1782759808.401020:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1782759808.401028:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233116800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759808.401050:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759808.401103:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233116800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759808.401123:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1782759808.401170:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233116800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782759808.401188:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759808.741658:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759808.742099:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218618880 00000100:00100000:2.0:1782759808.742109:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218618880 00000100:00100000:2.0:1782759808.742196:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5506 00000100:00100000:3.0:1782759808.742273:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759808.742307:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759808.742329:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759808.742349:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759808.742368:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619136 00000100:00100000:3.0:1782759808.742371:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619136 00000100:00100000:3.0:1782759808.742403:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619264 00000100:00100000:3.0:1782759808.742406:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619264 00000100:00100000:3.0:1782759808.742424:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3241 00000100:00100000:3.0:1782759808.742432:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218619136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759808.742501:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218619136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 70us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759808.742507:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3241 00000100:00100000:3.0:1782759808.742672:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3242 00000100:00100000:3.0:1782759808.742681:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218619264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:1.0:1782759808.742719:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759808.742724:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759808.742728:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759808.742748:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218618880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759808.742788:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218618880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 583us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759808.742795:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5506 00000100:00100000:2.0:1782759808.742823:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619008 00000100:00100000:2.0:1782759808.742827:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619008 00000100:00100000:2.0:1782759808.742863:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5507 00000100:00100000:2.0:1782759808.742873:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218619008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759808.742905:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218619008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759808.742911:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5507 00000100:00100000:0.0:1782759808.742996:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218618752 00000100:00100000:0.0:1782759808.743001:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218618752 00000100:00100000:3.0:1782759808.743022:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218619264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 341us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759808.743030:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3242 00000100:00100000:0.0:1782759808.743042:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3443 00000100:00100000:0.0:1782759808.743051:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218618752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759808.743090:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218618752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759808.743097:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3443 00000100:00080000:1.0:1782759808.743414:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1782759808.985084:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759809.996907:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1782759810.495475:0:160855:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1782759810.495487:0:160855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1782759810.496925:0:160854:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1782759810.496934:0:160854:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1782759810.954740:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759810.954860:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233116928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759810.955085:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759810.956843:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233116928 00000100:00100000:0.0:1782759810.956856:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233116928 00000100:00100000:0.0:1782759810.957091:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3515 00000100:00100000:0.0:1782759810.957112:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233116928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759810.957165:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:0.0:1782759810.957256:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233116928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759810.957264:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3515 00000100:00100000:3.0:1782759810.957344:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233116928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759811.022710:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759811.508020:0:160914:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe81e67a00 20000000:00000080:2.0:1782759811.508047:0:160914:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e81000 uarg=0000000000000000 00010000:00010000:2.0:1782759811.508467:0:160914:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759811.508485:0:160914:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924a000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759811.508509:0:160914:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759811.508519:0:160914:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759811.508535:0:160914:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759811.508552:0:160914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759811.508570:0:160914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759811.508682:0:160914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759811.508721:0:160914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759811.508735:0:160914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 23 pid: 6525 timeout: 4001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759811.508767:0:160914:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160914:1869355233117056:0@lo:104: 00000100:00100000:2.0:1782759811.509372:0:160914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.509439:0:160914:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759811.509785:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782759811.509803:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117056 00000100:00100000:3.0:1782759811.509809:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117056 00000100:00100000:3.0:1782759811.509900:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1782759811.509910:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:160914:x1869355233117056:12345-0@lo:104: 00010000:00010000:3.0:1782759811.509926:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759811.510007:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759811.510013:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:160914:x1869355233117056:12345-0@lo:104: Request processed in 105us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759811.510020:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:2.0:1782759811.510121:0:160914:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a90380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:160914:1869355233117056:0@lo:104: 00010000:00010000:2.0:1782759811.510167:0:160914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510266:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759811.510274:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510286:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759811.510290:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510298:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759811.510305:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759811.510310:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759811.510353:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510360:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759811.510389:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510396:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412200/0xd5b45c7f5c60ddeb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60ddf2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510413:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759811.510415:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759811.510417:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759811.510425:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759811.510437:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233117184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759811.510471:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.510506:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117184 00000100:00100000:0.0:1782759811.510509:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117184 00010000:00010000:0.0:1782759811.510528:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 24 pid: 6525 timeout: 4001 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759811.510551:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1782759811.510557:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233117184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759811.510568:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759811.510574:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 24 pid: 6525 timeout: 4001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510617:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 24 pid: 6525 timeout: 4001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510631:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60ddf2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ddeb expref: 24 pid: 6525 timeout: 4001 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510643:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510650:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510663:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510669:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510675:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510681:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510687:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759811.510690:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510696:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510711:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759811.510721:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759811.510728:0:160914:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759811.510737:0:160914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759811.510742:0:160914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648400/0xd5b45c7f5c60ded2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 160914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759811.510751:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233117184:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759811.510760:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:0.0:1782759811.510793:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233117184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759811.979326:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233117568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.979564:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.979646:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233118080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.979674:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.979698:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233118592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.979718:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.979743:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759811.979748:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233117440:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.979770:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.979784:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233117952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.979807:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.979821:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233118464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.979840:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759811.979869:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118080 00000100:00100000:0.0:1782759811.979878:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118080 00000100:00100000:0.0:1782759811.979928:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118592 00000100:00100000:0.0:1782759811.979932:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118592 00000100:00100000:0.0:1782759811.979959:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117440 00000100:00100000:0.0:1782759811.979962:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117440 00000100:00100000:0.0:1782759811.979974:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117952 00000100:00100000:0.0:1782759811.979976:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117952 00000100:00100000:0.0:1782759811.979988:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118464 00000100:00100000:0.0:1782759811.979990:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118464 00000100:00100000:0.0:1782759811.980005:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5508 00000100:00100000:0.0:1782759811.980013:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233118080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980084:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233118080:12345-0@lo:400:kworker.0 Request processed in 70us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759811.980092:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5508 00000100:00100000:0.0:1782759811.980109:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5509 00000100:00100000:0.0:1782759811.980115:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233118592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980219:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233118592:12345-0@lo:400:kworker.0 Request processed in 104us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759811.980227:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5509 00000100:00100000:0.0:1782759811.980240:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5510 00000100:00100000:0.0:1782759811.980246:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233117440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980273:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233117440:12345-0@lo:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759811.980283:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5510 00000100:00100000:0.0:1782759811.980295:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5511 00000100:00100000:0.0:1782759811.980300:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233117952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980325:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233117952:12345-0@lo:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759811.980407:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5511 00000100:00100000:0.0:1782759811.980421:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5512 00000100:00100000:0.0:1782759811.980428:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233118464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980458:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233118464:12345-0@lo:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759811.980463:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5512 00000100:00080000:0.0:1782759811.980493:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759811.980497:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759811.980529:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233117440:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980539:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233117952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980549:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233118464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980558:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233118080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759811.980566:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233118592:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980713:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233117696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980746:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.980771:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233118208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980794:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.980810:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233118720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980828:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.980844:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782759811.980850:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233117312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980873:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.980893:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233117824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980931:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.980948:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233118336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.980969:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.980985:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233118848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981006:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759811.981046:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117568 00000100:00100000:2.0:1782759811.981051:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117568 00000100:00100000:2.0:1782759811.981105:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117824 00000100:00100000:2.0:1782759811.981108:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117824 00000100:00100000:2.0:1782759811.981138:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3516 00000100:00100000:2.0:1782759811.981147:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233117568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981192:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233117568:12345-0@lo:400:kworker.0 Request processed in 47us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981198:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3516 00000100:00100000:2.0:1782759811.981214:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517 00000100:00100000:2.0:1782759811.981222:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233117824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981254:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233117824:12345-0@lo:400:kworker.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981260:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517 00000100:00100000:2.0:1782759811.981277:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117696 00000100:00100000:2.0:1782759811.981280:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117696 00000100:00100000:2.0:1782759811.981306:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5513 00000100:00100000:2.0:1782759811.981312:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233117696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981543:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233117696:12345-0@lo:400:kworker.0 Request processed in 231us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981549:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5513 00000100:00100000:2.0:1782759811.981601:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118208 00000100:00100000:2.0:1782759811.981606:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118208 00000100:00100000:2.0:1782759811.981640:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118720 00000100:00100000:2.0:1782759811.981643:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118720 00000100:00100000:2.0:1782759811.981656:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118336 00000100:00100000:2.0:1782759811.981658:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118336 00000100:00100000:2.0:1782759811.981672:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118848 00000100:00100000:2.0:1782759811.981674:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118848 00000100:00100000:2.0:1782759811.981688:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3243 00000100:00100000:2.0:1782759811.981694:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233118208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981725:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233118208:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981730:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3243 00000100:00100000:2.0:1782759811.981741:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3244 00000100:00100000:2.0:1782759811.981746:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233118720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981768:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233118720:12345-0@lo:400:kworker.0 Request processed in 23us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981773:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3244 00000100:00100000:2.0:1782759811.981782:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3245 00000100:00100000:2.0:1782759811.981788:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233118336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981810:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233118336:12345-0@lo:400:kworker.0 Request processed in 23us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981815:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3245 00000100:00100000:2.0:1782759811.981824:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3246 00000100:00100000:2.0:1782759811.981829:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233118848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981852:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233118848:12345-0@lo:400:kworker.0 Request processed in 24us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981868:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3246 00000100:00100000:2.0:1782759811.981888:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233117312 00000100:00100000:2.0:1782759811.981891:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233117312 00000100:00100000:2.0:1782759811.981916:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3444 00000100:00100000:2.0:1782759811.981922:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233117312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.981954:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233117312:12345-0@lo:400:kworker.0 Request processed in 32us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759811.981959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3444 00000100:00100000:2.0:1782759811.982022:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233117312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.982049:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233117824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.982060:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233118336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.982069:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233118848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.982078:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233117696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.982087:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233118208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759811.982096:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233118720:0@lo:400:kworker.0 00000100:00080000:0.0:1782759811.982209:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759811.982213:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759811.982281:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233117568:0@lo:400:kworker.0 00010000:00010000:0.0:1782759812.044213:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759812.492751:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759812.492775:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233118976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759812.492845:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759812.492909:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233118976 00000100:00100000:2.0:1782759812.492917:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233118976 00000100:00100000:2.0:1782759812.492983:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:2.0:1782759812.493002:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233118976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759812.493042:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759812.493091:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233118976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759812.493098:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00000100:00100000:2.0:1782759812.493165:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233118976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759812.494853:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233119104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759812.494913:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759812.495066:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233119104 00000100:00100000:1.0:1782759812.495073:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233119104 00000100:00100000:1.0:1782759812.495121:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:1.0:1782759812.495130:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233119104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759812.495407:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759812.495462:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233119104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 333us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759812.495470:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00000100:00100000:2.0:1782759812.495538:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233119104:0@lo:13:osp-pre-1-1.0 00000001:00080000:3.0:1782759812.506630:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967769 is committed 00010000:00010000:0.0:1782759812.506677:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759812.506695:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759812.506704:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759812.506710:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759812.506715:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759812.506722:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759812.506737:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f4f00) 00010000:00010000:0.0:1782759812.506741:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759812.506745:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759812.506752:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60debd lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759812.682725:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759812.682735:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759812.682741:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759812.682798:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759812.682811:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759812.682824:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759812.682851:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233119232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759812.682922:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759812.682990:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d34000 going to sleep for 11 seconds 00000100:00100000:1.0:1782759812.683083:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233119232 00000100:00100000:1.0:1782759812.683091:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233119232 00000100:00100000:1.0:1782759812.683145:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3445 00000100:00100000:1.0:1782759812.683155:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233119232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759812.683170:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759812.683193:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60ded9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759812.683219:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759812.683251:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759812.683259:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412a00, rc 0) 00000100:00100000:1.0:1782759812.683312:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233119232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759812.683319:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3445 00000100:00100000:3.0:1782759812.683573:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233119232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759812.683616:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759812.683626:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759812.683646:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759812.683651:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759812.683659:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759813.073694:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759813.514839:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759813.514862:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233119360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759813.514881:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759813.514890:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233119488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759813.515082:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233119616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759813.520531:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759813.522870:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233119360 00000100:00100000:0.0:1782759813.522882:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233119360 00000100:00100000:0.0:1782759813.522939:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:0.0:1782759813.522957:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233119360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759813.522988:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759813.523077:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233119360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759813.523084:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00000100:00080000:0.0:1782759813.524727:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759813.524788:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233119360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759813.532177:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759813.532323:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233119488 00000100:00100000:3.0:1782759813.532332:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233119488 00000100:00100000:3.0:1782759813.532396:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518 00000100:00100000:3.0:1782759813.532405:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233119488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759813.532443:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 18243584 pending 0 free 1446117376 avail 1299877888 00000100:00100000:3.0:1782759813.532502:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233119488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759813.532509:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518 00000100:00100000:3.0:1782759813.532566:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233119488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759813.536975:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759813.538927:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233119616 00000100:00100000:2.0:1782759813.538940:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233119616 00000100:00100000:2.0:1782759813.539056:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:2.0:1782759813.539067:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233119616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759813.539094:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759813.539177:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233119616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759813.539183:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:2.0:1782759813.539237:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233119616:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1782759813.542200:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759813.853811:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759813.853894:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619520 00000100:00100000:3.0:1782759813.853904:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619520 00000100:00100000:3.0:1782759813.853993:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5514 00000100:00100000:3.0:1782759813.854004:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218619520:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759813.854091:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2403:x1869355218619520:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759813.854100:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5514 00000100:00080000:1.0:1782759813.854259:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759813.860778:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759813.860816:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759813.860856:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759813.860892:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619904 00000100:00100000:3.0:1782759813.860904:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619904 00000100:00100000:3.0:1782759813.860978:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3247 00000100:00100000:3.0:1782759813.860988:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218619904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759813.861073:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218619904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759813.861081:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3247 00000100:00080000:3.0:1782759813.861105:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759813.861481:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619392 00000100:00100000:2.0:1782759813.861487:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619392 00000100:00100000:2.0:1782759813.861532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3446 00000100:00100000:2.0:1782759813.861541:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218619392:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759813.861595:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218619392:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759813.861602:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3446 00000100:00100000:1.0:1782759813.861766:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619648 00000100:00100000:1.0:1782759813.861772:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619648 00000100:00100000:1.0:1782759813.861826:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5515 00000100:00100000:1.0:1782759813.861834:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218619648:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759813.861874:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218619648:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 42us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759813.861881:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5515 00000100:00080000:3.0:1782759813.861957:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759813.868322:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759813.869496:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218619776 00000100:00100000:1.0:1782759813.869509:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218619776 00000100:00100000:1.0:1782759813.869623:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3248 00000100:00100000:1.0:1782759813.869634:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218619776:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759813.869712:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218619776:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 80us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759813.869719:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3248 00000100:00080000:3.0:1782759813.870409:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782759814.103390:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759815.107152:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.107293:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218620032 00000100:00100000:3.0:1782759815.107304:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218620032 00000100:00080000:1.0:1782759815.107391:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759815.107423:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3104 00000100:00100000:3.0:1782759815.107432:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115305:x1869355218620032:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759815.107450:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759815.107470:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dee7 lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27789 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107541:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107552:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107562:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107618:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107624:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107634:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107808:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107819:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107824:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107828:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107831:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759815.107834:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107838:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107847:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759815.107849:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759815.107852:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107855:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60deee lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107865:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107874:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107877:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107880:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759815.107882:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107885:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107900:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cddc34f4900) 00010000:00010000:3.0:1782759815.107901:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759815.107903:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107906:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7c00/0xd5b45c7f5c60def5 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.107943:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dee7 lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27789 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.108053:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cddc34f4c00) 00010000:00010000:3.0:1782759815.108056:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759815.108061:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6000/0xd5b45c7f5c60dee7 lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27789 expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.108080:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6000, rc 0) 00000100:00100000:3.0:1782759815.108151:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115305:x1869355218620032:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 720us (1009us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759815.108172:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3104 00000100:00100000:3.0:1782759815.111388:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.111469:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218620288 00000100:00100000:0.0:1782759815.111479:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218620288 00000100:00100000:0.0:1782759815.111537:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3105 00000100:00100000:0.0:1782759815.111548:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115305:x1869355218620288:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759815.111567:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759815.111608:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60defc lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27790 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.111723:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 3/0,1 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.111736:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.111745:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 3/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.111757:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,1 mode: --/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.111764:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.111775:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112277:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112288:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112296:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759815.112308:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x2f:0x0]: returning size 0 00010000:00010000:0.0:1782759815.112334:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112342:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 4/0,1 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112348:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 3/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112355:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112361:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759815.112366:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 4/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112373:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 5/0,0 mode: CW/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112391:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759815.112394:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759815.112398:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 3/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112405:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df03 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759815.112417:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc3ded6b reply state 00000000d4db49bd transno 4294967770 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112427:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112433:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759815.112436:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759815.112438:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782759815.112465:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60defc lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112484:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.112490:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:0.0:1782759815.112492:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759815.112494:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803400, rc 0) 00000100:00100000:0.0:1782759815.112549:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115305:x1869355218620288:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1003us (1169us total) trans 4294967770 rc 0/0 00000100:00100000:0.0:1782759815.112558:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3105 00010000:00010000:0.0:1782759815.116514:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759815.118550:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.118743:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218620544 00000100:00100000:0.0:1782759815.118753:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218620544 00000100:00100000:0.0:1782759815.118806:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3106 00000100:00100000:0.0:1782759815.118871:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115305:x1869355218620544:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759815.118895:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759815.118916:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df1f lrc: 2/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27797 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.119891:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.119908:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.119917:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 4/0,1 mode: --/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.120107:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.120218:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 9 pid: 6532 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759815.120233:0:6533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355233119744:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759815.120370:0:6533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759815.149899:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759815.149936:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218620672 00000100:00100000:1.0:1782759815.149945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218620672 00000100:00100000:2.0:1782759815.149968:0:6533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6533:1869355233119744:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759815.149983:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 10 pid: 6532 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.149991:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759815.150210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 876 00000100:00100000:1.0:1782759815.150221:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:2402:x1869355218620672:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759815.150237:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759815.150255:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 10 pid: 6532 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.150268:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 10 pid: 6532 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.150290:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df11 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27790 expref: 10 pid: 6532 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.150303:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:1.0:1782759815.150308:0:6516:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: --/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.150316:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.150322:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 4/0,1 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.150349:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759815.150399:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218620672:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 180us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.150407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 876 00010000:00010000:3.0:1782759815.157068:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157087:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759815.157245:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000405:0x2f:0x0]: returning size 0 00010000:00010000:3.0:1782759815.157472:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,1 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157481:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 2/0,0 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157488:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157495:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759815.157499:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 3/0,0 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157507:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 4/0,0 mode: EX/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157523:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:3.0:1782759815.157528:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759815.157533:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 2/0,0 mode: --/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157538:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60df26 lrc: 0/0,0 mode: --/EX res: [0x240000405:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157629:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df1f lrc: 1/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27797 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157641:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:3.0:1782759815.157643:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759815.157647:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df1f lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27797 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.157661:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803800, rc 0) 00000100:00100000:3.0:1782759815.158779:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115305:x1869355218620544:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 39906us (40231us total) trans 4294967771 rc 301/301 00000100:00100000:3.0:1782759815.158791:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3106 00000100:00100000:1.0:1782759815.161504:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.161562:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218620928 00000100:00100000:3.0:1782759815.161571:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218620928 00000100:00100000:3.0:1782759815.161649:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 447 00000100:00100000:3.0:1782759815.161658:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115305:x1869355218620928:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759815.162453:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115305:x1869355218620928:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 793us (956us total) trans 4294967772 rc 0/0 00000100:00100000:3.0:1782759815.162463:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 447 00000100:00100000:2.0:1782759815.176098:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.176193:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218621184 00000100:00100000:0.0:1782759815.176203:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218621184 00000100:00100000:0.0:1782759815.176292:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 448 00000100:00100000:0.0:1782759815.176304:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115305:x1869355218621184:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759815.176541:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:115305:x1869355218621184:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 238us (449us total) trans 4294967773 rc 0/0 00000100:00100000:0.0:1782759815.176548:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 448 00000100:00100000:1.0:1782759815.200363:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.200451:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218621440 00000100:00100000:0.0:1782759815.200461:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218621440 00000100:00100000:0.0:1782759815.200523:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3107 00000100:00100000:0.0:1782759815.200533:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+10:115307:x1869355218621440:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782759815.200556:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759815.200698:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60df34 lrc: 2/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2779e expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200828:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 3/1,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200843:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200855:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 3/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200863:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 3/1,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200870:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200876:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200930:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200950:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.200956:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759815.201210:0:12673:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1782759815.201214:0:12673:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 0 -> 1782759815 00000004:00010000:0.0:1782759815.201217:0:12673:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 0 -> 1782759815 00000004:00010000:0.0:1782759815.201219:0:12673:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 0 -> 1782759815 00000004:00010000:0.0:1782759815.201221:0:12673:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1782759815.201226:0:12673:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1782759815.201233:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201240:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 4/1,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201247:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 3/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201254:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201260:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759815.201264:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 4/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201272:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 5/0,0 mode: CR/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201284:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x0 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759815.201287:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759815.201292:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 3/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201299:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60df3b lrc: 0/0,0 mode: --/CR res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201312:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201318:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 2/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201324:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201329:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759815.201333:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201339:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 4/0,0 mode: PR/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201346:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759815.201348:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759815.201351:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201356:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60df42 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201391:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802a00/0xd5b45c7f5c60df34 lrc: 0/0,0 mode: --/CW res: [0x240000405:0x26:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201408:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.201415:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:0.0:1782759815.201417:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1782759815.201419:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803800, rc 0) 00000100:00100000:0.0:1782759815.201476:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:115307:x1869355218621440:12345-192.168.202.31@tcp:101:dd.0 Request processed in 945us (1122us total) trans 4294967774 rc 0/0 00000100:00100000:0.0:1782759815.201483:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3107 00000100:00100000:3.0:1782759815.208877:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.209076:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218621568 00000100:00100000:0.0:1782759815.209086:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218621568 00000100:00100000:0.0:1782759815.209134:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3108 00000100:00100000:0.0:1782759815.209143:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+12:115307:x1869355218621568:12345-192.168.202.31@tcp:101:dd.0 00010000:00010000:0.0:1782759815.209246:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759815.209267:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df57 lrc: 2/0,0 mode: --/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277a5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.209301:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60df5e lrc: 3/1,0 mode: --/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.209314:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60df5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.209325:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60df5e lrc: 3/1,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.209430:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60df57 lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277a5 expref: 14 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.209445:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60df5e lrc: 3/0,0 mode: PR/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277a5 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759815.209453:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:0.0:1782759815.209456:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782759815.209459:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802000, rc 0) 00000100:00100000:0.0:1782759815.209614:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:115307:x1869355218621568:12345-192.168.202.31@tcp:101:dd.0 Request processed in 471us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.209621:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3108 00000100:00100000:2.0:1782759815.212001:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759815.212140:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218621824 00000100:00100000:1.0:1782759815.212150:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218621824 00000100:00100000:1.0:1782759815.212205:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3109 00000100:00100000:1.0:1782759815.212215:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+13:115307:x1869355218621824:12345-192.168.202.31@tcp:36:dd.0 00010000:00010000:1.0:1782759815.212350:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.212366:0:8593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 2/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.212376:0:8593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 4/0,1 mode: --/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.212408:0:8593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759815.212422:0:8593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 13 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759815.212437:0:8593:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355233119872:192.168.202.31@tcp:104: 00000100:00100000:1.0:1782759815.212566:0:8593:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759815.217508:0:8593:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8593:1869355233119872:192.168.202.31@tcp:104: 00010000:00010000:2.0:1782759815.217538:0:8593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759815.223193:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.226292:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218621952 00000100:00100000:3.0:1782759815.226309:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218621952 00010000:00010000:3.0:1782759815.226358:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 14 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.226457:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 877 00000100:00100000:3.0:1782759815.226466:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2402:x1869355218621952:12345-192.168.202.31@tcp:102:ldlm_bl.0 00010000:00010000:3.0:1782759815.226484:0:6515:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 4/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 14 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.226496:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 14 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.226508:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 14 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.226518:0:6515:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:3.0:1782759815.226520:0:6515:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:3.0:1782759815.226525:0:6515:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: --/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.226535:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.226543:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 4/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759815.226622:0:6515:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 3/0,0 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 14 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.226689:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+14:2402:x1869355218621952:12345-192.168.202.31@tcp:102:ldlm_bl.0 Request processed in 223us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.226697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 877 00010000:00010000:2.0:1782759815.230288:0:8593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.230325:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759815.230492:0:8593:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1782759815.230496:0:8593:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759815 -> 1782759816 00000004:00010000:2.0:1782759815.230499:0:8593:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:2.0:1782759815.230501:0:8593:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759815 -> 1782759816 00000004:00010000:2.0:1782759815.230504:0:8593:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1782759815.230511:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e797aae reply state 00000000448dd110 transno 4294967775 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: PW/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.230528:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.230538:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:2.0:1782759815.230541:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759815.230546:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759815.230692:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:115307:x1869355218621824:12345-192.168.202.31@tcp:36:dd.0 Request processed in 18473us (18704us total) trans 4294967775 rc 0/0 00000100:00100000:2.0:1782759815.230701:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3109 00000100:00100000:2.0:1782759815.233342:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.233428:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622080 00000100:00100000:3.0:1782759815.233439:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622080 00002000:00010000:3.0:1782759815.233486:0:6546:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000405:0x2f:0x0] 00002000:00100000:3.0:1782759815.233492:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4acb480 with x1869355218622080 00000100:00100000:3.0:1782759815.233574:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 26 00000100:00100000:3.0:1782759815.233617:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+15:2403:x1869355218622080:12345-192.168.202.31@tcp:10:dd.0 00000004:00010000:3.0:1782759815.233831:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1782759815.233835:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:3.0:1782759815.233837:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:3.0:1782759815.233839:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:3.0:1782759815.233841:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782759815.233913:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:2403:x1869355218622080:12345-192.168.202.31@tcp:10:dd.0 Request processed in 297us (579us total) trans 4294967776 rc 0/0 00000100:00100000:3.0:1782759815.233921:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 26 00002000:00010000:3.0:1782759815.233924:0:6546:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0001: refresh DOM lock for [0x240000405:0x2f:0x0] 00002000:00100000:3.0:1782759815.233927:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4acb480 with x1869355218622080 00000100:00100000:1.0:1782759815.279292:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.283124:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622208 00000100:00100000:2.0:1782759815.283142:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622208 00002000:00100000:2.0:1782759815.283215:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49aa680 x1869355218622208/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.283228:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49aa680 with x1869355218622208 00000100:00100000:2.0:1782759815.283328:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 27 00000100:00100000:2.0:1782759815.283351:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+16:2405:x1869355218622208:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:1.0:1782759815.311983:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00000100:00100000:1.0:1782759815.312195:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120000:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759815.312262:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759815.312345:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120000 00000100:00100000:3.0:1782759815.312352:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120000 00000100:00100000:3.0:1782759815.312404:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1782759815.312412:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120000:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:3.0:1782759815.312440:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759815.312507:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759815.312702:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120000:12345-0@lo:601:mdt_io00_001.0 Request processed in 289us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.312713:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1782759815.318502:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120000:0@lo:601:mdt_io00_001.0 00010000:00010000:1.0:1782759815.318549:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 9 lru_type: 1 00010000:00010000:1.0:1782759815.318614:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000004:00010000:1.0:1782759815.321835:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 0 -> 1048576 00000004:00010000:1.0:1782759815.321846:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.321848:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:1.0:1782759815.321851:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.321853:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 0 -> 2048 00000100:00100000:1.0:1782759815.322080:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:2405:x1869355218622208:12345-192.168.202.31@tcp:4:dd.0 Request processed in 38726us (42793us total) trans 4294967777 rc 0/0 00000100:00100000:1.0:1782759815.322092:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 27 00002000:00100000:1.0:1782759815.322106:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49aa680 x1869355218622208/t4294967777(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759815.322117:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49aa680 with x1869355218622208 00000100:00100000:0.0:1782759815.326168:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.326265:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622336 00000100:00100000:3.0:1782759815.326275:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622336 00000100:00100000:3.0:1782759815.326375:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3110 00000100:00100000:3.0:1782759815.326386:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+18:115307:x1869355218622336:12345-192.168.202.31@tcp:44:dd.0 00000001:00080000:1.0:1782759815.333358:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967777 is committed 00000100:00100000:3.0:1782759815.333646:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:115307:x1869355218622336:12345-192.168.202.31@tcp:44:dd.0 Request processed in 7256us (7485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.333659:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3110 00010000:00010000:2.0:1782759815.334387:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334400:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334407:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334413:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759815.334418:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334426:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334442:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x26:0x0].0x1143c7b5 (ffff8cdecda0ad00) 00010000:00010000:2.0:1782759815.334444:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759815.334448:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334455:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60df0a lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x26:0x0].0x1143c7b5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334543:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,1 mode: TXN/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334548:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 2/0,0 mode: TXN/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334554:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334757:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759815.334763:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 3/0,0 mode: TXN/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334770:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 4/0,0 mode: TXN/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334780:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:2.0:1782759815.334782:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759815.334785:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 2/0,0 mode: --/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759815.334791:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60df65 lrc: 0/0,0 mode: --/TXN res: [0x240000405:0x2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.335935:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.336291:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622464 00000100:00100000:0.0:1782759815.336301:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622464 00000100:00100000:0.0:1782759815.336361:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3111 00000100:00100000:0.0:1782759815.336372:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218622464:12345-192.168.202.31@tcp:16:dd.0 00000100:00100000:0.0:1782759815.336511:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218622464:12345-192.168.202.31@tcp:16:dd.0 Request processed in 140us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.336520:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3111 00000100:00100000:1.0:1782759815.363302:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.365458:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622592 00000100:00100000:3.0:1782759815.365472:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622592 00002000:00100000:3.0:1782759815.365536:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49a9880 x1869355218622592/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:3.0:1782759815.365548:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49a9880 with x1869355218622592 00000100:00100000:3.0:1782759815.365666:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 28 00000100:00100000:3.0:1782759815.365686:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218622592:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:2.0:1782759815.385330:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00000100:00100000:2.0:1782759815.385388:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120128:0@lo:601:mdt_io00_002.0 00000100:00100000:2.0:1782759815.385453:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.385624:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759815.385917:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120128 00000100:00100000:0.0:1782759815.385925:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120128 00000100:00100000:0.0:1782759815.386253:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:0.0:1782759815.386263:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120128:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:0.0:1782759815.386293:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759815.386536:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120128:12345-0@lo:601:mdt_io00_002.0 Request processed in 274us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.386544:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:2.0:1782759815.386626:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9c00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120128:0@lo:601:mdt_io00_002.0 00010000:00010000:2.0:1782759815.386666:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 10 lru_type: 1 00010000:00010000:2.0:1782759815.386685:0:6546:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000004:00010000:2.0:1782759815.388755:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 1048576 -> 2097152 00000004:00010000:2.0:1782759815.388768:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:2.0:1782759815.388771:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:2.0:1782759815.388773:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:2.0:1782759815.388775:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 2048 -> 4096 00000100:00100000:2.0:1782759815.389265:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218622592:12345-192.168.202.31@tcp:4:dd.0 Request processed in 23574us (25969us total) trans 4294967778 rc 0/0 00000100:00100000:2.0:1782759815.389277:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 28 00002000:00100000:2.0:1782759815.389291:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49a9880 x1869355218622592/t4294967778(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.389301:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49a9880 with x1869355218622592 00000100:00100000:2.0:1782759815.393902:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.394226:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622720 00000100:00100000:3.0:1782759815.394238:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622720 00000100:00100000:3.0:1782759815.394302:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3112 00000100:00100000:3.0:1782759815.394313:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218622720:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:3.0:1782759815.397571:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967778 is committed 00000100:00100000:1.0:1782759815.398628:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218622720:12345-192.168.202.31@tcp:16:dd.0 Request processed in 4259us (4680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.398643:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3112 00000100:00100000:1.0:1782759815.422347:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.422501:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622848 00000100:00100000:2.0:1782759815.422511:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622848 00002000:00100000:2.0:1782759815.422573:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49aad80 x1869355218622848/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.422615:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49aad80 with x1869355218622848 00000100:00100000:2.0:1782759815.422649:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 29 00000100:00100000:2.0:1782759815.422661:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218622848:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:3.0:1782759815.458534:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00000100:00100000:3.0:1782759815.458660:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120256:0@lo:601:mdt_io00_001.0 00000100:00100000:3.0:1782759815.458795:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759815.460625:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759815.461226:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120256 00000100:00100000:1.0:1782759815.461237:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120256 00000100:00100000:1.0:1782759815.461344:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1782759815.461355:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120256:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:1.0:1782759815.461465:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759815.461783:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120256:12345-0@lo:601:mdt_io00_001.0 Request processed in 428us (2987us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.461791:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1782759815.461874:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4480000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120256:0@lo:601:mdt_io00_001.0 00010000:00010000:0.0:1782759815.461918:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 11 lru_type: 1 00010000:00010000:0.0:1782759815.461938:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 12 lru_type: 1 00000004:00010000:2.0:1782759815.463917:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 2097152 -> 3145728 00000004:00010000:2.0:1782759815.463926:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:2.0:1782759815.463939:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:2.0:1782759815.463941:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:2.0:1782759815.463966:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 4096 -> 6144 00000100:00100000:2.0:1782759815.464069:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218622848:12345-192.168.202.31@tcp:4:dd.0 Request processed in 41407us (41727us total) trans 4294967779 rc 0/0 00000100:00100000:2.0:1782759815.464080:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 29 00002000:00100000:2.0:1782759815.464092:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49aad80 x1869355218622848/t4294967779(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.464102:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49aad80 with x1869355218622848 00000100:00100000:0.0:1782759815.468544:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.468777:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218622976 00000100:00100000:2.0:1782759815.468788:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218622976 00000100:00100000:2.0:1782759815.468893:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3113 00000100:00100000:2.0:1782759815.468906:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218622976:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759815.471723:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967779 is committed 00000100:00100000:2.0:1782759815.471989:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218622976:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3081us (3450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759815.472351:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3113 00000100:00100000:0.0:1782759815.499616:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.499803:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623104 00000100:00100000:2.0:1782759815.499814:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623104 00002000:00100000:2.0:1782759815.499878:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddcb90ea00 x1869355218623104/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.499890:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddcb90ea00 with x1869355218623104 00000100:00100000:2.0:1782759815.499940:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 30 00000100:00100000:2.0:1782759815.499953:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218623104:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:2.0:1782759815.519925:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 12 lru_type: 1 00000100:00100000:2.0:1782759815.520219:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120384:0@lo:601:mdt_io00_002.0 00000100:00100000:2.0:1782759815.520297:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.520427:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759815.520744:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120384 00000100:00100000:0.0:1782759815.520752:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120384 00000100:00100000:0.0:1782759815.520847:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1782759815.520857:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120384:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:0.0:1782759815.520889:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759815.521179:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120384:12345-0@lo:601:mdt_io00_002.0 Request processed in 323us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.521188:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1782759815.521269:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120384:0@lo:601:mdt_io00_002.0 00010000:00010000:2.0:1782759815.521349:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 12 lru_type: 1 00010000:00010000:2.0:1782759815.521360:0:6546:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 13 lru_type: 1 00000004:00010000:2.0:1782759815.524028:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 3145728 -> 4194304 00000004:00010000:2.0:1782759815.524037:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:2.0:1782759815.524040:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:2.0:1782759815.524043:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:2.0:1782759815.524045:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 6144 -> 8192 00000100:00100000:2.0:1782759815.524144:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218623104:12345-192.168.202.31@tcp:4:dd.0 Request processed in 24189us (24566us total) trans 4294967780 rc 0/0 00000100:00100000:2.0:1782759815.524155:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 30 00002000:00100000:2.0:1782759815.524169:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddcb90ea00 x1869355218623104/t4294967780(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.524178:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddcb90ea00 with x1869355218623104 00000100:00100000:3.0:1782759815.528777:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759815.528955:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623232 00000100:00100000:1.0:1782759815.528974:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623232 00000100:00100000:1.0:1782759815.529052:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3114 00000100:00100000:1.0:1782759815.529062:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218623232:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759815.533818:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967780 is committed 00000100:00100000:1.0:1782759815.534328:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218623232:12345-192.168.202.31@tcp:16:dd.0 Request processed in 5260us (5556us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.534342:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3114 00000100:00100000:1.0:1782759815.567257:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.567461:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623360 00000100:00100000:2.0:1782759815.567472:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623360 00002000:00100000:2.0:1782759815.567543:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49a8380 x1869355218623360/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.567555:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49a8380 with x1869355218623360 00000100:00100000:2.0:1782759815.567649:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 31 00000100:00100000:2.0:1782759815.567694:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218623360:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:0.0:1782759815.585604:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 13 lru_type: 1 00000100:00100000:0.0:1782759815.585665:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120512:0@lo:601:mdt_io00_001.0 00000100:00100000:0.0:1782759815.585742:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759815.585804:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759815.586106:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120512 00000100:00100000:3.0:1782759815.586125:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120512 00000100:00100000:3.0:1782759815.586188:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1782759815.586198:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120512:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:3.0:1782759815.586228:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.586458:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120512:12345-0@lo:601:mdt_io00_001.0 Request processed in 262us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.586466:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1782759815.586740:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120512:0@lo:601:mdt_io00_001.0 00010000:00010000:0.0:1782759815.586778:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 13 lru_type: 1 00010000:00010000:0.0:1782759815.586790:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 14 lru_type: 1 00000004:00010000:0.0:1782759815.590801:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 4194304 -> 5242880 00000004:00010000:0.0:1782759815.590812:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:0.0:1782759815.590814:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:0.0:1782759815.590817:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:0.0:1782759815.590819:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 8192 -> 10240 00000100:00100000:0.0:1782759815.591197:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218623360:12345-192.168.202.31@tcp:4:dd.0 Request processed in 23499us (23945us total) trans 4294967781 rc 0/0 00000100:00100000:0.0:1782759815.591211:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 31 00002000:00100000:0.0:1782759815.591226:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc49a8380 x1869355218623360/t4294967781(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759815.591236:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc49a8380 with x1869355218623360 00000100:00100000:2.0:1782759815.595910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759815.596236:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623488 00000100:00100000:1.0:1782759815.596248:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623488 00000100:00100000:1.0:1782759815.596350:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3115 00000100:00100000:1.0:1782759815.596360:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218623488:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759815.598665:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967781 is committed 00000100:00100000:1.0:1782759815.599363:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218623488:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2998us (3456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.599385:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3115 00000100:00100000:1.0:1782759815.641689:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.642222:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623616 00000100:00100000:2.0:1782759815.642234:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623616 00002000:00100000:2.0:1782759815.642297:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc208d500 x1869355218623616/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.642308:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc208d500 with x1869355218623616 00000100:00100000:2.0:1782759815.642345:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 32 00000100:00100000:2.0:1782759815.642356:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218623616:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:0.0:1782759815.664789:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 14 lru_type: 1 00000100:00100000:0.0:1782759815.670883:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120640:0@lo:601:mdt_io00_002.0 00000100:00100000:0.0:1782759815.671122:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759815.671193:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759815.671355:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120640 00000100:00100000:3.0:1782759815.671364:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120640 00000100:00100000:3.0:1782759815.671433:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1782759815.671443:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120640:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:3.0:1782759815.671472:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.671878:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120640:12345-0@lo:601:mdt_io00_002.0 Request processed in 435us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.671886:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1782759815.674251:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120640:0@lo:601:mdt_io00_002.0 00010000:00010000:0.0:1782759815.674297:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 14 lru_type: 1 00010000:00010000:0.0:1782759815.674312:0:6546:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 15 lru_type: 1 00000004:00010000:0.0:1782759815.676757:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 5242880 -> 6291456 00000004:00010000:0.0:1782759815.676766:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:0.0:1782759815.676769:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:0.0:1782759815.676772:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:0.0:1782759815.676774:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 10240 -> 12288 00000100:00100000:0.0:1782759815.676909:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218623616:12345-192.168.202.31@tcp:4:dd.0 Request processed in 34550us (35237us total) trans 4294967782 rc 0/0 00000100:00100000:0.0:1782759815.676921:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 32 00002000:00100000:0.0:1782759815.676946:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc208d500 x1869355218623616/t4294967782(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759815.676956:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc208d500 with x1869355218623616 00000100:00100000:1.0:1782759815.681301:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.681456:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623744 00000100:00100000:3.0:1782759815.681465:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623744 00000100:00100000:3.0:1782759815.681524:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3116 00000100:00100000:3.0:1782759815.681535:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218623744:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759815.683434:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967782 is committed 00000100:00100000:3.0:1782759815.683798:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218623744:12345-192.168.202.31@tcp:16:dd.0 Request processed in 2258us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.683810:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3116 00000100:00100000:0.0:1782759815.717349:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.718808:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218623872 00000100:00100000:2.0:1782759815.718822:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218623872 00002000:00100000:2.0:1782759815.718891:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc4d06300 x1869355218623872/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:2.0:1782759815.718903:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4d06300 with x1869355218623872 00000100:00100000:2.0:1782759815.719161:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 33 00000100:00100000:2.0:1782759815.719175:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218623872:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:1.0:1782759815.776933:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 15 lru_type: 1 00000100:00100000:1.0:1782759815.777282:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120768:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759815.777352:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759815.777437:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759815.778052:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120768 00000100:00100000:2.0:1782759815.778061:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120768 00000100:00100000:2.0:1782759815.778143:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:2.0:1782759815.778154:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3becc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120768:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:2.0:1782759815.778188:0:66654:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759815.778439:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3becc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233120768:12345-0@lo:601:mdt_io00_001.0 Request processed in 287us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759815.778458:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1782759815.780369:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc208f100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233120768:0@lo:601:mdt_io00_001.0 00010000:00010000:1.0:1782759815.780431:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 15 lru_type: 1 00010000:00010000:1.0:1782759815.780445:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 16 lru_type: 1 00000004:00010000:1.0:1782759815.783175:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 6291456 -> 7340032 00000004:00010000:1.0:1782759815.783187:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.783189:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:1.0:1782759815.783191:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.783194:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 12288 -> 14336 00000100:00100000:1.0:1782759815.784476:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218623872:12345-192.168.202.31@tcp:4:dd.0 Request processed in 65295us (67125us total) trans 4294967783 rc 0/0 00000100:00100000:1.0:1782759815.784490:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 33 00002000:00100000:1.0:1782759815.784505:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc4d06300 x1869355218623872/t4294967783(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759815.784515:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4d06300 with x1869355218623872 00000100:00100000:3.0:1782759815.791177:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.791342:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624000 00000100:00100000:0.0:1782759815.791352:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624000 00000100:00100000:0.0:1782759815.791419:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3117 00000100:00100000:0.0:1782759815.791428:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218624000:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759815.794989:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967783 is committed 00000100:00100000:0.0:1782759815.796530:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218624000:12345-192.168.202.31@tcp:16:dd.0 Request processed in 5092us (5354us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.796545:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3117 00000100:00100000:1.0:1782759815.833140:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.833908:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624128 00000100:00100000:0.0:1782759815.833931:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624128 00002000:00100000:0.0:1782759815.833997:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc208f100 x1869355218624128/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759815.834018:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc208f100 with x1869355218624128 00000100:00100000:0.0:1782759815.834059:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 34 00000100:00100000:0.0:1782759815.834069:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2403:x1869355218624128:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:0.0:1782759815.845432:0:6546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 16 lru_type: 1 00000100:00100000:0.0:1782759815.845485:0:6546:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120896:0@lo:601:mdt_io00_002.0 00000100:00100000:0.0:1782759815.845544:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759815.845615:0:6546:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759815.846930:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233120896 00000100:00100000:1.0:1782759815.846940:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233120896 00000100:00100000:1.0:1782759815.847075:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1782759815.847085:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120896:12345-0@lo:601:mdt_io00_002.0 00040000:00010000:1.0:1782759815.847127:0:6534:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759815.847531:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:6546:x1869355233120896:12345-0@lo:601:mdt_io00_002.0 Request processed in 447us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.847536:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1782759815.847929:0:6546:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000-lwp-MDT0001_UUID:6546:1869355233120896:0@lo:601:mdt_io00_002.0 00010000:00010000:0.0:1782759815.847967:0:6546:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 16 lru_type: 1 00010000:00010000:0.0:1782759815.847979:0:6546:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00000004:00010000:0.0:1782759815.849781:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 7340032 -> 8388608 00000004:00010000:0.0:1782759815.849790:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:0.0:1782759815.849792:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:0.0:1782759815.849794:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:0.0:1782759815.849795:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 14336 -> 16384 00000100:00100000:0.0:1782759815.849882:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc208f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2403:x1869355218624128:12345-192.168.202.31@tcp:4:dd.0 Request processed in 15810us (16748us total) trans 4294967784 rc 0/0 00000100:00100000:0.0:1782759815.849893:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 34 00002000:00100000:0.0:1782759815.849903:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc208f100 x1869355218624128/t4294967784(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759815.849911:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc208f100 with x1869355218624128 00000100:00100000:2.0:1782759815.854176:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759815.854261:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624256 00000100:00100000:3.0:1782759815.854348:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624256 00000100:00100000:3.0:1782759815.854407:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3118 00000100:00100000:3.0:1782759815.854415:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2404:x1869355218624256:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:2.0:1782759815.855946:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967784 is committed 00000100:00100000:3.0:1782759815.856287:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2404:x1869355218624256:12345-192.168.202.31@tcp:16:dd.0 Request processed in 1868us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.856296:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3118 00000100:00100000:0.0:1782759815.881716:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759815.881897:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624384 00000100:00100000:1.0:1782759815.881907:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624384 00002000:00100000:1.0:1782759815.882100:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc4d05180 x1869355218624384/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759815.882867:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4d05180 with x1869355218624384 00000100:00100000:1.0:1782759815.883276:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 35 00000100:00100000:1.0:1782759815.883298:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218624384:12345-192.168.202.31@tcp:4:dd.0 00010000:00010000:2.0:1782759815.898688:0:6545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00000100:00100000:2.0:1782759815.898744:0:6545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233121024:0@lo:601:mdt_io00_001.0 00000100:00100000:2.0:1782759815.899069:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759815.899880:0:6545:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759815.900611:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121024 00000100:00100000:3.0:1782759815.900623:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121024 00000100:00100000:3.0:1782759815.900685:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1782759815.900695:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233121024:12345-0@lo:601:mdt_io00_001.0 00040000:00010000:3.0:1782759815.900734:0:6535:0:(qmt_handler.c:1343:qmt_dqacq()) ### acquire request ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413e00/0xd5b45c7f5c60de85 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60de7e expref: 8 pid: 6535 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759815.901040:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:6545:x1869355233121024:12345-0@lo:601:mdt_io00_001.0 Request processed in 345us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759815.901049:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1782759815.901096:0:6545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_001:lustre-MDT0000-lwp-MDT0001_UUID:6545:1869355233121024:0@lo:601:mdt_io00_001.0 00000100:00100000:1.0:1782759815.901534:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233121152:0@lo:106: 00000100:00100000:1.0:1782759815.901600:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759815.901634:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759815.901651:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121152 00000100:00100000:1.0:1782759815.901656:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121152 00000100:00100000:1.0:1782759815.901690:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1782759815.901698:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233121152:12345-0@lo:106: 00010000:00010000:1.0:1782759815.901710:0:140593:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00010000:00010000:1.0:1782759815.901720:0:140593:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00000100:00100000:1.0:1782759815.901844:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0001+9:6554:x1869355233121152:12345-0@lo:106: Request processed in 146us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759815.901851:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1782759815.902081:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8e00 pname:cluuid:pid:xid:nid:opc:job qmt_reba_lustre:lustre-MDT0000_UUID:6554:1869355233121152:0@lo:106: 00010000:00010000:1.0:1782759815.904213:0:6545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 17 lru_type: 1 00010000:00010000:1.0:1782759815.904236:0:6545:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cdedf803e00/0xd5b45c7f5c60de7e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x186a0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd5b45c7f5c60de85 expref: -99 pid: 6544 timeout: 0 lvb_type: 2 lru_score: 18 lru_type: 1 00000004:00010000:1.0:1782759815.908555:0:6545:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 8388608 -> 9437184 00000004:00010000:1.0:1782759815.908566:0:6545:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.908568:0:6545:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:1.0:1782759815.908570:0:6545:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.908572:0:6545:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 16384 -> 18440 00000100:00100000:1.0:1782759815.908873:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2405:x1869355218624384:12345-192.168.202.31@tcp:4:dd.0 Request processed in 25579us (27160us total) trans 4294967785 rc 0/0 00000100:00100000:1.0:1782759815.908886:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 35 00002000:00100000:1.0:1782759815.908900:0:6545:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_001: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc4d05180 x1869355218624384/t4294967785(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759815.908911:0:6545:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc4d05180 with x1869355218624384 00000100:00100000:1.0:1782759815.914194:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759815.914366:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624512 00000100:00100000:2.0:1782759815.914435:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624512 00000100:00100000:2.0:1782759815.914547:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3119 00000100:00100000:2.0:1782759815.914559:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+9:2402:x1869355218624512:12345-192.168.202.31@tcp:16:dd.0 00000001:00080000:0.0:1782759815.918149:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967785 is committed 00000100:00100000:2.0:1782759815.918466:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218624512:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3904us (4275us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759815.918479:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3119 00000100:00100000:2.0:1782759815.940619:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.940936:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624640 00000100:00100000:0.0:1782759815.940947:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624640 00002000:00100000:0.0:1782759815.941021:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc3d6ce00 x1869355218624640/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/0 e 0 to 0 dl 1782759826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:0.0:1782759815.941039:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc3d6ce00 with x1869355218624640 00000100:00100000:0.0:1782759815.941127:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 36 00000100:00100000:0.0:1782759815.941139:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218624640:12345-192.168.202.31@tcp:4:dd.0 00000004:00010000:1.0:1782759815.955519:0:6546:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb size from disk: 9437184 -> 9437184 00000004:00010000:1.0:1782759815.955530:0:6546:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb mtime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.955532:0:6546:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb atime from disk: 1782759815 -> 1782759815 00000004:00010000:1.0:1782759815.955535:0:6546:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb ctime from disk: 1782759816 -> 1782759816 00000004:00010000:1.0:1782759815.955537:0:6546:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x240000405:0x2f:0x0] updating lvb blocks from disk: 18440 -> 18440 00000100:00100000:1.0:1782759815.957666:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218624640:12345-192.168.202.31@tcp:4:dd.0 Request processed in 16518us (17086us total) trans 0 rc -122/-122 00000100:00100000:1.0:1782759815.957701:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 36 00002000:00100000:1.0:1782759815.957715:0:6546:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0001 mdt_io00_002: refresh rw locks for [0x240000405:0x2f:0x0] req@ffff8cddc3d6ce00 x1869355218624640/t0(0) o4->e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0@192.168.202.31@tcp:221/0 lens 488/448 e 0 to 0 dl 1782759826 ref 1 fl Complete:/600/0 rc -122/-122 job:'dd.0' uid:0 gid:0 projid:65534 00002000:00100000:1.0:1782759815.957726:0:6546:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8cddc3d6ce00 with x1869355218624640 00000100:00100000:1.0:1782759815.968859:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759815.969028:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218624768 00000100:00100000:0.0:1782759815.969038:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218624768 00000100:00100000:0.0:1782759815.969098:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3120 00000100:00100000:0.0:1782759815.972189:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218624768:12345-192.168.202.31@tcp:16:dd.0 00000100:00100000:0.0:1782759815.972355:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218624768:12345-192.168.202.31@tcp:16:dd.0 Request processed in 3246us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759815.972366:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3120 00000100:00100000:2.0:1782759815.978651:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759815.978694:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625024 00000100:00100000:1.0:1782759815.978704:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625024 00000100:00100000:1.0:1782759815.978882:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 458 00000100:00100000:1.0:1782759815.978894:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:115307:x1869355218625024:12345-192.168.202.31@tcp:35:dd.0 00000100:00100000:1.0:1782759815.979574:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115307:x1869355218625024:12345-192.168.202.31@tcp:35:dd.0 Request processed in 681us (931us total) trans 4294967786 rc 0/0 00000100:00100000:1.0:1782759815.979610:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 458 00000100:00100000:0.0:1782759816.077221:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233121280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759816.077320:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759816.077671:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121280 00000100:00100000:2.0:1782759816.077680:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121280 00000100:00100000:2.0:1782759816.077766:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:2.0:1782759816.077779:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233121280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759816.077819:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759816.077885:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4a93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233121280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759816.077911:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:0.0:1782759816.078167:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233121280:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759816.141088:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759817.099903:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233121536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100068:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233121408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100126:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100189:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233121920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100219:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100239:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233122432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100276:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100294:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233122944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100316:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100349:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233121664:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100376:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100393:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233122176:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100420:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100439:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233122688:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100460:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100478:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759817.100484:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233121792:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100505:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100521:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233122304:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100541:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100556:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233122816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100599:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759817.100629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121408 00000100:00100000:3.0:1782759817.100636:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121408 00000100:00100000:3.0:1782759817.100681:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3447 00000100:00100000:3.0:1782759817.100690:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233121408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100741:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233121408:12345-0@lo:400:kworker.0 Request processed in 51us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.100748:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3447 00000100:00100000:3.0:1782759817.100783:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121920 00000100:00100000:3.0:1782759817.100787:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121920 00000100:00100000:3.0:1782759817.100826:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121664 00000100:00100000:3.0:1782759817.100829:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121664 00000100:00100000:3.0:1782759817.100843:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520 00000100:00100000:3.0:1782759817.100849:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233121920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100885:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233121920:12345-0@lo:400:kworker.0 Request processed in 36us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.100892:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520 00000100:00100000:3.0:1782759817.100903:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521 00000100:00100000:3.0:1782759817.100909:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233121664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.100940:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233121664:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.100945:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521 00000100:00100000:3.0:1782759817.100962:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122432 00000100:00100000:3.0:1782759817.100966:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122432 00000100:00100000:3.0:1782759817.101425:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122944 00000100:00100000:3.0:1782759817.101430:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122944 00000100:00100000:3.0:1782759817.101444:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122304 00000100:00100000:3.0:1782759817.101447:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122304 00000100:00100000:3.0:1782759817.101458:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122816 00000100:00100000:3.0:1782759817.101460:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122816 00000100:00100000:3.0:1782759817.101484:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3249 00000100:00100000:3.0:1782759817.101489:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233122432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101529:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233122432:12345-0@lo:400:kworker.0 Request processed in 39us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101535:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3249 00000100:00100000:3.0:1782759817.101547:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3250 00000100:00100000:3.0:1782759817.101553:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233122944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101606:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233122944:12345-0@lo:400:kworker.0 Request processed in 53us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101613:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3250 00000100:00100000:3.0:1782759817.101624:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1782759817.101630:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233122304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101657:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233122304:12345-0@lo:400:kworker.0 Request processed in 28us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101663:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3251 00000100:00100000:3.0:1782759817.101674:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3252 00000100:00100000:3.0:1782759817.101679:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233122816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101704:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233122816:12345-0@lo:400:kworker.0 Request processed in 26us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101710:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3252 00000100:00100000:3.0:1782759817.101737:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122176 00000100:00100000:3.0:1782759817.101741:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122176 00000100:00100000:3.0:1782759817.101770:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122688 00000100:00100000:3.0:1782759817.101774:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122688 00000100:00100000:3.0:1782759817.101791:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121792 00000100:00100000:3.0:1782759817.101794:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121792 00000100:00100000:3.0:1782759817.101812:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5516 00000100:00100000:3.0:1782759817.101818:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233122176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101849:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233122176:12345-0@lo:400:kworker.0 Request processed in 31us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101854:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5516 00000100:00100000:3.0:1782759817.101865:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5517 00000100:00100000:3.0:1782759817.101871:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233122688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101898:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233122688:12345-0@lo:400:kworker.0 Request processed in 28us (1438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101904:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5517 00000100:00100000:3.0:1782759817.101915:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5518 00000100:00100000:3.0:1782759817.101921:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233121792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759817.101948:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233121792:12345-0@lo:400:kworker.0 Request processed in 27us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759817.101953:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5518 00000100:00100000:0.0:1782759817.102160:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759817.113223:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233122048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113301:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759817.113334:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233122560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113357:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759817.113405:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233121536 00000100:00100000:0.0:1782759817.113412:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233121536 00000100:00100000:0.0:1782759817.113448:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122048 00000100:00100000:0.0:1782759817.113451:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122048 00000100:00100000:0.0:1782759817.113467:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233122560 00000100:00100000:0.0:1782759817.113469:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233122560 00000100:00100000:0.0:1782759817.113483:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5519 00000100:00100000:0.0:1782759817.113491:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233121536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113544:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233121536:12345-0@lo:400:kworker.0 Request processed in 53us (11384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759817.113551:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5519 00000100:00100000:0.0:1782759817.113567:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5520 00000100:00100000:0.0:1782759817.113573:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233122048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113622:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233122048:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759817.113628:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5520 00000100:00100000:0.0:1782759817.113640:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5521 00000100:00100000:0.0:1782759817.113646:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233122560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113672:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233122560:12345-0@lo:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759817.113677:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5521 00000100:00100000:0.0:1782759817.113714:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233121536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113725:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233122048:0@lo:400:kworker.0 00000100:00100000:0.0:1782759817.113733:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233122560:0@lo:400:kworker.0 00000100:00080000:1.0:1782759817.114428:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759817.114434:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759817.114437:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759817.114440:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759817.114479:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233121792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114493:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233122304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114504:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233122816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114516:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233121664:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114527:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233122176:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114538:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233122688:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114597:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233121408:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114627:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233121920:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114639:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233122432:0@lo:400:kworker.0 00000100:00100000:1.0:1782759817.114650:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233122944:0@lo:400:kworker.0 00010000:00010000:1.0:1782759817.162793:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759817.612207:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759817.612278:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759817.612352:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123072 00000100:00100000:2.0:1782759817.612360:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123072 00000100:00100000:2.0:1782759817.612412:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1782759817.612420:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233123200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759817.612422:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233123072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759817.612449:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759817.612449:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759817.612505:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233123072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759817.612512:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:2.0:1782759817.612527:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123200 00000100:00100000:2.0:1782759817.612530:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123200 00000100:00100000:1.0:1782759817.612533:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233123072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759817.612551:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:2.0:1782759817.612558:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233123200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759817.612569:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759817.612617:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233123200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759817.612623:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00000100:00100000:1.0:1782759817.612628:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233123200:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782759818.188553:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759818.634849:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759818.634874:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233123328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759818.635077:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759818.636062:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233123456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759818.636110:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759818.636666:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233123584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759818.636704:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759818.636754:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123584 00000100:00100000:3.0:1782759818.636761:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123584 00000100:00100000:3.0:1782759818.636817:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522 00000100:00100000:3.0:1782759818.636825:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233123584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759818.636860:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 27901952 pending 0 free 1436676096 avail 1290436608 00000100:00100000:3.0:1782759818.636915:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233123584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759818.636923:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522 00000100:00100000:3.0:1782759818.637209:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233123584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759818.642546:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123328 00000100:00100000:3.0:1782759818.642561:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123328 00000100:00100000:3.0:1782759818.642752:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123456 00000100:00100000:3.0:1782759818.642756:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123456 00000100:00100000:3.0:1782759818.642784:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:3.0:1782759818.642793:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233123328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759818.642825:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759818.642892:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233123328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (7815us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759818.642899:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1782759818.643311:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1782759818.643323:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233123456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759818.643336:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759818.643450:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233123456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (7340us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759818.643457:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00000100:00100000:1.0:1782759818.643505:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233123328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759818.644158:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233123456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759818.972717:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759818.972754:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759818.972787:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759818.972820:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759818.972849:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759818.972886:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625408 00000100:00100000:2.0:1782759818.972895:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625408 00000100:00100000:2.0:1782759818.972962:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5522 00000100:00100000:2.0:1782759818.973000:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218625408:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759818.973018:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625280 00000100:00100000:0.0:1782759818.973024:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625280 00000100:00100000:0.0:1782759818.973062:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5523 00000100:00100000:0.0:1782759818.973071:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218625280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759818.973090:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2402:x1869355218625408:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759818.973099:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5522 00000100:00100000:0.0:1782759818.973108:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2402:x1869355218625280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759818.973117:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5523 00000100:00080000:2.0:1782759818.973123:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759818.973129:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759818.974048:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625664 00000100:00100000:1.0:1782759818.974056:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625664 00000100:00100000:1.0:1782759818.974108:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625536 00000100:00100000:1.0:1782759818.974111:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625536 00000100:00100000:1.0:1782759818.974135:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3253 00000100:00100000:1.0:1782759818.974144:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218625664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759818.974198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625152 00000100:00100000:1.0:1782759818.974200:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218625664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 57us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759818.974205:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625152 00000100:00100000:1.0:1782759818.974211:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3253 00000100:00100000:3.0:1782759818.974325:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3448 00000100:00100000:3.0:1782759818.974334:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218625152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759818.974364:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218625152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759818.974370:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3448 00000100:00100000:3.0:1782759818.974407:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3254 00000100:00100000:3.0:1782759818.974414:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218625536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759818.974441:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2402:x1869355218625536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759818.974447:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3254 00000100:00080000:0.0:1782759818.974657:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759818.974662:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759819.147000:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759819.147024:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233123712:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1782759819.147162:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759819.147346:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123712 00000100:00100000:2.0:1782759819.147354:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123712 00000100:00100000:2.0:1782759819.147416:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:2.0:1782759819.147435:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233123712:12345-0@lo:601:lquota_wb_lustr.0 00000100:00080000:1.0:1782759819.147441:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759819.147520:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233123712:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 96us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759819.147528:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1782759819.148490:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233123712:0@lo:601:lquota_wb_lustr.0 00010000:00010000:3.0:1782759819.211008:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759820.234780:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759821.195476:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759821.195500:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233123840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759821.195569:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759821.195757:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123840 00000100:00100000:2.0:1782759821.195766:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123840 00000100:00100000:2.0:1782759821.195847:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523 00000100:00100000:2.0:1782759821.195858:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233123840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759821.196132:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759821.196195:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233123840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 340us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759821.196202:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523 00000100:00100000:3.0:1782759821.196272:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233123840:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759821.260689:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782759821.708185:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967786 is committed 00000100:00100000:0.0:1782759822.220340:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233124352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.220408:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759822.220465:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233124864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.220488:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759822.220503:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233125376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.220519:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759822.220540:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759822.220545:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233124224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.220563:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759822.220785:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124352 00000100:00100000:2.0:1782759822.220792:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124352 00000100:00100000:2.0:1782759822.220849:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5524 00000100:00100000:2.0:1782759822.220872:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233124352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759822.220930:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233124352:12345-0@lo:400:kworker.0 Request processed in 61us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759822.220937:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5524 00000100:00100000:0.0:1782759822.221110:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233124736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.221134:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759822.221193:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124224 00000100:00100000:2.0:1782759822.221197:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124224 00000100:00100000:2.0:1782759822.221235:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3524 00000100:00100000:2.0:1782759822.221241:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233124224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759822.221270:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233124224:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759822.221276:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3524 00000100:00100000:0.0:1782759822.221325:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233125248:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.221346:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.221629:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233123968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.221662:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.221683:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233124480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.221702:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.221716:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233124992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.221740:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.221752:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233125504:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.221767:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.221782:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759822.221786:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233124096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.221814:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124480 00000100:00100000:3.0:1782759822.221817:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124480 00000100:00100000:3.0:1782759822.221844:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525 00000100:00100000:3.0:1782759822.221849:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233124480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.223806:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233124480:12345-0@lo:400:kworker.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.223821:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525 00000100:00100000:3.0:1782759822.223871:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233123968 00000100:00100000:3.0:1782759822.223890:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233123968 00000100:00100000:3.0:1782759822.223934:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3449 00000100:00100000:3.0:1782759822.223942:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233123968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.224035:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233123968:12345-0@lo:400:kworker.0 Request processed in 94us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.224042:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3449 00000100:00100000:3.0:1782759822.224081:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124864 00000100:00100000:3.0:1782759822.224084:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124864 00000100:00100000:3.0:1782759822.224120:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233125376 00000100:00100000:3.0:1782759822.224123:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233125376 00000100:00100000:3.0:1782759822.224137:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124992 00000100:00100000:3.0:1782759822.224139:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124992 00000100:00100000:3.0:1782759822.224150:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233125504 00000100:00100000:3.0:1782759822.224153:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233125504 00000100:00100000:3.0:1782759822.224178:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3255 00000100:00100000:3.0:1782759822.224185:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233124864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.224221:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233124864:12345-0@lo:400:kworker.0 Request processed in 37us (3732us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.224226:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3255 00000100:00100000:3.0:1782759822.224239:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3256 00000100:00100000:3.0:1782759822.224245:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233125376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.224272:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233125376:12345-0@lo:400:kworker.0 Request processed in 27us (3752us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.224277:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3256 00000100:00100000:3.0:1782759822.224287:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3257 00000100:00100000:3.0:1782759822.224293:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233124992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.224320:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233124992:12345-0@lo:400:kworker.0 Request processed in 28us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.224325:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3257 00000100:00100000:3.0:1782759822.224334:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3258 00000100:00100000:3.0:1782759822.224339:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233125504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.224364:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233125504:12345-0@lo:400:kworker.0 Request processed in 24us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.224369:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3258 00000100:00080000:3.0:1782759822.224396:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759822.224401:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759822.225461:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233124352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.225479:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233124864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.225491:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233125376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.225525:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233124224:0@lo:400:kworker.0 00000100:00100000:1.0:1782759822.228004:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124736 00000100:00100000:1.0:1782759822.228020:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124736 00000100:00100000:3.0:1782759822.231195:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233125248 00000100:00100000:3.0:1782759822.231209:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233125248 00000100:00100000:3.0:1782759822.231287:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5525 00000100:00100000:3.0:1782759822.231298:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233125248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231401:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233125248:12345-0@lo:400:kworker.0 Request processed in 106us (10053us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.231409:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5525 00000100:00100000:3.0:1782759822.231440:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.231475:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233124608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231509:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.231525:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233125120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231546:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759822.231608:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233123968:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231624:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233124480:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231637:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233124992:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231648:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233125504:0@lo:400:kworker.0 00000100:00080000:3.0:1782759822.231684:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759822.231696:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124096 00000100:00100000:3.0:1782759822.231700:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124096 00000100:00100000:3.0:1782759822.231722:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233124608 00000100:00100000:3.0:1782759822.231725:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233124608 00000100:00100000:3.0:1782759822.231742:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233125120 00000100:00100000:3.0:1782759822.231744:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233125120 00000100:00100000:3.0:1782759822.231765:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5526 00000100:00100000:3.0:1782759822.231772:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233124096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231811:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233124096:12345-0@lo:400:kworker.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.231817:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5526 00000100:00100000:3.0:1782759822.231830:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5527 00000100:00100000:3.0:1782759822.231835:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233124608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231859:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233124608:12345-0@lo:400:kworker.0 Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.231865:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5527 00000100:00100000:3.0:1782759822.231874:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5528 00000100:00100000:3.0:1782759822.231893:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233125120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231922:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233125120:12345-0@lo:400:kworker.0 Request processed in 43us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759822.231928:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5528 00000100:00080000:3.0:1782759822.231960:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759822.231978:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233124096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231987:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233124608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.231995:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233125120:0@lo:400:kworker.0 00000100:00100000:3.0:1782759822.232030:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233125248:0@lo:400:kworker.0 00000100:00080000:0.0:1782759822.232534:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759822.232592:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5529 00000100:00100000:0.0:1782759822.232601:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233124736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759822.232648:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233124736:12345-0@lo:400:kworker.0 Request processed in 49us (11513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759822.232654:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5529 00000100:00100000:3.0:1782759822.232808:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233124736:0@lo:400:kworker.0 00010000:00010000:0.0:1782759822.282737:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759822.731382:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759822.731404:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233125760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759822.731466:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759822.731474:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759822.731482:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233125632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759822.731523:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759822.731567:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233125760 00000100:00100000:0.0:1782759822.731596:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233125760 00000100:00100000:0.0:1782759822.731639:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233125632 00000100:00100000:0.0:1782759822.731643:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233125632 00000100:00100000:0.0:1782759822.731666:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00000100:00100000:0.0:1782759822.731674:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233125760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759822.731706:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759822.731727:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00000100:00100000:2.0:1782759822.731747:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233125632:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759822.731755:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233125760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (283us total) trans 0 rc 0/0 00002000:00000024:2.0:1782759822.731760:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759822.731764:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00000100:00100000:2.0:1782759822.732249:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233125632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 513us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759822.732258:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1782759822.732324:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233125760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759822.732365:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233125632:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1782759823.291956:0:161305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed1fbfa70 20000000:00000080:3.0:1782759823.291977:0:161305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cddc3ecd800 uarg=0000000000000000 20000000:01000000:3.0:1782759823.292090:0:161305:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782759823.292093:0:161305:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782759823.292096:0:161305:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.mdt=none' 20000000:01000000:3.0:1782759823.292101:0:161305:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.mdt=none' 20000000:01000000:3.0:1782759823.292106:0:161305:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.mdt=none' 20000000:01000000:3.0:1782759823.292209:0:161305:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1782759823.292211:0:161305:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/quota.mdt fl=4 20000000:01000000:1.0:1782759823.292750:0:161306:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 62 marker 59 1->4: lustre quota.mdt 20000000:01000000:1.0:1782759823.292844:0:161306:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 64 marker 59 2->4: lustre quota.mdt 00000040:00080000:1.0:1782759823.292861:0:161306:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 65 count 64 00000040:00080000:3.0:1782759823.293147:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].65, 224 off19632 00000040:00080000:3.0:1782759823.293173:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].66, 88 off19720 00000040:00080000:3.0:1782759823.293191:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].67, 224 off19944 20000000:01000000:3.0:1782759823.293200:0:161305:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782759823.293201:0:161305:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.mdt fl=4 20000000:01000000:1.0:1782759823.293484:0:161307:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 17 marker 60 1->4: lustre quota.mdt 20000000:01000000:1.0:1782759823.293512:0:161307:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 19 marker 60 2->4: lustre quota.mdt 00000040:00080000:1.0:1782759823.293526:0:161307:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 20 count 20 00000040:00080000:3.0:1782759823.297550:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11800 00000040:00080000:3.0:1782759823.297612:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 88 off11888 00000040:00080000:3.0:1782759823.297632:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12112 20000000:01000000:3.0:1782759823.297646:0:161305:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782759823.297648:0:161305:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.mdt fl=4 20000000:01000000:1.0:1782759823.298254:0:161308:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 62 marker 61 1->4: lustre quota.mdt 20000000:01000000:1.0:1782759823.298298:0:161308:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 64 marker 61 2->4: lustre quota.mdt 00000040:00080000:1.0:1782759823.298313:0:161308:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 65 count 64 00000040:00080000:3.0:1782759823.298512:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].65, 224 off19632 00000040:00080000:3.0:1782759823.298535:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].66, 88 off19720 00000040:00080000:3.0:1782759823.298553:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].67, 224 off19944 20000000:01000000:3.0:1782759823.298563:0:161305:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782759823.298565:0:161305:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.mdt fl=4 20000000:01000000:1.0:1782759823.299100:0:161309:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 14 marker 62 1->4: lustre quota.mdt 20000000:01000000:1.0:1782759823.299139:0:161309:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 62 2->4: lustre quota.mdt 00000040:00080000:1.0:1782759823.299153:0:161309:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 17 count 17 00000040:00080000:3.0:1782759823.299323:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11272 00000040:00080000:3.0:1782759823.299344:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 88 off11360 00000040:00080000:3.0:1782759823.299359:0:161305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 224 off11584 10000000:01000000:3.0:1782759823.299373:0:161305:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782759823.299392:0:161305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299411:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299420:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299427:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299439:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299446:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299453:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299460:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299467:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299474:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299483:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299490:0:161305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299498:0:161305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299537:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299556:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 9 pid: 6524 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.299572:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233125888:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759823.299808:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299817:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.299826:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126016:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759823.299861:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.299869:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 23 pid: 6524 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.299878:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126144:0@lo:104: 00000100:00100000:3.0:1782759823.299918:0:161305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759823.299996:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300004:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300085:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126272:0@lo:104: 00000100:00100000:3.0:1782759823.300110:0:161305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759823.300141:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300149:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300157:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126400:0@lo:104: 00000100:00100000:3.0:1782759823.300177:0:161305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759823.300198:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300206:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300214:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126528:0@lo:104: 00000100:00100000:3.0:1782759823.300236:0:161305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759823.300256:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300263:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300271:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126656:0@lo:104: 00000100:00100000:3.0:1782759823.300290:0:161305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759823.300306:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300313:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 23 pid: 6525 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300322:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126784:0@lo:104: 00000100:00100000:3.0:1782759823.300344:0:161305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759823.300361:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300368:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300375:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126912:0@lo:104: 00010000:00010000:3.0:1782759823.300399:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300407:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300414:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233127040:0@lo:104: 00010000:00010000:3.0:1782759823.300436:0:161305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759823.300445:0:161305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 23 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.300452:0:161305:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233127168:0@lo:104: 00000100:00100000:3.0:1782759823.300469:0:161305:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759823.300550:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782759823.300569:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.300612:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.300621:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.300630:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126144 00000100:00100000:0.0:1782759823.300635:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126144 00000100:00100000:0.0:1782759823.300685:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126272 00000100:00100000:0.0:1782759823.300689:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126272 00000100:00100000:0.0:1782759823.300699:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126400 00000100:00100000:0.0:1782759823.300702:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126400 00000100:00100000:0.0:1782759823.300709:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126528 00000100:00100000:0.0:1782759823.300711:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126528 00000100:00100000:0.0:1782759823.300718:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126656 00000100:00100000:0.0:1782759823.300720:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126656 00000100:00100000:0.0:1782759823.300728:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126784 00000100:00100000:0.0:1782759823.300730:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126784 00000100:00100000:0.0:1782759823.300740:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233126912 00000100:00100000:0.0:1782759823.300742:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233126912 00000100:00100000:0.0:1782759823.300751:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127040 00000100:00100000:0.0:1782759823.300753:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127040 00000100:00100000:0.0:1782759823.300760:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127168 00000100:00100000:0.0:1782759823.300761:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127168 00000100:00100000:0.0:1782759823.300773:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1782759823.300781:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+11:161305:x1869355233126144:12345-0@lo:104: 00010000:00010000:0.0:1782759823.300792:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.300847:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759823.300852:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+11:161305:x1869355233126144:12345-0@lo:104: Request processed in 73us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.300859:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1782759823.300875:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1782759823.300934:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+10:161305:x1869355233126272:12345-0@lo:104: 00010000:00010000:0.0:1782759823.300953:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.300987:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782759823.300993:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+10:161305:x1869355233126272:12345-0@lo:104: Request processed in 113us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.300998:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:0.0:1782759823.301011:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1782759823.301031:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+9:161305:x1869355233126400:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301038:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301072:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782759823.301077:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+9:161305:x1869355233126400:12345-0@lo:104: Request processed in 48us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301083:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1782759823.301096:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1782759823.301102:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+8:161305:x1869355233126528:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301109:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301134:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782759823.301139:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+8:161305:x1869355233126528:12345-0@lo:104: Request processed in 39us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301144:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1782759823.301156:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1782759823.301161:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+7:161305:x1869355233126656:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301168:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301192:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1782759823.301197:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+7:161305:x1869355233126656:12345-0@lo:104: Request processed in 36us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301202:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1782759823.301213:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1782759823.301218:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb718450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+6:161305:x1869355233126784:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301225:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301250:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1782759823.301254:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb718450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+6:161305:x1869355233126784:12345-0@lo:104: Request processed in 37us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301259:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1782759823.301286:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1782759823.301293:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+5:161305:x1869355233126912:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301299:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301324:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1782759823.301328:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+5:161305:x1869355233126912:12345-0@lo:104: Request processed in 37us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301334:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1782759823.301346:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1782759823.301351:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:161305:x1869355233127040:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301357:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301380:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1782759823.301385:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+4:161305:x1869355233127040:12345-0@lo:104: Request processed in 35us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301390:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1782759823.301400:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1782759823.301405:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:161305:x1869355233127168:12345-0@lo:104: 00010000:00010000:0.0:1782759823.301411:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301435:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1782759823.301440:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:161305:x1869355233127168:12345-0@lo:104: Request processed in 35us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.301446:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00010000:00010000:0.0:1782759823.301464:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1782759823.301469:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301476:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301480:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301489:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301496:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301501:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.301532:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301543:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.301562:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301570:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5200/0xd5b45c7f5c60d6d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301607:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1782759823.301611:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301616:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301619:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301626:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301632:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301638:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.301651:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301657:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.301673:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301680:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5a00/0xd5b45c7f5c60d6c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6cf expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301690:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1782759823.301693:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301699:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301701:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301707:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301713:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301718:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.301730:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301736:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.301741:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301748:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de5600/0xd5b45c7f5c60d6ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6c1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301757:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782759823.301759:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301769:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd4dc800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301772:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301777:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301783:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301787:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.301796:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301801:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.301806:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301812:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd4dc800/0xd5b45c7f5c60d6ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6b3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301820:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782759823.301823:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301829:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301832:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301843:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301849:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301854:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.301864:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301870:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.301874:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301881:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb767200/0xd5b45c7f5c60d69e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d6a5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301890:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782759823.301892:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301897:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301900:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301906:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301912:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301917:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.301928:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301933:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.301950:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301957:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766000/0xd5b45c7f5c60d690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d697 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301966:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782759823.301969:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301975:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.301977:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.301983:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.301989:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.301994:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.302006:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302012:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.302017:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302023:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedb766800/0xd5b45c7f5c60d67b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d682 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302031:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782759823.302034:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302040:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.302042:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302048:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.302054:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.302059:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.302070:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302076:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.302080:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302086:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc3de4000/0xd5b45c7f5c60d658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d65f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302094:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759823.302097:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302103:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5428a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759823.302106:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302112:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759823.302118:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759823.302123:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1782759823.302133:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302139:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759823.302143:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302150:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5428a00/0xd5b45c7f5c60d64a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60d651 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302162:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759823.302164:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759823.302166:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759823.302175:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759823.302181:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759823.302203:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233127296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302240:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302262:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233127808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302281:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302296:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233128320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302315:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302367:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759823.302373:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233127680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302397:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302413:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233128192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302430:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302460:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233127424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302480:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302498:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233127936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302534:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302546:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782759823.302551:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233127552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302572:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302603:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233128064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.302622:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759823.302659:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127296 00000100:00100000:0.0:1782759823.302665:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127296 00010000:00010000:0.0:1782759823.302691:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 24 pid: 6524 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302710:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127808 00000100:00100000:0.0:1782759823.302712:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127808 00010000:00010000:0.0:1782759823.302722:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 25 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302732:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128320 00000100:00100000:0.0:1782759823.302735:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128320 00010000:00010000:0.0:1782759823.302743:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 26 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302752:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127680 00000100:00100000:0.0:1782759823.302754:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127680 00010000:00010000:0.0:1782759823.302764:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 27 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302774:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128192 00000100:00100000:0.0:1782759823.302776:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128192 00010000:00010000:0.0:1782759823.302784:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 28 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302793:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127424 00000100:00100000:0.0:1782759823.302796:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127424 00010000:00010000:0.0:1782759823.302805:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 29 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302813:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127936 00000100:00100000:0.0:1782759823.302816:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127936 00010000:00010000:0.0:1782759823.302824:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 30 pid: 6525 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302832:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233127552 00000100:00100000:0.0:1782759823.302834:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233127552 00010000:00010000:0.0:1782759823.302841:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 31 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302849:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128064 00000100:00100000:0.0:1782759823.302851:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128064 00010000:00010000:0.0:1782759823.302858:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 32 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.302869:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1782759823.302876:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+32:3663:x1869355233127296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.302887:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.302891:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 32 pid: 6524 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302900:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 32 pid: 6524 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302915:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.302951:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+32:3663:x1869355233127296:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.302958:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:0.0:1782759823.302971:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1782759823.302976:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+31:3663:x1869355233127808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.302983:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.302987:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 31 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.302995:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 31 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303003:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303020:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+31:3663:x1869355233127808:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303029:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1782759823.303038:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1782759823.303043:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+30:3663:x1869355233128320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303049:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303052:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 30 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303060:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 30 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303068:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303084:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+30:3663:x1869355233128320:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303090:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00100000:0.0:1782759823.303100:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1782759823.303105:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+29:3663:x1869355233127680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303111:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303114:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 29 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303121:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 29 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303129:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303148:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+29:3663:x1869355233127680:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303154:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:0.0:1782759823.303167:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1782759823.303173:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+28:3663:x1869355233128192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303179:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303183:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 28 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303191:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 28 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303199:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303218:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+28:3663:x1869355233128192:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303224:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:0.0:1782759823.303237:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1782759823.303242:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+27:3664:x1869355233127424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303250:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303254:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 27 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303261:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 27 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303270:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303294:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+27:3664:x1869355233127424:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303299:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:0.0:1782759823.303310:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1782759823.303315:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+26:3664:x1869355233127936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303324:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303327:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 26 pid: 6525 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303335:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 26 pid: 6525 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303343:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303358:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+26:3664:x1869355233127936:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303363:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1782759823.303388:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1782759823.303393:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+25:3664:x1869355233127552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303398:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303402:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 25 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303409:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 25 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303417:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303431:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+25:3664:x1869355233127552:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303436:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1782759823.303444:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1782759823.303449:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233128064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.303454:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.303458:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 24 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303465:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 24 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.303473:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.303491:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233128064:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.303496:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1782759823.303549:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233127552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303557:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233128064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303564:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233127424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303570:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233127936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303624:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233127680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303630:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233128192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303636:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233127296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303641:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233127808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759823.303648:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233128320:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759823.303826:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428e00/0xd5b45c7f5c60d6dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6d6 expref: 23 pid: 6524 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303839:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126144:0@lo:104: 00010000:00010000:3.0:1782759823.303848:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4a00/0xd5b45c7f5c60d6cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6c8 expref: 22 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303860:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126272:0@lo:104: 00010000:00010000:3.0:1782759823.303868:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4600/0xd5b45c7f5c60d6c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ba expref: 21 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303874:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126400:0@lo:104: 00010000:00010000:3.0:1782759823.303882:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dce00/0xd5b45c7f5c60d6b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d6ac expref: 20 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303889:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126528:0@lo:104: 00010000:00010000:3.0:1782759823.303897:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4400/0xd5b45c7f5c60d6a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d69e expref: 19 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303904:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126656:0@lo:104: 00010000:00010000:3.0:1782759823.303912:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767600/0xd5b45c7f5c60d697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d690 expref: 18 pid: 6525 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303919:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126784:0@lo:104: 00010000:00010000:3.0:1782759823.303926:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedb767400/0xd5b45c7f5c60d682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d67b expref: 17 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303933:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126912:0@lo:104: 00010000:00010000:3.0:1782759823.303953:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428400/0xd5b45c7f5c60d65f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d658 expref: 16 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303960:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233127040:0@lo:104: 00010000:00010000:3.0:1782759823.303968:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5429400/0xd5b45c7f5c60d651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60d64a expref: 15 pid: 6526 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.303976:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233127168:0@lo:104: 00010000:00010000:0.0:1782759823.306970:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759823.309889:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759823.310018:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233125888:192.168.202.31@tcp:104: 00000100:00100000:0.0:1782759823.310140:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625792 00000100:00100000:0.0:1782759823.310149:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625792 00010000:00010000:0.0:1782759823.310194:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 10 pid: 6524 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.310244:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 887 00000100:00100000:0.0:1782759823.310253:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218625792:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.310270:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.310276:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 10 pid: 6524 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.310288:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 10 pid: 6524 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.310308:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc3de4e00/0xd5b45c7f5c60d6eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c9 expref: 10 pid: 6524 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.310325:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.310417:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2403:x1869355218625792:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 164us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.310425:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 887 00000100:00100000:1.0:1782759823.311220:0:161305:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161305:1869355233126016:192.168.202.31@tcp:104: 00010000:00010000:1.0:1782759823.311291:0:161305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759823.311832:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759823.311966:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218625920 00000100:00100000:0.0:1782759823.311971:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218625920 00010000:00010000:0.0:1782759823.311997:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759823.312040:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 888 00000100:00100000:0.0:1782759823.312048:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2403:x1869355218625920:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759823.312061:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759823.312066:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312081:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312113:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5428800/0xd5b45c7f5c60d6e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb275c2 expref: 9 pid: 6525 timeout: 3963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312127:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312135:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312150:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312157:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312165:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312172:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312178:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759823.312182:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312191:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312215:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759823.312224:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759823.312272:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2403:x1869355218625920:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 224us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759823.312280:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 888 00010000:00010000:1.0:1782759823.312333:0:161305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759823.312360:0:161305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759823.312366:0:161305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60df6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759823.754854:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233128448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759823.754986:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759823.755238:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128448 00000100:00100000:1.0:1782759823.755247:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128448 00000100:00100000:1.0:1782759823.755302:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:1.0:1782759823.755312:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233128448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759823.755357:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759823.755409:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233128448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759823.755416:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00000100:00100000:1.0:1782759823.755464:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233128448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759823.755783:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233128704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759823.755817:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759823.755852:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128704 00000100:00100000:3.0:1782759823.755953:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233128576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759823.755985:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759823.756024:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128576 00000100:00100000:3.0:1782759823.756028:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128576 00000100:00100000:3.0:1782759823.756069:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:3.0:1782759823.756077:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233128576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759823.756091:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759823.756125:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233128576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759823.756131:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00000100:00100000:3.0:1782759823.756163:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233128576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759823.756292:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128704 00000100:00100000:1.0:1782759823.756423:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3526 00000100:00100000:1.0:1782759823.756432:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233128704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759823.756456:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 27901952 pending 0 free 1436676096 avail 1290436608 00000100:00100000:1.0:1782759823.756502:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233128704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759823.756508:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3526 00000100:00100000:2.0:1782759823.756601:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc44f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233128704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759824.093305:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759824.093370:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759824.093415:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759824.093481:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759824.093511:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759824.093545:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626304 00000100:00100000:2.0:1782759824.093556:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626304 00000100:00100000:2.0:1782759824.093685:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626176 00000100:00100000:2.0:1782759824.093689:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626176 00000100:00100000:2.0:1782759824.093717:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5530 00000100:00100000:2.0:1782759824.093729:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218626304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759824.093808:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218626304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 82us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759824.093816:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5530 00000100:00100000:2.0:1782759824.093832:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5531 00000100:00100000:2.0:1782759824.093840:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218626176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759824.094126:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626048 00000100:00100000:3.0:1782759824.094131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626048 00000100:00100000:3.0:1782759824.094164:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3450 00000100:00100000:3.0:1782759824.094171:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2405:x1869355218626048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759824.094200:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2405:x1869355218626048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759824.094206:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3450 00000100:00100000:1.0:1782759824.094780:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626560 00000100:00100000:1.0:1782759824.094800:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626560 00000100:00100000:1.0:1782759824.094840:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626432 00000100:00100000:1.0:1782759824.094843:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626432 00000100:00100000:1.0:1782759824.094880:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3259 00000100:00100000:1.0:1782759824.094889:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218626560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759824.094938:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218626560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759824.094947:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3259 00000100:00100000:1.0:1782759824.095138:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3260 00000100:00100000:1.0:1782759824.095146:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218626432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759824.095175:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218626432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759824.095181:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3260 00000100:00080000:1.0:1782759824.095231:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759824.095742:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759824.095748:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759824.095751:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759824.100249:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218626176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 6388us (6745us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759824.100267:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5531 00010000:00010000:0.0:1782759824.338363:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759825.166811:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759825.166819:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 64 10000000:01000000:3.0:1782759825.166826:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759825.166872:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.166884:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.166896:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759825.166931:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233128832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.167050:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759825.167105:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c900 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.167300:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128832 00000100:00100000:0.0:1782759825.167307:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128832 00000100:00100000:0.0:1782759825.167363:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3451 00000100:00100000:0.0:1782759825.167372:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355233128832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759825.167385:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759825.167399:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60df73 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.167422:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.167431:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.167439:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802800, rc 0) 00000100:00100000:0.0:1782759825.167490:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233128832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.167498:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3451 00000100:00100000:0.0:1782759825.167545:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233128832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759825.167558:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.167567:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759825.167658:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233128960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.167708:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.167725:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc46043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.167739:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233128960 00000100:00100000:0.0:1782759825.167754:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233128960 00000100:00100000:0.0:1782759825.167791:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3452 00000100:00100000:0.0:1782759825.167798:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233128960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.167965:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233128960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.167972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3452 00000100:00100000:0.0:1782759825.168005:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233128960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.168259:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.168303:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.168356:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc46043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.173691:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129088 00000100:00100000:3.0:1782759825.173706:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129088 00000100:00100000:2.0:1782759825.181114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3453 00000100:00100000:2.0:1782759825.181133:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233129088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.181349:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233129088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (13045us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.181356:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3453 00000100:00100000:0.0:1782759825.181454:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782759825.186752:0:161406:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1782759825.186846:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1782759825.186874:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759825.186887:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.186899:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759825.186909:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782759825.186911:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 17 10000000:01000000:0.0:1782759825.186914:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782759825.186961:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.186970:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.186980:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759825.187003:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.187081:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.188392:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604540 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.188508:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129216 00000100:00100000:3.0:1782759825.188518:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129216 00000100:00100000:3.0:1782759825.188563:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3454 00000100:00100000:3.0:1782759825.188573:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233129216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759825.188669:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759825.188685:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60df81 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.188711:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.188721:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.188730:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7c00, rc 0) 00000100:00100000:3.0:1782759825.189283:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233129216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 710us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.189292:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3454 00000100:00100000:0.0:1782759825.195359:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759825.195387:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.195401:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759825.195487:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.195546:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.205243:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.206797:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129344 00000100:00100000:2.0:1782759825.206809:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129344 00000100:00100000:2.0:1782759825.206885:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3455 00000100:00100000:2.0:1782759825.206897:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233129344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.207115:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233129344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (11567us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.207136:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3455 00000100:00100000:0.0:1782759825.207269:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.207320:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.207365:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.207396:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604540 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.209012:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129472 00000100:00100000:2.0:1782759825.209025:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129472 00000100:00100000:2.0:1782759825.209086:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3456 00000100:00100000:2.0:1782759825.209098:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233129472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.209291:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233129472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.209298:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3456 00000100:00100000:2.0:1782759825.209363:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.209609:0:161408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161408:1869355233129600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.209651:0:161408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.209674:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129600 00000100:00100000:2.0:1782759825.209677:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129600 00000100:00100000:2.0:1782759825.209697:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3457 00000100:00100000:2.0:1782759825.209704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:161408:x1869355233129600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.209771:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:161408:x1869355233129600:12345-0@lo:502:llog_process_th.0 Request processed in 67us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.209777:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3457 00000100:00100000:2.0:1782759825.209806:0:161408:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.209817:0:161408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161408:1869355233129600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759825.209837:0:161408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759825.209846:0:161408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759825.209848:0:161408:0:(obd_config.c:1561:class_process_config()) marker 66 (0x1) lustre quota.mdt 00000020:00000080:2.0:1782759825.209853:0:161408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759825.209876:0:161408:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161408:1869355233129728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.209912:0:161408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.209942:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129728 00000100:00100000:2.0:1782759825.209946:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129728 00000100:00100000:2.0:1782759825.209964:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3458 00000100:00100000:2.0:1782759825.209970:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:161408:x1869355233129728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.210026:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:161408:x1869355233129728:12345-0@lo:502:llog_process_th.0 Request processed in 56us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.210033:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3458 00000100:00100000:2.0:1782759825.210060:0:161408:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.210072:0:161408:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161408:1869355233129728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759825.210089:0:161408:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759825.210093:0:161408:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759825.210094:0:161408:0:(obd_config.c:1561:class_process_config()) marker 66 (0x2) lustre quota.mdt 00000040:00080000:2.0:1782759825.210098:0:161408:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 20 count 20 00000020:01000000:2.0:1782759825.210159:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 17-19 (rc=0) 10000000:01000000:2.0:1782759825.210180:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782759825.210190:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210200:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759825.210210:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759825.210213:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 64 10000000:01000000:2.0:1782759825.210216:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759825.210240:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210249:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210266:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.210280:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.210305:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.210318:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.210333:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129856 00000100:00100000:2.0:1782759825.210336:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129856 00000100:00100000:2.0:1782759825.210355:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3459 00000100:00100000:2.0:1782759825.210362:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233129856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.210370:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759825.210382:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60df8f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210404:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210414:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210423:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759825.210452:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233129856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.210458:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3459 00000100:00100000:2.0:1782759825.210486:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.210498:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.210514:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.210555:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.210605:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.210619:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.210631:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233129984 00000100:00100000:2.0:1782759825.210634:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233129984 00000100:00100000:2.0:1782759825.210654:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3460 00000100:00100000:2.0:1782759825.210661:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233129984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.210757:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233129984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.210764:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3460 00000100:00100000:2.0:1782759825.210793:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233129984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.210817:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.210846:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.210856:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.210866:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130112 00000100:00100000:2.0:1782759825.210869:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130112 00000100:00100000:2.0:1782759825.210886:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3461 00000100:00100000:2.0:1782759825.210892:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233130112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.210971:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233130112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.210978:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3461 00000100:00100000:2.0:1782759825.211015:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782759825.219992:0:161409:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1782759825.220186:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759825.220219:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759825.220231:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.220243:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759825.220252:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759825.220255:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 20 10000000:01000000:2.0:1782759825.220258:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759825.220294:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.220302:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.220313:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.220338:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.220404:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.220450:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.227006:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130240 00000100:00100000:3.0:1782759825.227021:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130240 00000100:00100000:3.0:1782759825.227081:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3462 00000100:00100000:3.0:1782759825.227091:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233130240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759825.227107:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759825.227123:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60df9d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.227150:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.227173:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.227182:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6000, rc 0) 00000100:00100000:3.0:1782759825.227253:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233130240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (6848us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.227260:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3462 00000100:00100000:2.0:1782759825.232020:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.232049:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.232062:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.232434:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.232500:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.232545:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.232621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130368 00000100:00100000:3.0:1782759825.232628:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130368 00000100:00100000:3.0:1782759825.232671:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3463 00000100:00100000:3.0:1782759825.232681:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233130368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.232808:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233130368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.232816:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3463 00000100:00100000:2.0:1782759825.234429:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.234484:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.234556:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.234609:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.234673:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130496 00000100:00100000:3.0:1782759825.234680:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130496 00000100:00100000:3.0:1782759825.234732:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3464 00000100:00100000:3.0:1782759825.234741:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233130496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.234846:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233130496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.234853:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3464 00000100:00100000:2.0:1782759825.235177:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.237334:0:161412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161412:1869355233130624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.237405:0:161412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.237447:0:161412:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8ac8480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.237495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130624 00000100:00100000:3.0:1782759825.237502:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130624 00000100:00100000:3.0:1782759825.237549:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3465 00000100:00100000:3.0:1782759825.237557:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:161412:x1869355233130624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759825.237697:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:161412:x1869355233130624:12345-0@lo:502:llog_process_th.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.237705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3465 00000100:00100000:0.0:1782759825.239636:0:161412:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161412:1869355233130624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759825.239683:0:161412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759825.239696:0:161412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759825.239698:0:161412:0:(obd_config.c:1561:class_process_config()) marker 64 (0x1) lustre quota.mdt 00000020:00000080:0.0:1782759825.239704:0:161412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782759825.240123:0:161412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161412:1869355233130752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759825.240186:0:161412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.240227:0:161412:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc46043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759825.244625:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130752 00000100:00100000:1.0:1782759825.244640:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130752 00000100:00100000:1.0:1782759825.244696:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1782759825.244707:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:161412:x1869355233130752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759825.244870:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:161412:x1869355233130752:12345-0@lo:502:llog_process_th.0 Request processed in 165us (4683us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759825.244878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3466 00000100:00100000:1.0:1782759825.251058:0:161412:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161412:1869355233130752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782759825.251109:0:161412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782759825.251129:0:161412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782759825.251131:0:161412:0:(obd_config.c:1561:class_process_config()) marker 64 (0x2) lustre quota.mdt 00000040:00080000:1.0:1782759825.251137:0:161412:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 23 count 23 00000020:01000000:3.0:1782759825.251524:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 20-22 (rc=0) 10000000:01000000:3.0:1782759825.251552:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782759825.251564:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.251596:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759825.251608:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759825.251611:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 64 10000000:01000000:3.0:1782759825.251614:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759825.251650:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.251659:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.251668:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759825.251689:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.251748:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759825.251784:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759825.252441:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233130880 00000100:00100000:1.0:1782759825.252450:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233130880 00000100:00100000:1.0:1782759825.252524:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3467 00000100:00100000:1.0:1782759825.252533:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233130880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759825.252549:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759825.252573:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dfab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.252618:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.252830:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.252842:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412200, rc 0) 00000100:00100000:1.0:1782759825.252904:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233130880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 371us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759825.252911:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3467 00000100:00100000:2.0:1782759825.253001:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233130880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.253016:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.253025:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.253081:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.253107:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.253135:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.253223:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131008 00000100:00100000:3.0:1782759825.253228:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131008 00000100:00100000:3.0:1782759825.253261:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3468 00000100:00100000:3.0:1782759825.253269:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233131008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.253376:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233131008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.253383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3468 00000100:00100000:3.0:1782759825.253424:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.253451:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.253491:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759825.253503:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759825.253513:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131136 00000100:00100000:3.0:1782759825.253516:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131136 00000100:00100000:3.0:1782759825.253530:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3469 00000100:00100000:3.0:1782759825.253534:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233131136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.253846:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233131136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 310us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.253853:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3469 00000100:00100000:2.0:1782759825.262164:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759825.263360:0:161415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1782759825.265735:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1782759825.265787:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759825.265802:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.265815:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759825.265827:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1782759825.265830:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 65 10000000:01000000:3.0:1782759825.265832:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759825.265874:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.265883:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.265893:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759825.265932:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.266006:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759825.266045:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.268066:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131264 00000100:00100000:2.0:1782759825.268075:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131264 00000100:00100000:2.0:1782759825.268139:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3470 00000100:00100000:2.0:1782759825.268150:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233131264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.268165:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759825.268181:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dfb9 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.268206:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.268218:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.268226:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648a00, rc 0) 00000100:00100000:2.0:1782759825.268294:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233131264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.268301:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3470 00000100:00100000:2.0:1782759825.268353:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc52d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.268373:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.268383:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.268453:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.268484:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.268508:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131392 00000100:00100000:2.0:1782759825.268518:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131392 00000100:00100000:2.0:1782759825.268541:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3471 00000100:00100000:2.0:1782759825.268547:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233131392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.268682:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233131392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.268689:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3471 00000100:00100000:2.0:1782759825.268716:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.268726:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.268754:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.268787:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.268804:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131520 00000100:00100000:2.0:1782759825.268807:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131520 00000100:00100000:2.0:1782759825.268829:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3472 00000100:00100000:2.0:1782759825.268837:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233131520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.268907:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233131520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.268914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3472 00000100:00100000:2.0:1782759825.268960:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.268972:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.277551:0:161417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161417:1869355233131648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759825.277679:0:161417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.277719:0:161417:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.277980:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131648 00000100:00100000:2.0:1782759825.277988:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131648 00000100:00100000:2.0:1782759825.278039:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3473 00000100:00100000:2.0:1782759825.278050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:161417:x1869355233131648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.278216:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:161417:x1869355233131648:12345-0@lo:502:llog_process_th.0 Request processed in 168us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.278233:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3473 00000100:00100000:0.0:1782759825.278687:0:161417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161417:1869355233131648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759825.278718:0:161417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782759825.278727:0:161417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759825.278730:0:161417:0:(obd_config.c:1561:class_process_config()) marker 63 (0x1) lustre quota.mdt 00000020:00000080:0.0:1782759825.278736:0:161417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1782759825.278762:0:161417:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161417:1869355233131776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759825.278801:0:161417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759825.278832:0:161417:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.278874:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131776 00000100:00100000:2.0:1782759825.278879:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131776 00000100:00100000:2.0:1782759825.278918:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3474 00000100:00100000:2.0:1782759825.278936:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:161417:x1869355233131776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.279006:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:161417:x1869355233131776:12345-0@lo:502:llog_process_th.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.279013:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3474 00000100:00100000:0.0:1782759825.279083:0:161417:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161417:1869355233131776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782759825.279101:0:161417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782759825.279106:0:161417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782759825.279107:0:161417:0:(obd_config.c:1561:class_process_config()) marker 63 (0x2) lustre quota.mdt 00000040:00080000:0.0:1782759825.279111:0:161417:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 68 count 67 00000020:01000000:2.0:1782759825.279260:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 65-67 (rc=0) 10000000:01000000:2.0:1782759825.279284:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1782759825.279294:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.279304:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759825.279314:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759825.279316:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 64 10000000:01000000:2.0:1782759825.279319:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759825.279481:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.279491:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.279501:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.279516:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.279554:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.279602:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.279655:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233131904 00000100:00100000:0.0:1782759825.279659:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233131904 00000100:00100000:0.0:1782759825.279689:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3475 00000100:00100000:0.0:1782759825.279696:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233131904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759825.279705:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759825.279716:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dfc7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.279736:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.279757:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.279766:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803c00, rc 0) 00000100:00100000:0.0:1782759825.279795:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233131904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.279801:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3475 00000100:00100000:2.0:1782759825.279862:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233131904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.279875:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.279884:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.279942:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.279966:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.279985:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.280022:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132032 00000100:00100000:0.0:1782759825.280027:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132032 00000100:00100000:0.0:1782759825.280053:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3476 00000100:00100000:0.0:1782759825.280059:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233132032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.280157:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233132032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.280164:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3476 00000100:00100000:2.0:1782759825.280221:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.280246:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.280283:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.280304:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc686c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.280344:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132160 00000100:00100000:0.0:1782759825.280348:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132160 00000100:00100000:0.0:1782759825.280376:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3477 00000100:00100000:0.0:1782759825.280382:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233132160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.280453:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233132160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.280459:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3477 00000100:00100000:2.0:1782759825.280530:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759825.282853:0:161418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1782759825.283036:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759825.283070:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759825.283083:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.283096:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759825.283107:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782759825.283123:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 65 10000000:01000000:2.0:1782759825.283126:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759825.283161:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.283171:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.283182:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.283205:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.283273:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.283311:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5523600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.283388:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132288 00000100:00100000:0.0:1782759825.283395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132288 00000100:00100000:0.0:1782759825.283448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3478 00000100:00100000:0.0:1782759825.283458:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233132288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759825.283472:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759825.283490:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dfd5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.283514:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.283523:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.283531:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802200, rc 0) 00000100:00100000:0.0:1782759825.283601:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233132288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.283610:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3478 00000100:00100000:1.0:1782759825.283705:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759825.283719:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.283727:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759825.283944:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759825.283984:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759825.284047:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.296845:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132416 00000100:00100000:2.0:1782759825.296861:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132416 00000100:00100000:2.0:1782759825.296932:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3479 00000100:00100000:2.0:1782759825.296945:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233132416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.297115:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233132416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (13129us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.297123:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3479 00000100:00100000:1.0:1782759825.297434:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759825.297488:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759825.297543:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759825.297608:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e900c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.297937:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132544 00000100:00100000:2.0:1782759825.297943:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132544 00000100:00100000:2.0:1782759825.297986:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3480 00000100:00100000:2.0:1782759825.297996:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233132544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.298091:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233132544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.298099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3480 00000100:00100000:1.0:1782759825.298144:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759825.300064:0:161420:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161420:1869355233132672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759825.300642:0:161420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759825.300693:0:161420:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759825.303780:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132672 00000100:00100000:2.0:1782759825.303799:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132672 00000100:00100000:2.0:1782759825.303878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3481 00000100:00100000:2.0:1782759825.303889:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:161420:x1869355233132672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.307979:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:161420:x1869355233132672:12345-0@lo:502:llog_process_th.0 Request processed in 4081us (7327us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759825.307995:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3481 00000100:00100000:2.0:1782759825.308778:0:161420:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161420:1869355233132672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759825.308824:0:161420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759825.308836:0:161420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759825.308839:0:161420:0:(obd_config.c:1561:class_process_config()) marker 65 (0x1) lustre quota.mdt 00000020:00000080:2.0:1782759825.308845:0:161420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759825.308892:0:161420:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161420:1869355233132800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759825.308972:0:161420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.309050:0:161420:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3696180 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.311464:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132800 00000100:00100000:0.0:1782759825.311483:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132800 00000100:00100000:0.0:1782759825.311669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3482 00000100:00100000:0.0:1782759825.311680:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:161420:x1869355233132800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782759825.311904:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:161420:x1869355233132800:12345-0@lo:502:llog_process_th.0 Request processed in 225us (2931us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.311913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3482 00000100:00100000:3.0:1782759825.312039:0:161420:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161420:1869355233132800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782759825.312081:0:161420:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782759825.312088:0:161420:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782759825.312091:0:161420:0:(obd_config.c:1561:class_process_config()) marker 65 (0x2) lustre quota.mdt 00000040:00080000:3.0:1782759825.312096:0:161420:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 68 count 67 00000020:01000000:2.0:1782759825.315001:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 65-67 (rc=0) 10000000:01000000:2.0:1782759825.315048:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1782759825.315060:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.315072:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759825.315083:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1782759825.315086:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759825.315089:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1782759825.315130:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.315154:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.315165:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.315192:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.315264:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.315647:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc1095f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.316315:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233132928 00000100:00100000:0.0:1782759825.316324:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233132928 00000100:00100000:0.0:1782759825.316379:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3483 00000100:00100000:0.0:1782759825.316391:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233132928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759825.316407:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759825.316422:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60dfe3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.316448:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.316459:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759825.316468:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803000, rc 0) 00000100:00100000:0.0:1782759825.316523:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233132928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.316529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3483 00000100:00100000:2.0:1782759825.317009:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233132928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759825.317026:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759825.317036:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759825.317105:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233133056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759825.317138:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759825.317164:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc1095f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782759825.317207:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133056 00000100:00100000:0.0:1782759825.317213:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133056 00000100:00100000:0.0:1782759825.317247:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3484 00000100:00100000:0.0:1782759825.317255:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233133056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.317523:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759825.317546:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626688 00000100:00100000:3.0:1782759825.317550:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626688 00000100:00100000:3.0:1782759825.317569:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3485 00000100:00100000:3.0:1782759825.317601:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218626688:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759825.317610:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759825.317622:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277ac expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.317642:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.317652:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.317658:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6a00, rc 0) 00000100:00100000:3.0:1782759825.317695:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218626688:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.317702:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3485 00000100:00100000:0.0:1782759825.318156:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233133056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 898us (1013us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759825.318163:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3484 00000100:00100000:2.0:1782759825.322443:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233133056:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759825.322709:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759825.322726:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759825.322739:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759825.327386:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759825.327423:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626816 00000100:00100000:3.0:1782759825.327432:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626816 00000100:00100000:3.0:1782759825.327489:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3486 00000100:00100000:3.0:1782759825.327500:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218626816:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.327681:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218626816:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 182us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759825.327689:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3486 00000100:00100000:3.0:1782759825.333867:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759825.333951:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218626944 00000100:00100000:0.0:1782759825.333962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218626944 00000100:00100000:0.0:1782759825.334022:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3487 00000100:00100000:0.0:1782759825.334034:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218626944:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759825.334204:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218626944:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 171us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759825.334213:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3487 00000100:00100000:3.0:1782759825.346314:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759825.346403:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627072 00000100:00100000:1.0:1782759825.346413:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627072 00000100:00100000:1.0:1782759825.346463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3488 00000100:00100000:1.0:1782759825.346471:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218627072:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759825.346488:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759825.346504:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277b3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.346531:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.346541:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759825.346549:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413400, rc 0) 00000100:00100000:1.0:1782759825.346617:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218627072:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 146us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759825.346633:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3488 00000100:00100000:0.0:1782759825.352021:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759825.352096:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627200 00000100:00100000:3.0:1782759825.352107:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627200 00000100:00100000:3.0:1782759825.352165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3489 00000100:00100000:3.0:1782759825.352176:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218627200:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759825.352288:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218627200:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 113us (276us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759825.352296:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3489 00010000:00010000:2.0:1782759825.359038:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759826.315021:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233133184:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759826.315137:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759826.315392:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133184 00000100:00100000:2.0:1782759826.315400:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133184 00000100:00100000:2.0:1782759826.315477:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3527 00000100:00100000:2.0:1782759826.315489:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233133184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759826.315524:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759826.315633:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233133184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 147us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759826.315641:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3527 00000100:00100000:0.0:1782759826.315728:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233133184:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759826.378784:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759827.346994:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233133568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.347064:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759827.347119:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233134080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.347179:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759827.347205:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233134592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.347227:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759827.347249:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759827.347256:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233133696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.347277:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347505:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233133440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347537:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347557:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233133952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347602:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347620:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233134464:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347641:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347672:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782759827.347678:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233133312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347707:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347726:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233133824:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347749:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347770:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233134336:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347792:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347807:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233134848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.347839:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759827.347869:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134080 00000100:00100000:3.0:1782759827.347876:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134080 00000100:00100000:3.0:1782759827.347935:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134592 00000100:00100000:3.0:1782759827.347938:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134592 00000100:00100000:3.0:1782759827.347952:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133696 00000100:00100000:3.0:1782759827.347955:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133696 00000100:00100000:3.0:1782759827.347966:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133440 00000100:00100000:3.0:1782759827.347968:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133440 00000100:00100000:3.0:1782759827.347977:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133952 00000100:00100000:3.0:1782759827.347979:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133952 00000100:00100000:3.0:1782759827.347990:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134464 00000100:00100000:3.0:1782759827.347992:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134464 00000100:00100000:3.0:1782759827.348007:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5532 00000100:00100000:3.0:1782759827.348014:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233134080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348063:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233134080:12345-0@lo:400:kworker.0 Request processed in 49us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348070:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5532 00000100:00100000:3.0:1782759827.348087:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5533 00000100:00100000:3.0:1782759827.348093:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233134592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348121:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233134592:12345-0@lo:400:kworker.0 Request processed in 29us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348246:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5533 00000100:00100000:3.0:1782759827.348259:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5534 00000100:00100000:3.0:1782759827.348265:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233133696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348306:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233133696:12345-0@lo:400:kworker.0 Request processed in 30us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348313:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5534 00000100:00100000:3.0:1782759827.348325:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5535 00000100:00100000:3.0:1782759827.348331:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233133440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348362:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233133440:12345-0@lo:400:kworker.0 Request processed in 31us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348367:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5535 00000100:00100000:3.0:1782759827.348378:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5536 00000100:00100000:3.0:1782759827.348385:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233133952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348412:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233133952:12345-0@lo:400:kworker.0 Request processed in 28us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348418:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5536 00000100:00100000:3.0:1782759827.348428:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5537 00000100:00100000:3.0:1782759827.348434:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233134464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348458:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc44f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233134464:12345-0@lo:400:kworker.0 Request processed in 25us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348463:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5537 00000100:00100000:3.0:1782759827.348485:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133568 00000100:00100000:3.0:1782759827.348489:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133568 00000100:00100000:3.0:1782759827.348528:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133824 00000100:00100000:3.0:1782759827.348531:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133824 00000100:00100000:3.0:1782759827.348545:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3528 00000100:00100000:3.0:1782759827.348551:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233133568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348603:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233133568:12345-0@lo:400:kworker.0 Request processed in 52us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348609:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3528 00000100:00100000:3.0:1782759827.348621:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3529 00000100:00100000:3.0:1782759827.348626:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233133824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348651:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233133824:12345-0@lo:400:kworker.0 Request processed in 26us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348656:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3529 00000100:00100000:3.0:1782759827.348672:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134336 00000100:00100000:3.0:1782759827.348675:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134336 00000100:00100000:3.0:1782759827.348701:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134848 00000100:00100000:3.0:1782759827.348703:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134848 00000100:00100000:3.0:1782759827.348719:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3261 00000100:00100000:3.0:1782759827.348725:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233134336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348752:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233134336:12345-0@lo:400:kworker.0 Request processed in 28us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348758:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3261 00000100:00100000:3.0:1782759827.348767:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3262 00000100:00100000:3.0:1782759827.348771:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233134848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.348794:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233134848:12345-0@lo:400:kworker.0 Request processed in 23us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759827.348800:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3262 00000100:00080000:3.0:1782759827.348816:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759827.348820:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759827.348822:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759827.348824:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759827.349003:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233133312 00000100:00100000:2.0:1782759827.349008:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233133312 00000100:00100000:2.0:1782759827.349050:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3490 00000100:00100000:2.0:1782759827.349058:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233133312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759827.349093:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233133312:12345-0@lo:400:kworker.0 Request processed in 37us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759827.349099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3490 00000100:00100000:3.0:1782759827.349771:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233133312:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.349788:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233133824:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.349802:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233134336:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.349816:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233134848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.349900:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233133440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.349925:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233133952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759827.349936:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233134464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.350111:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233134208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.350282:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759827.350382:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233134720:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.350407:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759827.350508:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233133568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.350521:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233134080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.350533:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf87f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233134592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.350560:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233133696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759827.354232:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134208 00000100:00100000:2.0:1782759827.354244:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134208 00000100:00100000:2.0:1782759827.354339:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134720 00000100:00100000:2.0:1782759827.354342:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134720 00000100:00100000:2.0:1782759827.354366:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3263 00000100:00100000:2.0:1782759827.354375:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233134208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759827.354618:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233134208:12345-0@lo:400:kworker.0 Request processed in 243us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759827.354626:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3263 00000100:00100000:2.0:1782759827.354644:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3264 00000100:00100000:2.0:1782759827.354652:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233134720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759827.354685:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233134720:12345-0@lo:400:kworker.0 Request processed in 35us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759827.354691:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3264 00000100:00080000:2.0:1782759827.354715:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759827.354719:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759827.357446:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233134208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759827.357468:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdec48a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233134720:0@lo:400:kworker.0 00010000:00010000:0.0:1782759827.408790:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759827.854988:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233134976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759827.855060:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759827.855565:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233134976 00000100:00100000:1.0:1782759827.855574:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233134976 00000100:00100000:1.0:1782759827.855646:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1782759827.855655:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233134976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759827.855698:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759827.855770:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233134976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759827.855777:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1782759827.855824:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233134976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759827.856483:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759827.856495:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233135104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759827.856536:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759827.856594:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233135104 00000100:00100000:0.0:1782759827.856599:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233135104 00000100:00100000:0.0:1782759827.856630:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00000100:00100000:0.0:1782759827.856637:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233135104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759827.856807:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759827.856848:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233135104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759827.856854:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:2.0:1782759827.856864:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233135104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759828.426914:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759828.876419:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233135232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759828.876490:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759828.876565:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233135232 00000100:00100000:2.0:1782759828.876572:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233135232 00000100:00100000:2.0:1782759828.876647:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:2.0:1782759828.876658:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233135232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759828.876689:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759828.876749:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233135232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759828.876756:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00000100:00100000:2.0:1782759828.876803:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233135232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759828.878193:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759828.878209:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233135360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759828.878399:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759828.878450:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233135360 00000100:00100000:0.0:1782759828.878456:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233135360 00000100:00100000:0.0:1782759828.878514:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3530 00000100:00100000:0.0:1782759828.878523:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233135360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759828.878554:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 27901952 pending 0 free 1436676096 avail 1290436608 00000100:00100000:0.0:1782759828.878621:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233135360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759828.878629:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3530 00000100:00100000:0.0:1782759828.878672:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233135360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759828.880426:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759828.880444:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233135488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759828.880499:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759828.880544:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233135488 00000100:00100000:0.0:1782759828.880551:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233135488 00000100:00100000:0.0:1782759828.880613:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1782759828.880621:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233135488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759828.880641:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759828.880681:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233135488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759828.880687:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1782759828.882917:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233135488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759829.232731:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759829.232857:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759829.233030:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759829.233055:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627328 00000100:00100000:0.0:1782759829.233064:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627328 00000100:00100000:0.0:1782759829.233112:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3491 00000100:00100000:0.0:1782759829.233121:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218627328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759829.233301:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218627328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 181us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759829.233310:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3491 00000100:00100000:0.0:1782759829.233359:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759829.233397:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627712 00000100:00100000:2.0:1782759829.233401:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627712 00000100:00100000:2.0:1782759829.233445:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3265 00000100:00100000:2.0:1782759829.233460:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218627712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759829.233493:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218627712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759829.233500:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3265 00000100:00080000:2.0:1782759829.233520:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759829.244661:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627456 00000100:00100000:1.0:1782759829.244674:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627456 00000100:00100000:1.0:1782759829.244745:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627584 00000100:00100000:1.0:1782759829.244749:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627584 00000100:00100000:1.0:1782759829.244779:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5538 00000100:00100000:1.0:1782759829.244789:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218627456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759829.244866:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218627456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 79us (12143us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759829.246290:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5538 00000100:00100000:1.0:1782759829.246326:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5539 00000100:00100000:1.0:1782759829.246341:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218627584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759829.246404:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf87f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218627584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 69us (13043us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759829.246425:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5539 00000100:00080000:2.0:1782759829.247070:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759829.247077:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759829.248323:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759829.249041:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627840 00000100:00100000:2.0:1782759829.249052:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627840 00000100:00100000:2.0:1782759829.249231:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3266 00000100:00100000:2.0:1782759829.249250:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218627840:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759829.249448:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218627840:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 208us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759829.249466:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3266 00000100:00080000:0.0:1782759829.252008:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782759829.451344:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759830.186289:0:161606:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe70a6cef0 20000000:00000080:3.0:1782759830.186307:0:161606:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cddc3ecd400 uarg=0000000000000000 20000000:01000000:3.0:1782759830.186352:0:161606:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1782759830.186355:0:161606:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1782759830.186358:0:161606:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=none' 20000000:01000000:3.0:1782759830.186363:0:161606:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'quota.ost=none' 20000000:01000000:3.0:1782759830.186368:0:161606:0:(mgs_llog.c:4241:mgs_write_log_quota()) global 'quota.ost=none' 20000000:01000000:3.0:1782759830.186428:0:161606:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1782759830.186430:0:161606:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1782759830.189357:0:161607:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 59 marker 55 1->4: lustre quota.ost 20000000:01000000:1.0:1782759830.189438:0:161607:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 61 marker 55 2->4: lustre quota.ost 00000040:00080000:1.0:1782759830.189461:0:161607:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 68 count 67 00000040:00080000:3.0:1782759830.189713:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].68, 224 off20168 00000040:00080000:3.0:1782759830.189742:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].69, 88 off20256 00000040:00080000:3.0:1782759830.189761:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].70, 224 off20480 20000000:01000000:3.0:1782759830.189772:0:161606:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782759830.189775:0:161606:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1782759830.191973:0:161608:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 14 marker 56 1->4: lustre quota.ost 20000000:01000000:1.0:1782759830.192036:0:161608:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 16 marker 56 2->4: lustre quota.ost 00000040:00080000:1.0:1782759830.192057:0:161608:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 23 count 23 00000040:00080000:3.0:1782759830.192283:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 224 off12336 00000040:00080000:3.0:1782759830.192309:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 88 off12424 00000040:00080000:3.0:1782759830.192325:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12648 20000000:01000000:3.0:1782759830.192336:0:161606:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782759830.192338:0:161606:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1782759830.193127:0:161609:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 59 marker 57 1->4: lustre quota.ost 20000000:01000000:1.0:1782759830.193160:0:161609:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 61 marker 57 2->4: lustre quota.ost 00000040:00080000:1.0:1782759830.193179:0:161609:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 68 count 67 00000040:00080000:3.0:1782759830.193338:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].68, 224 off20168 00000040:00080000:3.0:1782759830.193361:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].69, 88 off20256 00000040:00080000:3.0:1782759830.193378:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].70, 224 off20480 20000000:01000000:3.0:1782759830.193388:0:161606:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782759830.193390:0:161606:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1782759830.196650:0:161610:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 11 marker 58 1->4: lustre quota.ost 20000000:01000000:1.0:1782759830.196720:0:161610:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 58 2->4: lustre quota.ost 00000040:00080000:1.0:1782759830.196739:0:161610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 20 count 20 00000040:00080000:3.0:1782759830.197111:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11808 00000040:00080000:3.0:1782759830.197137:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 88 off11896 00000040:00080000:3.0:1782759830.197156:0:161606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 224 off12120 10000000:01000000:3.0:1782759830.197172:0:161606:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1782759830.197192:0:161606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197212:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197221:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197228:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197235:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197242:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197249:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197256:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197263:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197275:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197285:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197292:0:161606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197300:0:161606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197337:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197347:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 9 pid: 6526 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197358:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233135616:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759830.197441:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197447:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197455:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233135744:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759830.197482:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197495:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 23 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197504:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233135872:0@lo:104: 00000100:00100000:3.0:1782759830.197547:0:161606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759830.197623:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197629:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197634:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136000:0@lo:104: 00000100:00100000:3.0:1782759830.197649:0:161606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759830.197663:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197668:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197673:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136128:0@lo:104: 00000100:00100000:3.0:1782759830.197684:0:161606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759830.197739:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197746:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197753:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136256:0@lo:104: 00000100:00100000:3.0:1782759830.197776:0:161606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759830.197796:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197804:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197810:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136384:0@lo:104: 00010000:00010000:3.0:1782759830.197827:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197832:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 23 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197840:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136512:0@lo:104: 00010000:00010000:3.0:1782759830.197862:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197870:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 23 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197889:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136640:0@lo:104: 00010000:00010000:3.0:1782759830.197917:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197925:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197932:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136768:0@lo:104: 00010000:00010000:3.0:1782759830.197955:0:161606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.197963:0:161606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.197970:0:161606:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136896:0@lo:104: 00000100:00100000:3.0:1782759830.197985:0:161606:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230000 going to sleep for 11 seconds 00000100:00100000:2.0:1782759830.198065:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759830.198084:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.198096:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.198104:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.198111:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.198142:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.198154:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233135872 00000100:00100000:2.0:1782759830.198161:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233135872 00000100:00100000:2.0:1782759830.198203:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136000 00000100:00100000:2.0:1782759830.198206:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136000 00000100:00100000:2.0:1782759830.198218:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136128 00000100:00100000:2.0:1782759830.198220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136128 00000100:00100000:2.0:1782759830.198228:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136256 00000100:00100000:2.0:1782759830.198230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136256 00000100:00100000:2.0:1782759830.198238:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136384 00000100:00100000:2.0:1782759830.198240:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136384 00000100:00100000:2.0:1782759830.198249:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136512 00000100:00100000:2.0:1782759830.198250:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136512 00000100:00100000:2.0:1782759830.198259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136640 00000100:00100000:2.0:1782759830.198261:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136640 00000100:00100000:2.0:1782759830.198272:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136768 00000100:00100000:2.0:1782759830.198274:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136768 00000100:00100000:2.0:1782759830.198283:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233136896 00000100:00100000:2.0:1782759830.198285:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233136896 00000100:00100000:2.0:1782759830.198298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1782759830.198306:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+11:161606:x1869355233135872:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198318:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198390:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759830.198397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+11:161606:x1869355233135872:12345-0@lo:104: Request processed in 92us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198404:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:2.0:1782759830.198422:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1782759830.198430:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+10:161606:x1869355233136000:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198438:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198468:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782759830.198473:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+10:161606:x1869355233136000:12345-0@lo:104: Request processed in 46us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198479:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1782759830.198490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1782759830.198497:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+9:161606:x1869355233136128:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198504:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198537:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782759830.198542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+9:161606:x1869355233136128:12345-0@lo:104: Request processed in 47us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198548:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1782759830.198558:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1782759830.198565:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4848850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:161606:x1869355233136256:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198571:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198630:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1782759830.198635:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4848850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+8:161606:x1869355233136256:12345-0@lo:104: Request processed in 72us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198641:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1782759830.198675:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1782759830.198682:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+7:161606:x1869355233136384:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198689:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198715:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1782759830.198720:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+7:161606:x1869355233136384:12345-0@lo:104: Request processed in 40us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198726:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1782759830.198738:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1782759830.198744:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:161606:x1869355233136512:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198752:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198776:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1782759830.198780:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+6:161606:x1869355233136512:12345-0@lo:104: Request processed in 38us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198785:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:2.0:1782759830.198797:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1782759830.198804:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:161606:x1869355233136640:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198810:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198843:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1782759830.198848:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+5:161606:x1869355233136640:12345-0@lo:104: Request processed in 46us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198855:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1782759830.198866:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1782759830.198873:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:161606:x1869355233136768:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198894:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198921:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1782759830.198925:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+4:161606:x1869355233136768:12345-0@lo:104: Request processed in 55us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1782759830.198941:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1782759830.198949:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:161606:x1869355233136896:12345-0@lo:104: 00010000:00010000:2.0:1782759830.198956:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.198981:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1782759830.198985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:161606:x1869355233136896:12345-0@lo:104: Request processed in 39us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.198991:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00010000:00010000:2.0:1782759830.199010:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1782759830.199015:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199031:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199035:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199043:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199050:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199055:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199087:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199094:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199112:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199120:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60dfe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfea expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199132:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1782759830.199135:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199141:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199144:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199161:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199167:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199172:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199186:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199191:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199197:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199204:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649a00/0xd5b45c7f5c60dfd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199213:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1782759830.199216:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199221:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199224:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199230:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199236:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199247:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199261:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199267:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199282:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199290:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60dfc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199299:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1782759830.199302:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199307:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199310:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199317:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199324:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199329:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199340:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199345:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199357:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199364:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60dfb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfc0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199372:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1782759830.199376:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199381:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199384:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199391:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199396:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199401:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199414:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199419:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199423:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199429:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6800/0xd5b45c7f5c60dfab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfb2 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199437:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1782759830.199445:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199451:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199454:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199461:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199467:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199471:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199485:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199490:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199495:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199502:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648c00/0xd5b45c7f5c60df9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dfa4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199510:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782759830.199513:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199518:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199520:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199538:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199545:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199550:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199563:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199569:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199574:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199602:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649000/0xd5b45c7f5c60df8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df96 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199610:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782759830.199614:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199619:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199622:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199628:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199635:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199646:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199660:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199666:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199671:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199677:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60df81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df88 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199686:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759830.199689:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199695:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759830.199697:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199704:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759830.199710:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759830.199715:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782759830.199724:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199730:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759830.199741:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199747:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60df73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60df7a expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.199759:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759830.199761:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759830.199763:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759830.199791:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.199837:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.199863:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.199900:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.199915:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233138048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.199938:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.199959:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782759830.199964:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.199984:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.199998:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.200015:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.200042:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.200063:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.200077:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.200095:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.200104:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782759830.200109:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.200138:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.200148:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.200179:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759830.200200:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137024 00000100:00100000:2.0:1782759830.200207:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137024 00010000:00010000:2.0:1782759830.200236:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 24 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200253:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137536 00000100:00100000:2.0:1782759830.200256:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137536 00010000:00010000:2.0:1782759830.200266:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 25 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200277:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138048 00000100:00100000:2.0:1782759830.200279:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138048 00010000:00010000:2.0:1782759830.200289:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 26 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200298:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137152 00000100:00100000:2.0:1782759830.200301:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137152 00010000:00010000:2.0:1782759830.200309:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 27 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200317:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137664 00000100:00100000:2.0:1782759830.200319:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137664 00010000:00010000:2.0:1782759830.200327:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 28 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200334:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137408 00000100:00100000:2.0:1782759830.200336:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137408 00010000:00010000:2.0:1782759830.200343:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 29 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200361:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137920 00000100:00100000:2.0:1782759830.200364:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137920 00010000:00010000:2.0:1782759830.200375:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 30 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200385:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137280 00000100:00100000:2.0:1782759830.200387:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137280 00010000:00010000:2.0:1782759830.200397:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 31 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200406:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233137792 00000100:00100000:2.0:1782759830.200409:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233137792 00010000:00010000:2.0:1782759830.200417:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 32 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.200429:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1782759830.200437:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+32:3662:x1869355233137024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759830.200449:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759830.200454:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 32 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200463:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 32 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200479:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759830.200509:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+32:3662:x1869355233137024:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.200516:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:2.0:1782759830.200531:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1782759830.200545:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+31:3662:x1869355233137536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759830.200553:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759830.200557:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 31 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200565:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 31 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200574:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759830.200617:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+31:3662:x1869355233137536:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.200623:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1782759830.200634:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1782759830.200641:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+30:3662:x1869355233138048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759830.200649:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759830.200653:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 30 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200660:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 30 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200669:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759830.200688:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+30:3662:x1869355233138048:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.200694:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:2.0:1782759830.200728:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1782759830.200735:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+29:3662:x1869355233137152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759830.200741:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759830.200750:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 29 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200757:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 29 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200766:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759830.200789:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+29:3662:x1869355233137152:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.200795:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:2.0:1782759830.200807:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1782759830.200814:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+28:3662:x1869355233137664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759830.200820:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759830.200824:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 28 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200831:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 28 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.200840:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759830.200858:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+28:3662:x1869355233137664:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.200864:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1782759830.200873:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00010000:00010000:0.0:1782759830.201240:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759830.201246:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759830.201263:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1782759830.201272:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+27:3665:x1869355233137920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759830.201280:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759830.201285:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 27 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.201294:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 27 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.201304:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759830.201344:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+27:3665:x1869355233137920:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.201350:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1782759830.201362:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1782759830.201369:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+26:3665:x1869355233137280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759830.201376:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759830.201382:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 26 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.201390:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 26 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.201398:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759830.201415:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+26:3665:x1869355233137280:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.201419:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:0.0:1782759830.201437:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:0.0:1782759830.201441:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355233137792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759830.201446:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759830.201450:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 25 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.201458:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 25 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.201467:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759830.201485:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+25:3665:x1869355233137792:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.201491:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1782759830.201633:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759830.201639:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759830.201644:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759830.201765:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60dfea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfe3 expref: 24 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.201775:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233135872:0@lo:104: 00010000:00010000:3.0:1782759830.201781:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60dfdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfd5 expref: 23 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.201786:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136000:0@lo:104: 00010000:00010000:3.0:1782759830.201791:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60dfce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfc7 expref: 22 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.201795:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136128:0@lo:104: 00000100:00100000:3.0:1782759830.201800:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136256:0@lo:104: 00010000:00010000:3.0:1782759830.201804:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60dfb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfab expref: 21 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.201808:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136384:0@lo:104: 00000100:00100000:2.0:1782759830.201959:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+20:3665:x1869355233137408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759830.201966:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6000/0xd5b45c7f5c60dfa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60df9d expref: 20 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.201970:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1782759830.201975:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136512:0@lo:104: 00010000:00010000:2.0:1782759830.201975:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 19 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.201986:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60df96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60df8f expref: 19 pid: 6525 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.201995:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136640:0@lo:104: 00010000:00010000:2.0:1782759830.201996:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 18 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.202004:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60df88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60df81 expref: 18 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.202007:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648a00/0xd5b45c7f5c60dfc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60dfb9 expref: 18 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.202012:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136768:0@lo:104: 00010000:00010000:3.0:1782759830.202022:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60df7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60df73 expref: 17 pid: 6524 timeout: 4020 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.202028:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759830.202029:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233136896:0@lo:104: 00000100:00100000:2.0:1782759830.202064:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+15:3665:x1869355233137408:12345-0@lo:103:ldlm_bl.0 Request processed in 1185us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759830.202071:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1782759830.202117:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233137408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.202120:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.202128:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.202139:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.202147:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233137536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759830.202167:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233138048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759830.203769:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233135616:192.168.202.31@tcp:104: 00000100:00100000:3.0:1782759830.203788:0:161606:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161606:1869355233135744:192.168.202.31@tcp:104: 00010000:00010000:3.0:1782759830.203919:0:161606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759830.204667:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759830.204974:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628096 00000100:00100000:0.0:1782759830.204984:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628096 00010000:00010000:0.0:1782759830.205027:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 10 pid: 6526 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759830.205073:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 898 00000100:00100000:0.0:1782759830.205084:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2402:x1869355218628096:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759830.205101:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759830.205107:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 10 pid: 6526 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.205118:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 10 pid: 6526 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.205153:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60dff8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277b3 expref: 10 pid: 6526 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759830.205168:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759830.205222:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2402:x1869355218628096:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 141us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759830.205230:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 898 00000100:00100000:2.0:1782759830.205502:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759830.205916:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218627968 00000100:00100000:3.0:1782759830.205922:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218627968 00010000:00010000:3.0:1782759830.205945:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.205976:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 899 00000100:00100000:3.0:1782759830.205984:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2402:x1869355218627968:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759830.206006:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759830.206011:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206025:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206038:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6a00/0xd5b45c7f5c60dff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ac expref: 9 pid: 6524 timeout: 3970 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206053:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206062:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206078:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206085:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206091:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206098:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206103:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759830.206108:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206284:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206309:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759830.206320:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759830.206337:0:161606:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759830.206349:0:161606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.206356:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2402:x1869355218627968:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 370us (852us total) trans 0 rc 0/0 00010000:00010000:2.0:1782759830.206360:0:161606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60dfff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759830.206369:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 899 00010000:00010000:2.0:1782759830.484377:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759831.243663:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782759831.243671:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cddc20b1000 from 64 10000000:01000000:2.0:1782759831.243686:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782759831.243737:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.243750:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.243762:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.243788:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.244053:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.244103:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc27009c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.244827:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138176 00000100:00100000:1.0:1782759831.244836:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138176 00000100:00100000:1.0:1782759831.244904:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3492 00000100:00100000:1.0:1782759831.244913:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+15:6528:x1869355233138176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759831.244928:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759831.244944:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5412400/0xd5b45c7f5c60e00d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e006 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.244967:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412400/0xd5b45c7f5c60e00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e006 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.244997:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5412400/0xd5b45c7f5c60e00d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e006 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.245006:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412400, rc 0) 00000100:00100000:1.0:1782759831.245060:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233138176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.245067:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3492 00000100:00100000:2.0:1782759831.245332:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.245349:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e00d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.245359:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e00d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.245427:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.245460:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.245623:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc27009c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.250951:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138304 00000100:00100000:1.0:1782759831.250968:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138304 00000100:00100000:1.0:1782759831.251107:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3493 00000100:00100000:1.0:1782759831.251118:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233138304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.252617:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233138304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1497us (7152us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.252626:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3493 00000100:00100000:2.0:1782759831.252776:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.253895:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.253968:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.254068:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc27009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759831.254227:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138432 00000100:00100000:0.0:1782759831.254235:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138432 00000100:00100000:0.0:1782759831.254289:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3494 00000100:00100000:0.0:1782759831.254297:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233138432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.254416:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233138432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759831.254426:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3494 00000100:00100000:0.0:1782759831.254483:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782759831.255428:0:161668:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:0.0:1782759831.255572:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:0.0:1782759831.255645:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782759831.255656:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e00d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.255672:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648a00/0xd5b45c7f5c60e006 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e00d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759831.255681:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1782759831.255685:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 20 10000000:01000000:0.0:1782759831.255688:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782759831.255906:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.255915:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.255926:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759831.255948:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.256000:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759831.256029:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedb609cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.256342:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138560 00000100:00100000:2.0:1782759831.256349:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138560 00000100:00100000:2.0:1782759831.256395:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3495 00000100:00100000:2.0:1782759831.256405:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+16:6528:x1869355233138560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.256418:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759831.256432:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60e01b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e014 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.256454:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60e01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e014 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.256463:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649000/0xd5b45c7f5c60e01b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e014 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.256471:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649000, rc 0) 00000100:00100000:2.0:1782759831.256517:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233138560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.256523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3495 00000100:00100000:3.0:1782759831.256958:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759831.256973:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e01b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.256983:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e01b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.257036:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.257075:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.257093:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759831.257214:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138688 00000100:00100000:0.0:1782759831.257218:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138688 00000100:00100000:0.0:1782759831.257251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3496 00000100:00100000:0.0:1782759831.257259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233138688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.257995:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233138688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 733us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759831.258003:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3496 00000100:00100000:3.0:1782759831.258077:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.258113:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.258154:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.258186:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90780 going to sleep for 11 seconds 00000100:00100000:0.0:1782759831.258228:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138816 00000100:00100000:0.0:1782759831.258232:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138816 00000100:00100000:0.0:1782759831.258265:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3497 00000100:00100000:0.0:1782759831.258272:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233138816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.258356:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233138816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759831.258363:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3497 00000100:00100000:0.0:1782759831.258404:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233138816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.259148:0:161669:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161669:1869355233138944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759831.259197:0:161669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.259218:0:161669:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.259904:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233138944 00000100:00100000:2.0:1782759831.259912:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233138944 00000100:00100000:2.0:1782759831.259973:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3498 00000100:00100000:2.0:1782759831.260321:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:161669:x1869355233138944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.260466:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:161669:x1869355233138944:12345-0@lo:502:llog_process_th.0 Request processed in 484us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.260483:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3498 00000100:00100000:3.0:1782759831.260690:0:161669:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161669:1869355233138944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.261895:0:161669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759831.261909:0:161669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.261911:0:161669:0:(obd_config.c:1561:class_process_config()) marker 70 (0x1) lustre quota.ost 00000020:00000080:2.0:1782759831.261922:0:161669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759831.261974:0:161669:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161669:1869355233139072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.262053:0:161669:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.262094:0:161669:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700300 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.262611:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139072 00000100:00100000:3.0:1782759831.262620:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139072 00000100:00100000:3.0:1782759831.262673:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3499 00000100:00100000:3.0:1782759831.262682:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:161669:x1869355233139072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759831.262837:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+17:161669:x1869355233139072:12345-0@lo:502:llog_process_th.0 Request processed in 155us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.262844:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3499 00000100:00100000:2.0:1782759831.263139:0:161669:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161669:1869355233139072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.263181:0:161669:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759831.263187:0:161669:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.263189:0:161669:0:(obd_config.c:1561:class_process_config()) marker 70 (0x2) lustre quota.ost 00000040:00080000:2.0:1782759831.263197:0:161669:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 23 count 23 00000020:01000000:0.0:1782759831.263883:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 20-22 (rc=0) 10000000:01000000:0.0:1782759831.263916:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1782759831.263928:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e01b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.263939:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf802e00/0xd5b45c7f5c60e014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e01b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759831.263949:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782759831.263953:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdecd52e800 from 64 10000000:01000000:0.0:1782759831.263955:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782759831.263989:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.263997:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.264005:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759831.264023:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.264074:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759831.264102:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.264924:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139200 00000100:00100000:2.0:1782759831.264935:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139200 00000100:00100000:2.0:1782759831.265013:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3500 00000100:00100000:2.0:1782759831.265023:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+17:6528:x1869355233139200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.265040:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759831.265056:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60e029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e022 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.265082:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60e029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e022 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.265094:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648c00/0xd5b45c7f5c60e029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e022 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.265102:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648c00, rc 0) 00000100:00100000:2.0:1782759831.265183:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233139200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.265189:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3500 00000100:00100000:0.0:1782759831.265648:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759831.265667:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e029 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.265678:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e029 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759831.265770:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.265807:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759831.265841:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.265961:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139328 00000100:00100000:3.0:1782759831.265966:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139328 00000100:00100000:3.0:1782759831.266003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3501 00000100:00100000:3.0:1782759831.266012:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233139328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.266371:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233139328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.266379:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3501 00000100:00100000:0.0:1782759831.266950:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.266991:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.267042:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759831.267077:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.267143:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139456 00000100:00100000:2.0:1782759831.267148:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139456 00000100:00100000:2.0:1782759831.267188:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3502 00000100:00100000:2.0:1782759831.267196:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233139456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.267366:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233139456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.267373:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3502 00000100:00100000:3.0:1782759831.269094:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782759831.276602:0:161670:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1782759831.276774:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759831.276808:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759831.276820:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e029 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.276832:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf802600/0xd5b45c7f5c60e022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e029 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759831.276841:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782759831.276844:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 23 10000000:01000000:2.0:1782759831.276846:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759831.276894:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.276904:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.276930:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.276957:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.277026:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.277107:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.279449:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139584 00000100:00100000:3.0:1782759831.279462:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139584 00000100:00100000:3.0:1782759831.279523:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3503 00000100:00100000:3.0:1782759831.279535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+18:6528:x1869355233139584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759831.279553:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759831.279851:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60e037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e030 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.279895:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60e037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e030 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.279911:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7c00/0xd5b45c7f5c60e037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e030 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.279926:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7c00, rc 0) 00000100:00100000:3.0:1782759831.280016:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233139584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 484us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.280024:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3503 00000100:00100000:2.0:1782759831.280167:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.280189:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e037 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.280199:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e037 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.280282:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.280318:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.280357:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.280402:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139712 00000100:00100000:1.0:1782759831.280408:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139712 00000100:00100000:1.0:1782759831.280448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3504 00000100:00100000:1.0:1782759831.280456:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233139712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.280627:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233139712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.280634:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3504 00000100:00100000:2.0:1782759831.280844:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.280887:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.280931:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.280960:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.281014:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139840 00000100:00100000:3.0:1782759831.281018:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139840 00000100:00100000:3.0:1782759831.281051:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3505 00000100:00100000:3.0:1782759831.281059:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233139840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.281149:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233139840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.281156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3505 00000100:00100000:0.0:1782759831.281225:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233139840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.290348:0:161672:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161672:1869355233139968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.290437:0:161672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.290791:0:161672:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded234f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.290848:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233139968 00000100:00100000:1.0:1782759831.290855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233139968 00000100:00100000:1.0:1782759831.290955:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3506 00000100:00100000:1.0:1782759831.290966:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:161672:x1869355233139968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759831.291207:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:161672:x1869355233139968:12345-0@lo:502:llog_process_th.0 Request processed in 243us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.291215:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3506 00000100:00100000:2.0:1782759831.291312:0:161672:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161672:1869355233139968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.291355:0:161672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759831.291365:0:161672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.291368:0:161672:0:(obd_config.c:1561:class_process_config()) marker 68 (0x1) lustre quota.ost 00000020:00000080:2.0:1782759831.291376:0:161672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759831.291412:0:161672:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161672:1869355233140096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.291452:0:161672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.291514:0:161672:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded3397240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.291544:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140096 00000100:00100000:1.0:1782759831.291548:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140096 00000100:00100000:1.0:1782759831.291784:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3507 00000100:00100000:1.0:1782759831.291792:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:161672:x1869355233140096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759831.291861:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:161672:x1869355233140096:12345-0@lo:502:llog_process_th.0 Request processed in 71us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.291881:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3507 00000100:00100000:2.0:1782759831.291949:0:161672:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161672:1869355233140096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.291969:0:161672:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759831.291973:0:161672:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.291975:0:161672:0:(obd_config.c:1561:class_process_config()) marker 68 (0x2) lustre quota.ost 00000040:00080000:2.0:1782759831.291979:0:161672:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 26 count 26 00000020:01000000:1.0:1782759831.292141:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 23-25 (rc=0) 10000000:01000000:1.0:1782759831.292163:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782759831.292173:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e037 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.292183:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648400/0xd5b45c7f5c60e030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e037 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759831.292193:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782759831.292196:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdee55e9800 from 64 10000000:01000000:1.0:1782759831.292198:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782759831.292224:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.292232:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.292241:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759831.292262:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.292292:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759831.292354:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.292410:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140224 00000100:00100000:2.0:1782759831.292414:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140224 00000100:00100000:2.0:1782759831.292452:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3508 00000100:00100000:2.0:1782759831.292460:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+19:6528:x1869355233140224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.292470:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759831.292482:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60e045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e03e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.292503:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60e045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e03e expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.292513:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649a00/0xd5b45c7f5c60e045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e03e expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.292522:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649a00, rc 0) 00000100:00100000:2.0:1782759831.292554:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233140224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.292681:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759831.292706:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e045 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.292716:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e045 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759831.292768:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.292796:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759831.292804:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.292818:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140352 00000100:00100000:1.0:1782759831.292822:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140352 00000100:00100000:1.0:1782759831.292842:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3509 00000100:00100000:1.0:1782759831.292849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.292962:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.292971:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3509 00000100:00100000:1.0:1782759831.293007:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.293041:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.293085:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759831.293102:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.293120:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140480 00000100:00100000:1.0:1782759831.293124:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140480 00000100:00100000:1.0:1782759831.293142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3510 00000100:00100000:1.0:1782759831.293148:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.293226:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.293233:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3510 00000100:00100000:1.0:1782759831.293273:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.293437:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3508 00000040:00080000:1.0:1782759831.298996:0:161673:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:3.0:1782759831.299192:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:3.0:1782759831.299223:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782759831.299236:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e045 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.299248:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412e00/0xd5b45c7f5c60e03e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e045 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759831.299258:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1782759831.299261:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 68 10000000:01000000:3.0:1782759831.299264:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1782759831.299304:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.299311:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.299326:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.299351:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.299423:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.299466:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.299522:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140608 00000100:00100000:1.0:1782759831.299531:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140608 00000100:00100000:1.0:1782759831.299606:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3511 00000100:00100000:1.0:1782759831.299618:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+20:6528:x1869355233140608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759831.299633:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759831.299647:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5412000/0xd5b45c7f5c60e053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e04c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.299672:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412000/0xd5b45c7f5c60e053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e04c expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.299682:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5412000/0xd5b45c7f5c60e053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e04c expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759831.299691:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412000, rc 0) 00000100:00100000:1.0:1782759831.300149:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 533us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.300156:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3511 00000100:00100000:3.0:1782759831.300320:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759831.300335:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e053 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.300344:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e053 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.300407:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.300440:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.300463:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.300481:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140736 00000100:00100000:3.0:1782759831.300485:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140736 00000100:00100000:3.0:1782759831.300512:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3512 00000100:00100000:3.0:1782759831.300520:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.300657:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.300664:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3512 00000100:00100000:3.0:1782759831.300766:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.301692:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.302898:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.302928:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604900 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.302964:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140864 00000100:00100000:3.0:1782759831.302970:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140864 00000100:00100000:3.0:1782759831.303015:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3513 00000100:00100000:3.0:1782759831.303023:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.303138:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233140864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.303145:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3513 00000100:00100000:3.0:1782759831.303197:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233140864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.303431:0:161674:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161674:1869355233140992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759831.303466:0:161674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.303478:0:161674:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759831.308615:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233140992 00000100:00100000:1.0:1782759831.308631:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233140992 00000100:00100000:1.0:1782759831.308679:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3514 00000100:00100000:1.0:1782759831.308688:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:161674:x1869355233140992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759831.310977:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+21:161674:x1869355233140992:12345-0@lo:502:llog_process_th.0 Request processed in 2284us (7504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.310989:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3514 00000100:00100000:2.0:1782759831.316177:0:161674:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161674:1869355233140992:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.316225:0:161674:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759831.316237:0:161674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.316239:0:161674:0:(obd_config.c:1561:class_process_config()) marker 67 (0x1) lustre quota.ost 00000020:00000080:2.0:1782759831.316249:0:161674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759831.316297:0:161674:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161674:1869355233141120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.316373:0:161674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.316414:0:161674:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded3397240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.327225:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141120 00000100:00100000:3.0:1782759831.327240:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141120 00000100:00100000:3.0:1782759831.327297:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3515 00000100:00100000:3.0:1782759831.327308:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:161674:x1869355233141120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759831.327480:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+21:161674:x1869355233141120:12345-0@lo:502:llog_process_th.0 Request processed in 172us (11105us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.327488:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3515 00000100:00100000:2.0:1782759831.346163:0:161674:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161674:1869355233141120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.346215:0:161674:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759831.346226:0:161674:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.346228:0:161674:0:(obd_config.c:1561:class_process_config()) marker 67 (0x2) lustre quota.ost 00000040:00080000:2.0:1782759831.346237:0:161674:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 71 count 70 00000020:01000000:3.0:1782759831.346440:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 68-70 (rc=0) 10000000:01000000:3.0:1782759831.346460:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1782759831.346470:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e053 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.346478:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6a00/0xd5b45c7f5c60e04c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e053 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759831.346487:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782759831.346489:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8cdec77f6000 from 64 10000000:01000000:3.0:1782759831.346490:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782759831.346520:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.346526:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.346532:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.346548:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.346650:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759831.346693:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141248 00000100:00100000:0.0:1782759831.346701:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141248 00000100:00100000:0.0:1782759831.346750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3516 00000100:00100000:0.0:1782759831.346760:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+21:6528:x1869355233141248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759831.346775:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759831.346788:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf802a00/0xd5b45c7f5c60e061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e05a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.346823:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802a00/0xd5b45c7f5c60e061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e05a expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.346831:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90240 going to sleep for 11 seconds 00010000:00010000:0.0:1782759831.346836:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf802a00/0xd5b45c7f5c60e061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e05a expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759831.346846:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802a00, rc 0) 00000100:00100000:0.0:1782759831.346917:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233141248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759831.346924:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3516 00000100:00100000:2.0:1782759831.347140:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ddb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.347155:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e061 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.347165:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e061 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.347222:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.347252:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.347275:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.347289:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141376 00000100:00100000:2.0:1782759831.347292:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141376 00000100:00100000:2.0:1782759831.347340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3517 00000100:00100000:2.0:1782759831.347354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233141376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.347471:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233141376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.347477:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3517 00000100:00100000:2.0:1782759831.347508:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.347536:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.347611:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.347631:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.347643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141504 00000100:00100000:2.0:1782759831.347646:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141504 00000100:00100000:2.0:1782759831.347669:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3518 00000100:00100000:2.0:1782759831.347676:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233141504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.347858:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233141504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.347865:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3518 00000100:00100000:2.0:1782759831.347916:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782759831.348550:0:161677:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 63 00000020:01000000:2.0:1782759831.348878:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 64-63 (rc=0) 10000000:01000000:2.0:1782759831.348900:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782759831.348910:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e061 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.348919:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6000/0xd5b45c7f5c60e05a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e061 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759831.348942:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782759831.348945:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 68 10000000:01000000:2.0:1782759831.348947:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782759831.348974:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.348982:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.348989:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.349005:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.349051:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.349088:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.349112:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141632 00000100:00100000:2.0:1782759831.349116:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141632 00000100:00100000:2.0:1782759831.349152:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3519 00000100:00100000:2.0:1782759831.349162:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+22:6528:x1869355233141632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.349174:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759831.349187:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60e06f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e068 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.349772:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60e06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e068 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.349784:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649c00/0xd5b45c7f5c60e06f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e068 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.349804:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649c00, rc 0) 00000100:00100000:2.0:1782759831.349849:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233141632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 687us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.349855:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3519 00000100:00100000:2.0:1782759831.349929:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.349944:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e06f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.349953:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e06f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759831.350771:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.350816:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.350846:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.350865:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141760 00000100:00100000:2.0:1782759831.350882:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141760 00000100:00100000:2.0:1782759831.350925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3520 00000100:00100000:2.0:1782759831.350935:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233141760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.351048:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233141760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.351056:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3520 00000100:00100000:2.0:1782759831.351096:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.351124:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.351164:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.351185:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4734d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.351198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233141888 00000100:00100000:2.0:1782759831.351202:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233141888 00000100:00100000:2.0:1782759831.351225:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1782759831.351232:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233141888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782759831.351312:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233141888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.351318:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3521 00000100:00100000:2.0:1782759831.351356:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233141888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782759831.359992:0:161678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161678:1869355233142016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782759831.360075:0:161678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759831.360121:0:161678:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec93a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759831.360313:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142016 00000100:00100000:2.0:1782759831.360321:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142016 00000100:00100000:2.0:1782759831.360377:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3522 00000100:00100000:2.0:1782759831.360388:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:161678:x1869355233142016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.360526:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:161678:x1869355233142016:12345-0@lo:502:llog_process_th.0 Request processed in 140us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.360534:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3522 00000100:00100000:2.0:1782759831.361894:0:161678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161678:1869355233142016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.361938:0:161678:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782759831.361949:0:161678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.361952:0:161678:0:(obd_config.c:1561:class_process_config()) marker 69 (0x1) lustre quota.ost 00000020:00000080:2.0:1782759831.361962:0:161678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782759831.362002:0:161678:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161678:1869355233142144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782759831.362059:0:161678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759831.362101:0:161678:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6000 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.362266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142144 00000100:00100000:3.0:1782759831.362273:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142144 00000100:00100000:3.0:1782759831.362326:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3523 00000100:00100000:3.0:1782759831.362336:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:161678:x1869355233142144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782759831.362454:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:161678:x1869355233142144:12345-0@lo:502:llog_process_th.0 Request processed in 119us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.362462:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3523 00000100:00100000:2.0:1782759831.362543:0:161678:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b8c55c43-51ff-4f74-a800-62b522e56789:161678:1869355233142144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782759831.363152:0:161678:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782759831.363167:0:161678:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782759831.363169:0:161678:0:(obd_config.c:1561:class_process_config()) marker 69 (0x2) lustre quota.ost 00000040:00080000:2.0:1782759831.363175:0:161678:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 71 count 70 00000020:01000000:3.0:1782759831.363339:0:6528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 68-70 (rc=0) 10000000:01000000:3.0:1782759831.363368:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782759831.363378:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e06f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363391:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649400/0xd5b45c7f5c60e068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e06f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759831.363402:0:6528:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782759831.363405:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759831.363408:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782759831.363436:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363446:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363455:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.363473:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233142272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.363515:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.363540:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.363557:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142272 00000100:00100000:3.0:1782759831.363593:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142272 00000100:00100000:3.0:1782759831.363637:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3524 00000100:00100000:3.0:1782759831.363645:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233142272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759831.363656:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759831.363668:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60e07d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e076 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363813:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60e07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e076 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363826:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6200/0xd5b45c7f5c60e07d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e076 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363839:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6200, rc 0) 00000100:00100000:3.0:1782759831.363885:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233142272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.363892:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3524 00000100:00100000:3.0:1782759831.363932:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233142272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759831.363945:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e07d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.363954:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e07d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759831.364008:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233142400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.364032:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759831.364046:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759831.364060:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142400 00000100:00100000:3.0:1782759831.364063:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142400 00000100:00100000:3.0:1782759831.364089:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3525 00000100:00100000:3.0:1782759831.364095:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233142400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.364163:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233142400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (129us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759831.364168:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3525 00000100:00100000:3.0:1782759831.364193:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4dd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233142400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1782759831.364217:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782759831.364222:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e07d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.364229:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7a00/0xd5b45c7f5c60e076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e07d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759831.438852:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233142528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759831.438972:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759831.439074:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142528 00000100:00100000:1.0:1782759831.439081:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142528 00000100:00100000:1.0:1782759831.439738:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531 00000100:00100000:1.0:1782759831.439751:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233142528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759831.439787:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759831.439851:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233142528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759831.439859:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531 00000100:00100000:2.0:1782759831.439910:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233142528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759831.503936:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759831.583702:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759831.583831:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628224 00000100:00100000:3.0:1782759831.583843:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628224 00000100:00100000:3.0:1782759831.583919:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3526 00000100:00100000:3.0:1782759831.583931:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:100263:x1869355218628224:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759831.583950:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759831.583969:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e084 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277ba expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.583997:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ba expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.584010:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e084 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ba expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759831.584019:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7000, rc 0) 00000100:00100000:3.0:1782759831.584680:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218628224:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 745us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.584690:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3526 00000100:00100000:0.0:1782759831.586416:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759831.586494:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628352 00000100:00100000:3.0:1782759831.586504:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628352 00000100:00100000:3.0:1782759831.586554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3527 00000100:00100000:3.0:1782759831.586562:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218628352:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.586721:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218628352:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 158us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.586730:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3527 00000100:00100000:2.0:1782759831.588789:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759831.588883:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628480 00000100:00100000:3.0:1782759831.588896:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628480 00000100:00100000:3.0:1782759831.588948:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3528 00000100:00100000:3.0:1782759831.588956:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218628480:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782759831.589117:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218628480:12345-192.168.202.31@tcp:503:ll_cfg_requeue.0 Request processed in 160us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759831.589124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3528 00000100:00100000:0.0:1782759831.594667:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759831.595324:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628608 00000100:00100000:2.0:1782759831.595336:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628608 00000100:00100000:2.0:1782759831.595399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3529 00000100:00100000:2.0:1782759831.595411:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:100263:x1869355218628608:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759831.595429:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759831.595447:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e08b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277c1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.595477:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277c1 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.595489:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e08b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277c1 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759831.595497:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759831.595560:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218628608:12345-192.168.202.31@tcp:101:ll_cfg_requeue.0 Request processed in 153us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759831.595565:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3529 00000100:00100000:1.0:1782759831.600531:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759831.602451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628736 00000100:00100000:0.0:1782759831.602465:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628736 00000100:00100000:0.0:1782759831.602573:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3530 00000100:00100000:0.0:1782759831.602600:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218628736:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782759831.602768:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:100263:x1869355218628736:12345-192.168.202.31@tcp:501:ll_cfg_requeue.0 Request processed in 162us (2238us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782759831.602777:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3530 00000100:00100000:1.0:1782759832.458988:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233142912:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459062:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759832.459116:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233143424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459143:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759832.459177:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233143936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459201:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759832.459225:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759832.459232:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233143040:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459253:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759832.459268:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233143552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459288:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759832.459303:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233144064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459331:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759832.459368:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142912 00000100:00100000:1.0:1782759832.459375:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142912 00000100:00100000:1.0:1782759832.459438:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3532 00000100:00100000:1.0:1782759832.459447:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459506:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233142912:12345-0@lo:400:kworker.0 Request processed in 59us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.459514:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3532 00000100:00100000:1.0:1782759832.459538:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143424 00000100:00100000:1.0:1782759832.459542:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143424 00000100:00100000:1.0:1782759832.459614:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143936 00000100:00100000:1.0:1782759832.459617:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143936 00000100:00100000:1.0:1782759832.459638:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143040 00000100:00100000:1.0:1782759832.459641:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143040 00000100:00100000:1.0:1782759832.459657:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5540 00000100:00100000:1.0:1782759832.459664:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233143424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459695:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233143424:12345-0@lo:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.459701:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5540 00000100:00100000:1.0:1782759832.459720:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5541 00000100:00100000:1.0:1782759832.459726:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233143936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459756:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233143936:12345-0@lo:400:kworker.0 Request processed in 30us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.459762:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5541 00000100:00100000:1.0:1782759832.459773:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5542 00000100:00100000:1.0:1782759832.459779:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233143040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459806:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233143040:12345-0@lo:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.459811:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5542 00000100:00100000:1.0:1782759832.459835:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143552 00000100:00100000:1.0:1782759832.459839:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143552 00000100:00100000:1.0:1782759832.459881:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144064 00000100:00100000:1.0:1782759832.459885:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144064 00000100:00100000:1.0:1782759832.459904:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3267 00000100:00100000:1.0:1782759832.459910:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233143552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459941:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233143552:12345-0@lo:400:kworker.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.459948:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3267 00000100:00100000:1.0:1782759832.459959:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3268 00000100:00100000:1.0:1782759832.459965:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233144064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.459992:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233144064:12345-0@lo:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759832.459998:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3268 00000100:00080000:1.0:1782759832.460016:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759832.460021:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759832.460024:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759832.460085:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233143040:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.460097:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233143552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.460106:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233144064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.460115:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233142912:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.460124:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233143424:0@lo:400:kworker.0 00000100:00100000:1.0:1782759832.460133:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233143936:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460335:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233142784:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460369:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460401:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233143296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460424:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460443:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233143808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460461:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460479:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782759832.460485:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233142656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460524:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460545:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233143168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460567:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460617:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233143680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460642:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460661:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233144192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460681:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759832.460709:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143680 00000100:00100000:3.0:1782759832.460713:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143680 00000100:00100000:3.0:1782759832.460764:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144192 00000100:00100000:3.0:1782759832.460767:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144192 00000100:00100000:3.0:1782759832.460784:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1782759832.460790:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233143680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460827:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233143680:12345-0@lo:400:kworker.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.460833:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3269 00000100:00100000:3.0:1782759832.460847:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1782759832.460853:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233144192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460892:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233144192:12345-0@lo:400:kworker.0 Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.460898:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3270 00000100:00100000:3.0:1782759832.460914:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142784 00000100:00100000:3.0:1782759832.460916:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142784 00000100:00100000:3.0:1782759832.460936:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143296 00000100:00100000:3.0:1782759832.460938:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143296 00000100:00100000:3.0:1782759832.460950:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143808 00000100:00100000:3.0:1782759832.460952:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143808 00000100:00100000:3.0:1782759832.460966:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5543 00000100:00100000:3.0:1782759832.460972:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233142784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.460999:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233142784:12345-0@lo:400:kworker.0 Request processed in 27us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.461005:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5543 00000100:00100000:3.0:1782759832.461016:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5544 00000100:00100000:3.0:1782759832.461023:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233143296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461047:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233143296:12345-0@lo:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.461054:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5544 00000100:00100000:3.0:1782759832.461064:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5545 00000100:00100000:3.0:1782759832.461070:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233143808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461094:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233143808:12345-0@lo:400:kworker.0 Request processed in 24us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.461100:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5545 00000100:00100000:3.0:1782759832.461119:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233143168 00000100:00100000:3.0:1782759832.461122:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233143168 00000100:00100000:3.0:1782759832.461155:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3533 00000100:00100000:3.0:1782759832.461161:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233143168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461191:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233143168:12345-0@lo:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759832.461197:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3533 00000100:00080000:3.0:1782759832.461224:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759832.461227:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759832.461229:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759832.461270:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233143168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461280:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233143680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461289:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233144192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461298:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233142784:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461307:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233143296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759832.461315:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233143808:0@lo:400:kworker.0 00000100:00100000:0.0:1782759832.461506:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233142656 00000100:00100000:0.0:1782759832.461511:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233142656 00000100:00100000:0.0:1782759832.461542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3531 00000100:00100000:0.0:1782759832.461548:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233142656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759832.461597:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233142656:12345-0@lo:400:kworker.0 Request processed in 50us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759832.461603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3531 00000100:00100000:3.0:1782759832.461980:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233142656:0@lo:400:kworker.0 00010000:00010000:0.0:1782759832.533362:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759832.972883:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233144320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759832.972955:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759832.973131:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144320 00000100:00100000:0.0:1782759832.973139:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144320 00000100:00100000:0.0:1782759832.973192:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1782759832.973201:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233144320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759832.973231:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759832.973284:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233144320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759832.973291:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000100:00100000:3.0:1782759832.973368:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233144320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759832.982371:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759832.990926:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233144448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759832.991011:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759832.991241:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144448 00000100:00100000:0.0:1782759832.991250:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144448 00000100:00100000:0.0:1782759832.991311:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1782759832.991320:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233144448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759832.991346:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 184391616 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759832.991410:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233144448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759832.991417:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:3.0:1782759832.991508:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233144448:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759833.558697:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759833.996749:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233144576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759833.996824:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759833.997304:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144576 00000100:00100000:1.0:1782759833.997311:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144576 00000100:00100000:1.0:1782759833.997374:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:1.0:1782759833.997383:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233144576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759833.997419:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 27901952 pending 0 free 1436676096 avail 1290436608 00000100:00100000:1.0:1782759833.997484:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233144576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759833.997491:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00100000:1.0:1782759833.997511:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759833.997520:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233144704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759833.997553:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759833.997613:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144704 00000100:00100000:1.0:1782759833.997617:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144704 00000100:00100000:1.0:1782759834.002776:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1782759834.002803:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233144704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759834.002841:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759834.002939:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233144704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (5389us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759834.002961:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00000100:00100000:1.0:1782759834.003043:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233144704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759834.003087:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233144576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759834.004733:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759834.004751:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233144832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759834.004805:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759834.004871:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144832 00000100:00100000:1.0:1782759834.004877:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144832 00000100:00100000:1.0:1782759834.004925:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:1.0:1782759834.004933:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233144832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759834.004951:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 192800704 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759834.004988:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233144832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759834.004995:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00000100:00080000:1.0:1782759834.005022:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759834.005048:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233144832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759834.334557:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759834.334634:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759834.334664:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759834.334751:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218629120 00000100:00100000:3.0:1782759834.334761:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218629120 00000100:00100000:3.0:1782759834.334821:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5546 00000100:00100000:3.0:1782759834.334831:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218629120:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759834.334911:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218629120:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759834.334919:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5546 00000100:00080000:3.0:1782759834.334955:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759834.335007:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628864 00000100:00100000:0.0:1782759834.335012:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628864 00000100:00100000:0.0:1782759834.335051:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3532 00000100:00100000:0.0:1782759834.335059:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218628864:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759834.335088:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2405:x1869355218628864:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759834.335094:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3532 00000100:00100000:1.0:1782759834.335451:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759834.335491:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759834.335910:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218628992 00000100:00100000:0.0:1782759834.335916:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218628992 00000100:00100000:0.0:1782759834.335959:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5547 00000100:00100000:0.0:1782759834.335968:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218628992:12345-192.168.202.31@tcp:400:kworker.0 00000100:00080000:3.0:1782759834.335993:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759834.336016:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2405:x1869355218628992:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 49us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759834.336025:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5547 00000100:00100000:2.0:1782759834.350467:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218629376 00000100:00100000:2.0:1782759834.350500:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218629376 00000100:00100000:2.0:1782759834.350612:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218629248 00000100:00100000:2.0:1782759834.350616:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218629248 00000100:00100000:2.0:1782759834.350651:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3271 00000100:00100000:2.0:1782759834.350663:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218629376:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759834.350752:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218629376:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 93us (16087us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759834.350760:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3271 00000100:00100000:2.0:1782759834.350779:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3272 00000100:00100000:2.0:1782759834.350787:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218629248:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759834.350813:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2405:x1869355218629248:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (15321us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759834.350819:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3272 00000100:00080000:1.0:1782759834.351509:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759834.351515:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1782759834.571337:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759835.594871:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759836.425350:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759836.427959:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218629632 00000100:00100000:2.0:1782759836.427974:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218629632 00000100:00100000:2.0:1782759836.428311:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 460 00000100:00100000:2.0:1782759836.428330:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:115940:x1869355218629632:12345-192.168.202.31@tcp:35:umount.0 00000100:00100000:2.0:1782759836.428753:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:115940:x1869355218629632:12345-192.168.202.31@tcp:35:umount.0 Request processed in 432us (3412us total) trans 4294968039 rc 0/0 00000100:00100000:2.0:1782759836.428761:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 460 00000100:00080000:1.0:1782759836.430043:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759836.430660:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759836.430730:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218629888 00000100:00100000:1.0:1782759836.430752:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218629888 00000100:00100000:1.0:1782759836.430818:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 461 00000100:00100000:1.0:1782759836.430839:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:115940:x1869355218629888:12345-192.168.202.31@tcp:35:umount.0 00000100:00080000:3.0:1782759836.431085:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759836.432246:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:115940:x1869355218629888:12345-192.168.202.31@tcp:35:umount.0 Request processed in 1413us (1665us total) trans 4294967787 rc 0/0 00000100:00100000:1.0:1782759836.432257:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 461 00000100:00100000:0.0:1782759836.444096:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759836.444184:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218630144 00000100:00100000:3.0:1782759836.444194:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218630144 00000100:00100000:3.0:1782759836.444253:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 462 00000100:00100000:3.0:1782759836.444264:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+6:115940:x1869355218630144:12345-192.168.202.31@tcp:35:umount.0 00000100:00100000:3.0:1782759836.444512:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:115940:x1869355218630144:12345-192.168.202.31@tcp:35:umount.0 Request processed in 250us (435us total) trans 4294968040 rc 0/0 00000100:00100000:3.0:1782759836.444521:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 462 00000100:00100000:0.0:1782759836.479385:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759836.479415:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759836.479442:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759836.479526:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218630272 00000100:00100000:2.0:1782759836.479537:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218630272 00000100:00100000:1.0:1782759836.479621:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218630528 00000100:00100000:1.0:1782759836.479626:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218630528 00000100:00100000:2.0:1782759836.479649:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218630400 00000100:00100000:2.0:1782759836.479653:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218630400 00000100:00100000:1.0:1782759836.479657:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 417 00000100:00100000:1.0:1782759836.479666:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+12:2403:x1869355218630272:12345-192.168.202.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1782759836.479672:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 418 00000100:00100000:2.0:1782759836.479678:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+12:2403:x1869355218630528:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759836.479681:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759836.479698:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e084 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277ba expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759836.479699:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759836.479706:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60a6d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d48 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759836.479715:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759836.479715:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759836.479764:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+10:2403:x1869355218630528:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 86us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759836.479772:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 418 00000100:00100000:2.0:1782759836.479790:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 419 00000100:00100000:2.0:1782759836.479799:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+9:2403:x1869355218630400:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759836.479806:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759836.479815:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd4dca00/0xd5b45c7f5c60a6d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26d41 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759836.479823:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759836.479851:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+8:2403:x1869355218630400:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 55us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759836.479858:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 419 00000100:00100000:1.0:1782759836.479883:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+7:2403:x1869355218630272:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 218us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759836.479889:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 417 00000100:00100000:0.0:1782759836.490077:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759836.490863:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218630912 00000100:00100000:3.0:1782759836.490875:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218630912 00000100:00100000:3.0:1782759836.490958:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1116 00000100:00100000:3.0:1782759836.490970:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2401:x1869355218630912:12345-192.168.202.31@tcp:9:umount.0 00000020:00000080:3.0:1782759836.491004:0:82628:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60d2ae 00000020:00010000:3.0:1782759836.491012:0:82628:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cddc4e20000: total 0 00000100:00080000:3.0:1782759836.491017:0:82628:0:(import.c:65:import_set_state_nolock()) ffff8cddc4d1f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759836.491066:0:82628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967443 00000100:00100000:3.0:1782759836.491250:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218630912:12345-192.168.202.31@tcp:9:umount.0 Request processed in 282us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759836.491260:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1116 00000100:00080000:1.0:1782759836.491282:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1782759836.492534:0:9533:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cddc4e20000: total 0 00010000:00010000:0.0:1782759836.492542:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759836.492646:0:9533:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc4e20000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1782759836.492704:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000683e39bb/0xd5b45c7f5c60d2ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2754b expref: 4 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.492739:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057d7444f/0xd5b45c7f5c60d7b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27616 expref: 3 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.492765:0:9533:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc4e20000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1782759836.492778:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759836.492780:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759836.492781:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759836.495452:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759836.495649:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218631296 00000100:00100000:2.0:1782759836.495659:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218631296 00000100:00100000:2.0:1782759836.495733:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1117 00000100:00100000:2.0:1782759836.495751:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2401:x1869355218631296:12345-192.168.202.31@tcp:9:umount.0 00000020:00000080:2.0:1782759836.495835:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60a6ee 00000020:00010000:2.0:1782759836.495844:0:8446:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cddc4599000: total 0 00000100:00080000:2.0:1782759836.495849:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cddc459b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759836.495893:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967449 00000100:00100000:2.0:1782759836.496054:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218631296:12345-192.168.202.31@tcp:9:umount.0 Request processed in 311us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759836.496070:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1117 00000020:00010000:0.0:1782759836.496679:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cddc4599000: total 0 00010000:00010000:0.0:1782759836.496723:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc4599000, canceled 0 locks, left on hash table 2. 00002000:00010000:0.0:1782759836.496765:0:6518:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 0 -> 3 00002000:00010000:0.0:1782759836.496769:0:6518:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 1782759523 00002000:00010000:0.0:1782759836.496772:0:6518:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1782759836.496796:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1872e70/0xd5b45c7f5c60cd98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27448 expref: 4 pid: 8600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.496849:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a94194c/0xd5b45c7f5c60abb0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb26e60 expref: 3 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759836.496865:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc4599000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1782759836.496879:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759836.496881:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759836.496883:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782759836.497648:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759836.527838:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759836.528042:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218634880 00000100:00100000:3.0:1782759836.528053:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218634880 00000100:00100000:3.0:1782759836.528120:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3121 00000100:00100000:3.0:1782759836.528130:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2401:x1869355218634880:12345-192.168.202.31@tcp:39:umount.0 00000020:00000080:3.0:1782759836.528162:0:12673:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60a6e0 00000100:00080000:3.0:1782759836.528181:0:12673:0:(import.c:65:import_set_state_nolock()) ffff8cdec924b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759836.528211:0:12673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968040 00000100:00100000:3.0:1782759836.528370:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+5:2401:x1869355218634880:12345-192.168.202.31@tcp:39:umount.0 Request processed in 241us (552us total) trans 4294968041 rc 0/0 00000100:00100000:3.0:1782759836.528378:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3121 00010000:00010000:0.0:1782759836.528983:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759836.541977:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759836.542054:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218637184 00000100:00100000:3.0:1782759836.542065:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218637184 00000100:00100000:3.0:1782759836.542123:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3122 00000100:00100000:3.0:1782759836.542132:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+8:2401:x1869355218637184:12345-192.168.202.31@tcp:39:umount.0 00000020:00000080:3.0:1782759836.542164:0:8593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60a6e7 00000020:00010000:3.0:1782759836.542171:0:8593:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cdec924d800: total 0 00000100:00080000:3.0:1782759836.542175:0:8593:0:(import.c:65:import_set_state_nolock()) ffff8cdec924e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782759836.542199:0:8593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967787 00000100:00100000:3.0:1782759836.542340:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0+7:2401:x1869355218637184:12345-192.168.202.31@tcp:39:umount.0 Request processed in 208us (371us total) trans 4294967788 rc 0/0 00000100:00100000:3.0:1782759836.542349:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3122 00000020:00010000:2.0:1782759836.542411:0:9533:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cdec924d800: total 0 00010000:00010000:2.0:1782759836.542474:0:9533:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cdec924d800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759836.542569:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:2.0:1782759836.542573:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 59 00010000:00010000:2.0:1782759836.542792:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60df49 lrc: 0/0,0 mode: --/PW res: [0x240000405:0x2f:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2779e expref: 6 pid: 12673 timeout: 3955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759836.542815:0:9533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000405:0x2f:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:2.0:1782759836.542817:0:9533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782759836.542821:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60df5e lrc: 0/0,0 mode: --/PR res: [0x240000405:0x2f:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277a5 expref: 5 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759836.542848:0:9533:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cdec924d800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1782759836.542864:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759836.542866:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759836.542868:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759836.554945:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759836.555008:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233144960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759836.555075:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759836.555252:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233144960 00000100:00100000:3.0:1782759836.555259:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233144960 00000100:00100000:3.0:1782759836.555318:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535 00000100:00100000:3.0:1782759836.555326:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233144960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759836.555359:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445670912 avail 1299431424 00000100:00100000:3.0:1782759836.556088:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233144960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 760us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759836.556098:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535 00000100:00100000:0.0:1782759836.556189:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233144960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759836.604991:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759836.605164:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218637440 00000100:00100000:0.0:1782759836.605174:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218637440 00000100:00100000:0.0:1782759836.605240:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3533 00000100:00100000:0.0:1782759836.605249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+7:2401:x1869355218637440:12345-192.168.202.31@tcp:251:umount.0 00000020:00000080:0.0:1782759836.605286:0:6526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60a6bd 00000020:00010000:0.0:1782759836.605293:0:6526:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cddc3f45800: total 0 00000100:00080000:0.0:1782759836.605297:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8cddc3f40800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782759836.605362:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:489d39fd-cfd2-42d4-9932-d6e3c45e06c5+3:2401:x1869355218637440:12345-192.168.202.31@tcp:251:umount.0 Request processed in 113us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759836.605368:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3533 00000020:00010000:2.0:1782759836.605674:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cddc3f45800: total 0 00010000:00010000:2.0:1782759836.605678:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759836.605742:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc3f45800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782759836.605786:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e08b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277c1 expref: 2 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759836.605802:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc3f45800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1782759836.605815:0:6518:0:(genops.c:906:class_export_put()) final put ffff8cddc3f45800/489d39fd-cfd2-42d4-9932-d6e3c45e06c5 00010000:00010000:2.0:1782759836.605853:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759836.605855:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759836.605857:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759836.606198:0:29139:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc3f45800/489d39fd-cfd2-42d4-9932-d6e3c45e06c5 for MGS 00000020:00000080:0.0:1782759836.606238:0:29139:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc3f40800 for MGS 00010000:00010000:0.0:1782759836.618904:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759837.302210:0:161859:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1cd0bcc0 20000000:00000080:0.0:1782759837.302227:0:161859:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf87b800 uarg=0000000000000000 10000000:01000000:0.0:1782759837.303491:0:161859:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759837.303516:0:161859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.303536:0:161859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.303545:0:161859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.303814:0:161859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.303837:0:161859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 23 pid: 6524 timeout: 4027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759837.303851:0:161859:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7215180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161859:1869355233145088:0@lo:104: 00000100:00100000:0.0:1782759837.303917:0:161859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759837.304078:0:161859:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759837.304125:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145088 00000100:00100000:1.0:1782759837.304134:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145088 00000100:00100000:1.0:1782759837.304222:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:1.0:1782759837.304231:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:161859:x1869355233145088:12345-0@lo:104: 00010000:00010000:1.0:1782759837.304244:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759837.304310:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759837.304331:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:161859:x1869355233145088:12345-0@lo:104: Request processed in 100us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.304337:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1782759837.304398:0:161859:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7215180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161859:1869355233145088:0@lo:104: 00010000:00010000:0.0:1782759837.304417:0:161859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304465:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759837.304473:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304480:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759837.304484:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304492:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759837.304501:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759837.304506:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759837.304545:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304552:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759837.304573:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304601:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60ded9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60dee0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304617:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759837.304618:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759837.304620:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759837.304630:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233145216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759837.304661:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.304693:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145216 00000100:00100000:3.0:1782759837.304696:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145216 00010000:00010000:3.0:1782759837.304715:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 24 pid: 6524 timeout: 4027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759837.304734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1782759837.304740:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233145216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759837.304759:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759837.304764:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 24 pid: 6524 timeout: 4027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304774:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 24 pid: 6524 timeout: 4027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304786:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60dee0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60ded9 expref: 24 pid: 6524 timeout: 4027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304798:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304809:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304832:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304840:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304846:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304854:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304860:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759837.304863:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304869:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304881:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759837.304890:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759837.304916:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233145216:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.304922:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1782759837.304962:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233145216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759837.305153:0:161859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.305165:0:161859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759837.305171:0:161859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e092 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759837.580427:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233145472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.580509:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.580570:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233145984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.580757:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.580784:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233146496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.580806:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.580842:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782759837.580848:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233145344:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.580870:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.580887:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233145856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.580907:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.580920:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233146368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.580971:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.580998:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233145600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581021:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.581037:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233146112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581060:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.581075:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233146624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581094:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.581111:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759837.581116:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233145728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581136:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.581149:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233146240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581207:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.581223:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233146752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581240:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759837.581272:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145984 00000100:00100000:3.0:1782759837.581279:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145984 00000100:00100000:3.0:1782759837.581324:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146496 00000100:00100000:3.0:1782759837.581328:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146496 00000100:00100000:3.0:1782759837.581343:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145344 00000100:00100000:3.0:1782759837.581346:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145344 00000100:00100000:3.0:1782759837.581357:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145856 00000100:00100000:3.0:1782759837.581359:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145856 00000100:00100000:3.0:1782759837.581370:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146368 00000100:00100000:3.0:1782759837.581372:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146368 00000100:00100000:3.0:1782759837.581382:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145600 00000100:00100000:3.0:1782759837.581385:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145600 00000100:00100000:3.0:1782759837.581399:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5548 00000100:00100000:3.0:1782759837.581408:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233145984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581461:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233145984:12345-0@lo:400:kworker.0 Request processed in 54us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581468:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5548 00000100:00100000:3.0:1782759837.581483:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5549 00000100:00100000:3.0:1782759837.581490:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233146496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581516:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233146496:12345-0@lo:400:kworker.0 Request processed in 27us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581522:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5549 00000100:00100000:3.0:1782759837.581532:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5550 00000100:00100000:3.0:1782759837.581538:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233145344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581563:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233145344:12345-0@lo:400:kworker.0 Request processed in 26us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581573:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5550 00000100:00100000:3.0:1782759837.581609:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5551 00000100:00100000:3.0:1782759837.581616:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233145856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581642:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233145856:12345-0@lo:400:kworker.0 Request processed in 27us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581648:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5551 00000100:00100000:3.0:1782759837.581658:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5552 00000100:00100000:3.0:1782759837.581663:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233146368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581689:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233146368:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581695:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5552 00000100:00100000:3.0:1782759837.581704:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5553 00000100:00100000:3.0:1782759837.581709:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233145600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581734:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233145600:12345-0@lo:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581740:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5553 00000100:00100000:3.0:1782759837.581766:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146112 00000100:00100000:3.0:1782759837.581769:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146112 00000100:00100000:3.0:1782759837.581795:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146624 00000100:00100000:3.0:1782759837.581798:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146624 00000100:00100000:3.0:1782759837.581808:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146240 00000100:00100000:3.0:1782759837.581811:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146240 00000100:00100000:3.0:1782759837.581835:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146752 00000100:00100000:3.0:1782759837.581838:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146752 00000100:00100000:3.0:1782759837.581849:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3273 00000100:00100000:3.0:1782759837.581855:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233146112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581886:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233146112:12345-0@lo:400:kworker.0 Request processed in 31us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581892:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3273 00000100:00100000:3.0:1782759837.581901:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3274 00000100:00100000:3.0:1782759837.581907:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233146624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581931:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233146624:12345-0@lo:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581937:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3274 00000100:00100000:3.0:1782759837.581947:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3275 00000100:00100000:3.0:1782759837.581953:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233146240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.581979:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233146240:12345-0@lo:400:kworker.0 Request processed in 26us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.581983:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3275 00000100:00100000:3.0:1782759837.581993:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1782759837.581998:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233146752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582022:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233146752:12345-0@lo:400:kworker.0 Request processed in 24us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759837.582027:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3276 00000100:00100000:3.0:1782759837.582070:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233145344:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582080:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233145856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582089:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233146368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582097:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233145984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582105:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233146496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582138:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233146240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582146:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233146752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582154:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233145600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582162:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233146112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759837.582169:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233146624:0@lo:400:kworker.0 00000100:00100000:1.0:1782759837.582425:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145472 00000100:00100000:1.0:1782759837.582430:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145472 00000100:00100000:1.0:1782759837.582474:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233145728 00000100:00100000:1.0:1782759837.582476:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233145728 00000100:00100000:1.0:1782759837.582488:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1782759837.582493:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233145472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759837.582533:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233145472:12345-0@lo:400:kworker.0 Request processed in 40us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.582538:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1782759837.582547:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3537 00000100:00100000:1.0:1782759837.582552:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233145728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759837.582595:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233145728:12345-0@lo:400:kworker.0 Request processed in 42us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759837.582601:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3537 00000100:00080000:1.0:1782759837.582614:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759837.582617:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759837.582619:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759837.582621:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759837.582636:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233145472:0@lo:400:kworker.0 00000100:00100000:1.0:1782759837.582654:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233145728:0@lo:400:kworker.0 00010000:00010000:2.0:1782759837.642911:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759838.092034:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759838.092058:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233146880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759838.092124:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759838.092187:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233146880 00000100:00100000:1.0:1782759838.092208:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233146880 00000100:00100000:1.0:1782759838.092255:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1782759838.092263:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233146880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759838.092292:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759838.092338:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233146880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.092346:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1782759838.092388:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233146880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759838.092427:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233147008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759838.092443:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759838.092460:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147008 00000100:00100000:1.0:1782759838.092463:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147008 00000100:00100000:1.0:1782759838.092478:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:1.0:1782759838.092482:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233147008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759838.092489:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759838.092507:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233147008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759838.092511:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000100:00100000:1.0:1782759838.092526:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233147008:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1782759838.334832:0:161907:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd2304ea0 20000000:00000080:3.0:1782759838.334850:0:161907:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3c5b800 uarg=0000000000000000 10000000:01000000:3.0:1782759838.335022:0:161907:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759838.335044:0:161907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335063:0:161907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335074:0:161907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335194:0:161907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335202:0:161907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335210:0:161907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335216:0:161907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759838.335221:0:161907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335229:0:161907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335242:0:161907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335247:0:161907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759838.335252:0:161907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e099 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759838.668943:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759839.117673:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759839.117681:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759839.117686:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759839.117722:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759839.117736:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759839.117747:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759839.117771:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233147264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759839.117852:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759839.117898:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3d1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759839.122153:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233147392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759839.122230:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759839.122270:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759839.122278:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233147136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759839.122301:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759839.122355:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147264 00000100:00100000:3.0:1782759839.122362:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147264 00000100:00100000:3.0:1782759839.122412:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3534 00000100:00100000:3.0:1782759839.122421:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233147264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759839.122436:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759839.122454:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e0a0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.122479:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.122492:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.122501:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7800, rc 0) 00000100:00100000:3.0:1782759839.122540:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233147264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (4688us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759839.122546:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3534 00000100:00100000:3.0:1782759839.125270:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233147264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759839.125299:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.125311:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759839.125333:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759839.125338:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.125345:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759839.125476:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147392 00000100:00100000:1.0:1782759839.125484:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147392 00000100:00100000:1.0:1782759839.125568:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1782759839.125598:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233147392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759839.125629:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759839.125702:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233147392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (3472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.125727:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:1.0:1782759839.125752:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147136 00000100:00100000:1.0:1782759839.125756:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147136 00000100:00100000:1.0:1782759839.125812:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3538 00000100:00100000:1.0:1782759839.125819:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233147136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759839.125841:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1436676096 avail 1290436608 00000100:00100000:1.0:1782759839.125894:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233147136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.125899:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3538 00000100:00100000:1.0:1782759839.125970:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233147136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759839.125988:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233147392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759839.126231:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759839.126395:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759839.126408:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233147520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759839.126450:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759839.126485:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147520 00000100:00100000:2.0:1782759839.126489:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147520 00000100:00100000:2.0:1782759839.126535:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:2.0:1782759839.126542:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233147520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759839.126554:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759839.126614:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233147520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759839.126620:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00000100:00080000:2.0:1782759839.126635:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759839.126658:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233147520:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1782759839.401127:0:161956:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe71615020 20000000:00000080:3.0:1782759839.401204:0:161956:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3c2ac00 uarg=0000000000000000 10000000:01000000:3.0:1782759839.401374:0:161956:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759839.401392:0:161956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.401413:0:161956:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.401422:0:161956:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.401461:0:161956:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.401472:0:161956:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 23 pid: 6525 timeout: 4029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759839.401483:0:161956:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161956:1869355233147648:0@lo:104: 00000100:00100000:3.0:1782759839.401871:0:161956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759839.401973:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759839.401988:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147648 00000100:00100000:1.0:1782759839.401994:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147648 00000100:00100000:3.0:1782759839.402048:0:161956:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759839.402080:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1782759839.402088:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc57dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:161956:x1869355233147648:12345-0@lo:104: 00010000:00010000:1.0:1782759839.402098:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402156:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759839.402162:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc57dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:161956:x1869355233147648:12345-0@lo:104: Request processed in 75us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.402169:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00010000:00010000:0.0:1782759839.402233:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1782759839.402234:0:161956:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:161956:1869355233147648:0@lo:104: 00010000:00010000:0.0:1782759839.402240:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759839.402247:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759839.402250:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.402253:0:161956:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759839.402264:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759839.402272:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759839.402278:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759839.402309:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759839.402316:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759839.402338:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759839.402341:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233147776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759839.402345:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf802400/0xd5b45c7f5c60e0a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e0a7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759839.402359:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759839.402361:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759839.402363:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759839.402368:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759839.402465:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147776 00000100:00100000:1.0:1782759839.402468:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147776 00010000:00010000:1.0:1782759839.402482:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 24 pid: 6525 timeout: 4029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759839.402545:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:1.0:1782759839.402552:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233147776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759839.402562:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759839.402567:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 24 pid: 6525 timeout: 4029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402600:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 24 pid: 6525 timeout: 4029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402615:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7800/0xd5b45c7f5c60e0a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0a0 expref: 24 pid: 6525 timeout: 4029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402626:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402634:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402646:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402653:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402660:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402667:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402683:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759839.402687:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402695:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402712:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759839.402723:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759839.402760:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233147776:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759839.402767:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:2.0:1782759839.402832:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233147776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759839.403059:0:161956:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.403065:0:161956:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759839.403069:0:161956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0ae lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 161956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759839.691832:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759840.233831:0:162004:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd3a692e0 20000000:00000080:1.0:1782759840.233848:0:162004:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc48a4400 uarg=0000000000000000 10000000:01000000:1.0:1782759840.234064:0:162004:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759840.234084:0:162004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234100:0:162004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234111:0:162004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234119:0:162004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234127:0:162004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234142:0:162004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234149:0:162004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759840.234154:0:162004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234163:0:162004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234176:0:162004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234184:0:162004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.234192:0:162004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e0b5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759840.651409:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759840.651418:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759840.651425:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759840.651477:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.651489:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759840.651500:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759840.651527:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233147904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759840.651649:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759840.651703:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44be540 going to sleep for 11 seconds 00000100:00100000:1.0:1782759840.651942:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233147904 00000100:00100000:1.0:1782759840.651952:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233147904 00000100:00100000:1.0:1782759840.652022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3535 00000100:00100000:1.0:1782759840.652033:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233147904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759840.652048:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759840.652063:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e0bc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.652087:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.652115:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759840.652123:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759840.665225:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233147904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 13183us (13565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759840.665239:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3535 00000100:00100000:0.0:1782759840.665454:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233147904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759840.665483:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.665495:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759840.665521:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759840.665527:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.665534:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759840.719212:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759841.675026:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233148032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759841.675122:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759841.675243:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148032 00000100:00100000:1.0:1782759841.675261:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148032 00000100:00100000:1.0:1782759841.675342:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3539 00000100:00100000:1.0:1782759841.675353:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233148032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759841.675389:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759841.675449:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233148032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759841.675456:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3539 00000100:00100000:2.0:1782759841.676080:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233148032:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759841.739699:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759842.704622:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233148160:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.704698:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.704754:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233148672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.704791:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.704812:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233149184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.704832:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.704845:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233149696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705356:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233148288:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705415:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759842.705437:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233148800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705458:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759842.705475:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233149312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705494:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759842.705517:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759842.705524:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233148416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705546:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759842.705559:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233148928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705593:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759842.705610:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233149440:0@lo:400:kworker.0 00000100:00100000:0.0:1782759842.705631:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759842.705693:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148288 00000100:00100000:0.0:1782759842.705707:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148288 00000100:00100000:0.0:1782759842.705746:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148800 00000100:00100000:0.0:1782759842.705749:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148800 00000100:00100000:0.0:1782759842.705771:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149312 00000100:00100000:0.0:1782759842.705783:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149312 00000100:00100000:0.0:1782759842.705797:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148928 00000100:00100000:0.0:1782759842.705799:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148928 00000100:00100000:0.0:1782759842.705809:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149440 00000100:00100000:0.0:1782759842.705811:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149440 00000100:00100000:0.0:1782759842.705824:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5554 00000100:00100000:0.0:1782759842.705831:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233148288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.706012:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148160 00000100:00100000:1.0:1782759842.706016:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148160 00000100:00100000:1.0:1782759842.706047:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1782759842.706053:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233148160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.706096:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233148160:12345-0@lo:400:kworker.0 Request processed in 43us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.706103:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3536 00000100:00100000:1.0:1782759842.706937:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148672 00000100:00100000:1.0:1782759842.706945:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148672 00000100:00100000:1.0:1782759842.707001:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148416 00000100:00100000:1.0:1782759842.707004:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148416 00000100:00100000:1.0:1782759842.707030:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3540 00000100:00100000:1.0:1782759842.707037:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233148672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.707089:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233148672:12345-0@lo:400:kworker.0 Request processed in 52us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.707096:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3540 00000100:00100000:1.0:1782759842.707110:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3541 00000100:00100000:1.0:1782759842.707117:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233148416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.709342:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.709409:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233148160:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.709428:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233148672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.709451:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782759842.709462:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233148544:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.709491:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.709504:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233149056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.709522:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.709537:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233149568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.709558:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759842.709664:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149184 00000100:00100000:3.0:1782759842.709671:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149184 00000100:00100000:3.0:1782759842.709721:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149696 00000100:00100000:3.0:1782759842.709725:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149696 00000100:00100000:3.0:1782759842.709737:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149056 00000100:00100000:3.0:1782759842.709739:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149056 00000100:00100000:3.0:1782759842.709751:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149568 00000100:00100000:3.0:1782759842.709752:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149568 00000100:00100000:3.0:1782759842.709766:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3277 00000100:00100000:3.0:1782759842.709978:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233149184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710039:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233149184:12345-0@lo:400:kworker.0 Request processed in 265us (5204us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759842.710046:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3277 00000100:00100000:3.0:1782759842.710064:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3278 00000100:00100000:3.0:1782759842.710071:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233149696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710098:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233149696:12345-0@lo:400:kworker.0 Request processed in 29us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759842.710103:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3278 00000100:00100000:3.0:1782759842.710114:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3279 00000100:00100000:3.0:1782759842.710120:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233149056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710156:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233149056:12345-0@lo:400:kworker.0 Request processed in 36us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759842.710161:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3279 00000100:00100000:3.0:1782759842.710173:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3280 00000100:00100000:3.0:1782759842.710179:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233149568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710203:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233149568:12345-0@lo:400:kworker.0 Request processed in 24us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759842.710208:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3280 00000100:00100000:3.0:1782759842.710276:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233149056:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710285:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233149568:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710296:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233149184:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.710306:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233149696:0@lo:400:kworker.0 00000001:00100000:3.0:1782759842.713900:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000001:00080000:3.0:1782759842.713917:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968041 is committed 00000020:00000080:3.0:1782759842.713926:0:6509:0:(genops.c:906:class_export_put()) final put ffff8cdec924a000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759842.713952:0:1371:0:(genops.c:865:class_export_destroy()) destroying export ffff8cdec924a000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-MDT0000 00000020:00000080:3.0:1782759842.714008:0:1371:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cdec924b000 for lustre-MDT0000 00000100:00100000:1.0:1782759842.715846:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233148416:12345-0@lo:400:kworker.0 Request processed in 8721us (10290us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.715872:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3541 00000100:00100000:1.0:1782759842.715922:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233148544 00000100:00100000:1.0:1782759842.715930:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233148544 00000100:00100000:1.0:1782759842.715963:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5555 00000100:00100000:1.0:1782759842.715972:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233148800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.716042:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233148800:12345-0@lo:400:kworker.0 Request processed in 71us (10582us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.716048:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5555 00000100:00100000:1.0:1782759842.716062:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5556 00000100:00100000:1.0:1782759842.716068:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233149312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.716099:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7217800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233149312:12345-0@lo:400:kworker.0 Request processed in 31us (10604us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.716104:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5556 00000100:00100000:1.0:1782759842.716115:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5557 00000100:00100000:1.0:1782759842.716120:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233148928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.716159:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233148928:12345-0@lo:400:kworker.0 Request processed in 39us (10565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.716172:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5557 00000100:00100000:1.0:1782759842.716184:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5558 00000100:00100000:1.0:1782759842.716189:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233149440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.716218:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233149440:12345-0@lo:400:kworker.0 Request processed in 29us (10587us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.716223:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5558 00000100:00100000:1.0:1782759842.716233:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5559 00000100:00100000:1.0:1782759842.716238:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233148544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759842.716272:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233148544:12345-0@lo:400:kworker.0 Request processed in 34us (6780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.716278:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5559 00000100:00100000:1.0:1782759842.716331:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233148544:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.717680:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233148416:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.717713:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233148928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.717727:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233149440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.717738:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233148800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759842.717748:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233149312:0@lo:400:kworker.0 00000001:00100000:1.0:1782759842.717987:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:1.0:1782759842.717993:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc4e20000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759842.718291:0:29139:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc4e20000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0001 00000020:00000080:3.0:1782759842.718340:0:29139:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc4d1f800 for lustre-OST0001 00000001:00100000:1.0:1782759842.718506:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000001:00080000:1.0:1782759842.718516:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967788 is committed 00000020:00000080:1.0:1782759842.718520:0:7461:0:(genops.c:906:class_export_put()) final put ffff8cdec924d800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000100:00080000:0.0:1782759842.724074:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759842.724085:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759842.724088:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759842.724091:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1782759842.724705:0:1371:0:(genops.c:865:class_export_destroy()) destroying export ffff8cdec924d800/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-MDT0001 00000020:00000080:3.0:1782759842.724788:0:1371:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cdec924e000 for lustre-MDT0001 00000100:00100000:1.0:1782759842.726166:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233148288:12345-0@lo:400:kworker.0 Request processed in 20325us (20741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759842.726179:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5554 00000100:00100000:3.0:1782759842.726914:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233148288:0@lo:400:kworker.0 00000001:00100000:3.0:1782759842.730024:0:8440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:3.0:1782759842.730035:0:8440:0:(genops.c:906:class_export_put()) final put ffff8cddc4599000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 00000020:00000080:0.0:1782759842.730094:0:29139:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc4599000/e6fbb6ea-5f5a-4f85-9d60-2035db13e2c0 for lustre-OST0000 00000020:00000080:0.0:1782759842.739746:0:29139:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc459b000 for lustre-OST0000 00010000:00010000:2.0:1782759842.766075:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759843.215741:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759843.215763:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233149824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759843.215840:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759843.216150:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149824 00000100:00100000:3.0:1782759843.216159:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149824 00000100:00100000:3.0:1782759843.216209:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1782759843.216220:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233149824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759843.216276:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759843.216323:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233149824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759843.216331:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000100:00100000:3.0:1782759843.216492:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233149824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759843.219133:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759843.219163:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233149952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759843.219235:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759843.219317:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233149952 00000100:00100000:3.0:1782759843.219326:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233149952 00000100:00100000:3.0:1782759843.219391:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:3.0:1782759843.219401:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233149952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759843.219424:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759843.219479:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233149952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759843.219486:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:1.0:1782759843.220174:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233149952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782759843.786778:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759843.828024:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759843.828113:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218637568 00000100:00100000:1.0:1782759843.828123:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218637568 00000100:00100000:1.0:1782759843.828184:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3537 00000100:00100000:1.0:1782759843.828192:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1869355218637568:12345-192.168.202.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782759843.828223:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from aa0a3d0a-2da7-4899-8fa4-e6a802a55616@192.168.202.31@tcp t0 exp 0000000000000000 cur 3884 last 0 00000020:00000080:1.0:1782759843.828255:0:6524:0:(genops.c:1406:class_connect()) connect: client aa0a3d0a-2da7-4899-8fa4-e6a802a55616, cookie 0xd5b45c7f5c60e0ca 00000100:00080000:1.0:1782759843.828300:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8cddc70b9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759843.828368:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+5:2401:x1869355218637568:12345-192.168.202.31@tcp:250:mount.lustre.0 Request processed in 175us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759843.828376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3537 00000100:00100000:2.0:1782759843.837777:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759843.838095:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218637696 00000100:00100000:1.0:1782759843.838105:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218637696 00000100:00100000:1.0:1782759843.838248:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3538 00000100:00100000:1.0:1782759843.838259:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+5:116054:x1869355218637696:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759843.838276:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759843.838294:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60e0d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277d6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.838324:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60e0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277d6 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.838337:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60e0d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277d6 expref: 6 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.838348:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412200, rc 0) 00000100:00100000:1.0:1782759843.838513:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+6:116054:x1869355218637696:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 254us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759843.838536:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3538 00000100:00100000:2.0:1782759843.859059:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759843.859200:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218637824 00000100:00100000:3.0:1782759843.859211:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218637824 00000100:00100000:3.0:1782759843.859272:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3539 00000100:00100000:3.0:1782759843.859283:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+6:116054:x1869355218637824:12345-192.168.202.31@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782759843.859447:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+6:116054:x1869355218637824:12345-192.168.202.31@tcp:501:mount.lustre.0 Request processed in 166us (407us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759843.859454:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3539 00000100:00100000:2.0:1782759843.863865:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759843.863975:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218637952 00000100:00100000:1.0:1782759843.863987:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218637952 00000100:00100000:1.0:1782759843.864061:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3540 00000100:00100000:1.0:1782759843.864070:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+6:116054:x1869355218637952:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759843.864089:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759843.864107:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413a00/0xd5b45c7f5c60e0d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb277dd expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.864135:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413a00/0xd5b45c7f5c60e0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277dd expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.864146:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413a00/0xd5b45c7f5c60e0d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277dd expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.864156:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413a00, rc 0) 00000100:00100000:1.0:1782759843.864217:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+7:116054:x1869355218637952:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 148us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759843.864224:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3540 00000100:00100000:2.0:1782759843.866422:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759843.866518:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638080 00000100:00100000:0.0:1782759843.866528:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638080 00000100:00100000:0.0:1782759843.866614:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3541 00000100:00100000:0.0:1782759843.866624:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+7:116054:x1869355218638080:12345-192.168.202.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759843.866806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116054:x1869355218638080:12345-192.168.202.31@tcp:501:mount.lustre.0 Request processed in 182us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759843.866814:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3541 00000100:00100000:2.0:1782759843.868688:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759843.868799:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638208 00000100:00100000:3.0:1782759843.868808:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638208 00000100:00100000:3.0:1782759843.868852:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3542 00000100:00100000:3.0:1782759843.868862:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116054:x1869355218638208:12345-192.168.202.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759843.869014:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116054:x1869355218638208:12345-192.168.202.31@tcp:503:mount.lustre.0 Request processed in 152us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759843.869022:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3542 00000100:00100000:2.0:1782759843.875626:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759843.875985:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638336 00000100:00100000:1.0:1782759843.875995:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638336 00000100:00100000:1.0:1782759843.876064:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3543 00000100:00100000:1.0:1782759843.876075:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116073:x1869355218638336:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759843.876271:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116073:x1869355218638336:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 197us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759843.876279:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3543 00000100:00100000:2.0:1782759843.950559:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759843.950726:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638464 00000100:00100000:0.0:1782759843.950736:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638464 00000100:00100000:0.0:1782759843.950804:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3544 00000100:00100000:0.0:1782759843.950814:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116073:x1869355218638464:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759843.950967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116073:x1869355218638464:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 154us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759843.950975:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3544 00000100:00100000:2.0:1782759843.968532:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759843.972021:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638592 00000100:00100000:3.0:1782759843.972035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638592 00000100:00100000:3.0:1782759843.972103:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3545 00000100:00100000:3.0:1782759843.972115:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116073:x1869355218638592:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759843.972285:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116073:x1869355218638592:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 172us (3762us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759843.972293:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3545 00000100:00100000:2.0:1782759843.990150:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759843.991000:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638720 00000100:00100000:1.0:1782759843.991012:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638720 00000100:00100000:1.0:1782759843.991066:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3546 00000100:00100000:1.0:1782759843.991076:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:116054:x1869355218638720:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759843.991094:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759843.991112:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5412600/0xd5b45c7f5c60e0df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2780e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.991140:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412600/0xd5b45c7f5c60e0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2780e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.991151:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5412600/0xd5b45c7f5c60e0df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2780e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759843.991170:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412600, rc 0) 00000100:00100000:1.0:1782759843.991230:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+9:116054:x1869355218638720:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 154us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759843.991238:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3546 00000100:00100000:2.0:1782759843.996919:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759844.003022:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638848 00000100:00100000:0.0:1782759844.003037:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638848 00000100:00100000:0.0:1782759844.003103:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3547 00000100:00100000:0.0:1782759844.003112:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+9:116054:x1869355218638848:12345-192.168.202.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782759844.003141:0:6524:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782759844.003180:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782759844.003186:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782759844.003190:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782759844.003193:0:6524:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1782759844.003195:0:6524:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1782759844.005248:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+9:116054:x1869355218638848:12345-192.168.202.31@tcp:256:mount.lustre.0 Request processed in 2128us (8331us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759844.005261:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3547 00000100:00100000:2.0:1782759844.009894:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759844.010030:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218638976 00000100:00100000:3.0:1782759844.010041:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218638976 00000100:00100000:3.0:1782759844.010096:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3548 00000100:00100000:3.0:1782759844.010106:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+9:116054:x1869355218638976:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759844.010122:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759844.010138:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7200/0xd5b45c7f5c60e0e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27815 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.010166:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7200/0xd5b45c7f5c60e0e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27815 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.010177:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7200/0xd5b45c7f5c60e0e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27815 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.010186:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7200, rc 0) 00000100:00100000:3.0:1782759844.010240:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116054:x1869355218638976:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.010247:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3548 00000100:00100000:2.0:1782759844.013995:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759844.014154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639104 00000100:00100000:1.0:1782759844.014165:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639104 00000100:00100000:1.0:1782759844.014226:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3549 00000100:00100000:1.0:1782759844.014235:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116054:x1869355218639104:12345-192.168.202.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759844.014401:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116054:x1869355218639104:12345-192.168.202.31@tcp:501:mount.lustre.0 Request processed in 165us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.014409:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3549 00000100:00100000:2.0:1782759844.023618:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759844.023727:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639232 00000100:00100000:0.0:1782759844.023738:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639232 00000100:00100000:0.0:1782759844.023803:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3550 00000100:00100000:0.0:1782759844.023815:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116054:x1869355218639232:12345-192.168.202.31@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782759844.024731:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116054:x1869355218639232:12345-192.168.202.31@tcp:503:mount.lustre.0 Request processed in 913us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759844.024742:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3550 00000100:00100000:2.0:1782759844.030622:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759844.031124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639360 00000100:00100000:3.0:1782759844.031135:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639360 00000100:00100000:3.0:1782759844.031194:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3551 00000100:00100000:3.0:1782759844.031204:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116078:x1869355218639360:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759844.031491:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116078:x1869355218639360:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 287us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.031499:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3551 00000100:00100000:2.0:1782759844.062439:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759844.062555:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639488 00000100:00100000:0.0:1782759844.062565:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639488 00000100:00100000:0.0:1782759844.062653:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3552 00000100:00100000:0.0:1782759844.062663:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116078:x1869355218639488:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759844.062834:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:116078:x1869355218639488:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 172us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759844.062842:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3552 00000100:00100000:2.0:1782759844.069025:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759844.069117:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759844.069251:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639616 00000100:00100000:1.0:1782759844.069263:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639616 00000100:00100000:1.0:1782759844.069314:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639872 00000100:00100000:1.0:1782759844.069317:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639872 00000100:00100000:1.0:1782759844.069343:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3123 00000100:00100000:1.0:1782759844.069353:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2401:x1869355218639616:12345-192.168.202.31@tcp:38:mount.lustre.0 00010000:00080000:1.0:1782759844.069385:0:42628:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 95b27dde-c150-4adf-930b-37620c52929b@192.168.202.31@tcp t0 exp 0000000000000000 cur 3884 last 0 00000020:00000080:1.0:1782759844.069425:0:42628:0:(genops.c:1406:class_connect()) connect: client 95b27dde-c150-4adf-930b-37620c52929b, cookie 0xd5b45c7f5c60e0ed 00000004:00100000:1.0:1782759844.069454:0:42628:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782759844.069485:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3124 00000100:00100000:3.0:1782759844.069492:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2401:x1869355218639872:12345-192.168.202.31@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782759844.069510:0:8593:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 95b27dde-c150-4adf-930b-37620c52929b@192.168.202.31@tcp t0 exp 0000000000000000 cur 3884 last 0 00000020:00000080:3.0:1782759844.069555:0:8593:0:(genops.c:1406:class_connect()) connect: client 95b27dde-c150-4adf-930b-37620c52929b, cookie 0xd5b45c7f5c60e0f4 00000004:00100000:3.0:1782759844.069568:0:8593:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1782759844.069569:0:42628:0:(import.c:65:import_set_state_nolock()) ffff8cddc70b8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759844.069735:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218639616:12345-192.168.202.31@tcp:38:mount.lustre.0 Request processed in 382us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.069744:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3123 00000100:00080000:3.0:1782759844.070050:0:8593:0:(import.c:65:import_set_state_nolock()) ffff8cddc47ff000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759844.070080:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218639872:12345-192.168.202.31@tcp:38:mount.lustre.0 Request processed in 586us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.070087:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3124 00000100:00100000:2.0:1782759844.075484:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759844.075646:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640128 00000100:00100000:0.0:1782759844.075657:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640128 00000100:00100000:0.0:1782759844.075755:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3125 00000100:00100000:0.0:1782759844.075775:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640128:12345-192.168.202.31@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782759844.075819:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00080000:1.0:1782759844.075967:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759844.076087:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640128:12345-192.168.202.31@tcp:41:mount.lustre.0 Request processed in 322us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759844.076095:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3125 00000100:00100000:2.0:1782759844.076636:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759844.076726:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759844.082028:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640000 00000100:00100000:1.0:1782759844.082044:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640000 00000100:00100000:1.0:1782759844.082173:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218639744 00000100:00100000:1.0:1782759844.082178:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218639744 00000100:00100000:1.0:1782759844.082211:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3126 00000100:00100000:1.0:1782759844.082222:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:0:x1869355218640000:12345-192.168.202.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759844.082262:0:42628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436676096 avail 1290436608 00000100:00100000:1.0:1782759844.082349:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:0:x1869355218640000:12345-192.168.202.31@tcp:41:mount.lustre.0 Request processed in 129us (5714us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.082358:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3126 00000100:00100000:1.0:1782759844.082377:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3127 00000100:00100000:1.0:1782759844.082384:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:0:x1869355218639744:12345-192.168.202.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759844.082396:0:42628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:1.0:1782759844.082427:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:0:x1869355218639744:12345-192.168.202.31@tcp:41:mount.lustre.0 Request processed in 43us (5700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.082434:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3127 00000100:00100000:1.0:1782759844.088433:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759844.088491:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640256 00000100:00100000:1.0:1782759844.088502:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640256 00000100:00100000:1.0:1782759844.088573:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3128 00000100:00100000:1.0:1782759844.088606:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640256:12345-192.168.202.31@tcp:40:mount.lustre.0 00000100:00100000:1.0:1782759844.088943:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640256:12345-192.168.202.31@tcp:40:mount.lustre.0 Request processed in 338us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.088952:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3128 00000100:00100000:1.0:1782759844.091906:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00080000:2.0:1782759844.092573:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759844.098378:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640384 00000100:00100000:3.0:1782759844.098395:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640384 00000100:00100000:2.0:1782759844.098857:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1118 00000100:00100000:2.0:1782759844.098869:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2401:x1869355218640384:12345-192.168.202.31@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782759844.098906:0:8447:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 95b27dde-c150-4adf-930b-37620c52929b@192.168.202.31@tcp t0 exp 0000000000000000 cur 3884 last 0 00000020:00000080:2.0:1782759844.098946:0:8447:0:(genops.c:1406:class_connect()) connect: client 95b27dde-c150-4adf-930b-37620c52929b, cookie 0xd5b45c7f5c60e0fb 00002000:00100000:2.0:1782759844.098961:0:8447:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95b27dde-c150-4adf-930b-37620c52929b/ffff8cddc68b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759844.098982:0:8447:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759844.099071:0:8447:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782759844.099109:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cddc68b1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759844.099193:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218640384:12345-192.168.202.31@tcp:8:mount.lustre.0 Request processed in 324us (7295us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759844.099220:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1118 00000100:00100000:2.0:1782759844.100852:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759844.100891:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759844.101004:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640512 00000100:00100000:3.0:1782759844.101013:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640512 00000100:00100000:3.0:1782759844.101058:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1119 00000100:00100000:3.0:1782759844.101066:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1869355218640512:12345-192.168.202.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782759844.101097:0:82628:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 95b27dde-c150-4adf-930b-37620c52929b@192.168.202.31@tcp t0 exp 0000000000000000 cur 3884 last 0 00000020:00000080:3.0:1782759844.101125:0:82628:0:(genops.c:1406:class_connect()) connect: client 95b27dde-c150-4adf-930b-37620c52929b, cookie 0xd5b45c7f5c60e102 00002000:00100000:3.0:1782759844.101136:0:82628:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95b27dde-c150-4adf-930b-37620c52929b/ffff8cddc47f9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782759844.101147:0:82628:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782759844.101216:0:82628:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1782759844.101241:0:82628:0:(import.c:65:import_set_state_nolock()) ffff8cddc47fa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759844.101306:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218640512:12345-192.168.202.31@tcp:8:mount.lustre.0 Request processed in 239us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.101313:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1119 00000100:00100000:0.0:1782759844.104494:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640640 00000100:00100000:0.0:1782759844.104514:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640640 00000100:00100000:0.0:1782759844.104664:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 113 00000100:00100000:0.0:1782759844.104675:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640640:12345-192.168.202.31@tcp:900:mount.lustre.0 00000100:00100000:0.0:1782759844.104786:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640640:12345-192.168.202.31@tcp:900:mount.lustre.0 Request processed in 112us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759844.104794:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 113 00000100:00100000:2.0:1782759844.111214:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759844.113629:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640768 00000100:00100000:3.0:1782759844.113645:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640768 00000100:00100000:2.0:1782759844.117891:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 463 00000100:00100000:2.0:1782759844.117909:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640768:12345-192.168.202.31@tcp:33:mount.lustre.0 00000004:00200000:2.0:1782759844.117999:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1782759844.118097:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+6:116054:x1869355218640768:12345-192.168.202.31@tcp:33:mount.lustre.0 Request processed in 192us (6892us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759844.118106:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 463 00000100:00100000:1.0:1782759844.235515:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759844.235543:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233150080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759844.235635:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759844.236074:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233150336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759844.236110:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759844.237506:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233150208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759844.237571:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.237792:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150080 00000100:00100000:2.0:1782759844.237803:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150080 00000100:00100000:3.0:1782759844.242524:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150336 00000100:00100000:3.0:1782759844.242539:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150336 00000100:00080000:1.0:1782759844.242811:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759844.242846:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150208 00000100:00100000:1.0:1782759844.242850:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150208 00000100:00100000:1.0:1782759844.245293:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3542 00000100:00100000:1.0:1782759844.245317:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233150208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759844.245362:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436676096 avail 1290436608 00000100:00100000:1.0:1782759844.245447:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233150208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.245455:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3542 00000100:00100000:1.0:1782759844.245524:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233150208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759844.248617:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:2.0:1782759844.248655:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233150080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759844.248702:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759844.248818:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233150080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 187us (13181us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.249492:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233150080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759844.250194:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00000100:00100000:3.0:1782759844.250429:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:3.0:1782759844.250447:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233150336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759844.250473:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759844.250787:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233150336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 346us (14674us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.250795:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:1.0:1782759844.251010:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233150336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759844.329682:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759844.329979:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218640896 00000100:00100000:3.0:1782759844.329991:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218640896 00000100:00100000:3.0:1782759844.330057:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3129 00000100:00100000:3.0:1782759844.330067:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:116096:x1869355218640896:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759844.330087:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759844.330142:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e109 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27846 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.330527:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e110 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.330543:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.330555:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759844.331608:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759844.331615:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759844.331639:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e110 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759844.331671:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e109 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27846 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759844.331726:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e110 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27846 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759844.332225:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759844.332229:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759844.332233:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7800, rc 0) 00000100:00100000:2.0:1782759844.332394:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:116096:x1869355218640896:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2326us (2720us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759844.332403:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3129 00000100:00100000:1.0:1782759844.345438:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759844.345493:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641024 00000100:00100000:2.0:1782759844.345504:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641024 00000100:00100000:2.0:1782759844.345649:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3130 00000100:00100000:2.0:1782759844.345664:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+7:116096:x1869355218641024:12345-192.168.202.31@tcp:48:lfs.0 00000001:00100000:3.0:1782759844.347421:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000100:00100000:2.0:1782759844.347927:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150464:0@lo:106: 00000100:00100000:2.0:1782759844.347997:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.348160:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150592:0@lo:106: 00000100:00100000:2.0:1782759844.348182:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.348201:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759844.348341:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150464 00000100:00100000:1.0:1782759844.348350:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150464 00000100:00100000:1.0:1782759844.348396:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150592 00000100:00100000:1.0:1782759844.348400:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150592 00000100:00100000:1.0:1782759844.348434:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1782759844.348445:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0001+9:42628:x1869355233150464:12345-0@lo:106: 00010000:00010000:1.0:1782759844.348459:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759844.348467:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00010000:00010000:1.0:1782759844.348474:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5000/0xd5b45c7f5c60d674 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d689 expref: -99 pid: 156698 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759844.348483:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:42628:x1869355233150592:12345-0@lo:106: 00010000:00010000:3.0:1782759844.348496:0:18645:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759844.348505:0:18645:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cdecd4dc600/0xd5b45c7f5c60d666 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d66d expref: -99 pid: 156696 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759844.348647:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:42628:x1869355233150592:12345-0@lo:106: Request processed in 169us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759844.348655:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1782759844.348807:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736b480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150464:0@lo:106: 00000100:00100000:2.0:1782759844.348817:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150592:0@lo:106: 00000100:00100000:1.0:1782759844.349520:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0001+9:42628:x1869355233150464:12345-0@lo:106: Request processed in 1075us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.349527:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1782759844.355975:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150720:0@lo:106: 00000100:00100000:2.0:1782759844.356046:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.356106:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7369c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150848:0@lo:106: 00000100:00100000:2.0:1782759844.356120:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.356158:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150976:0@lo:106: 00000100:00100000:2.0:1782759844.356172:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.356192:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233151104:0@lo:106: 00000100:00100000:2.0:1782759844.356205:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759844.356217:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc494ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759844.356327:0:6514:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759844.356349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150720 00000100:00100000:1.0:1782759844.356354:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150720 00000100:00100000:1.0:1782759844.356384:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150848 00000100:00100000:1.0:1782759844.356387:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150848 00000100:00100000:1.0:1782759844.356397:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233150976 00000100:00100000:1.0:1782759844.356399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233150976 00000100:00100000:1.0:1782759844.356409:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151104 00000100:00100000:1.0:1782759844.356411:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151104 00000100:00100000:1.0:1782759844.356425:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1782759844.356433:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0001+9:42628:x1869355233150720:12345-0@lo:106: 00010000:00010000:1.0:1782759844.356445:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759844.356457:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff8cddc3de5800/0xd5b45c7f5c60d5b7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5e8 expref: -99 pid: 156446 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759844.356514:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0001+9:42628:x1869355233150720:12345-0@lo:106: Request processed in 81us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.356519:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1782759844.356531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1782759844.356534:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:42628:x1869355233150848:12345-0@lo:106: 00010000:00010000:1.0:1782759844.356540:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759844.356545:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff8cddc5429800/0xd5b45c7f5c60d5be lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5f6 expref: -99 pid: 156447 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759844.356566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:42628:x1869355233150848:12345-0@lo:106: Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.356569:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1782759844.356597:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1782759844.356601:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:42628:x1869355233150976:12345-0@lo:106: 00010000:00010000:1.0:1782759844.356608:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759844.356615:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff8cddc5429000/0xd5b45c7f5c60d5c5 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5ef expref: -99 pid: 156448 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759844.356651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:42628:x1869355233150976:12345-0@lo:106: Request processed in 49us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.356657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1782759844.356668:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1782759844.356674:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:42628:x1869355233151104:12345-0@lo:106: 00010000:00010000:1.0:1782759844.356680:0:6514:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759844.356687:0:6514:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff8cddc5429a00/0xd5b45c7f5c60d5a9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60d5b0 expref: -99 pid: 156445 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759844.356721:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:42628:x1869355233151104:12345-0@lo:106: Request processed in 47us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.356726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1782759844.356984:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150720:0@lo:106: 00000100:00100000:1.0:1782759844.356995:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7369c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150848:0@lo:106: 00000100:00100000:1.0:1782759844.357003:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233150976:0@lo:106: 00000100:00100000:1.0:1782759844.357011:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233151104:0@lo:106: 00000100:00100000:1.0:1782759844.357090:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:116096:x1869355218641024:12345-192.168.202.31@tcp:48:lfs.0 Request processed in 11429us (11658us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759844.357097:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3130 00010000:00010000:3.0:1782759844.811100:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759845.834937:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759846.795094:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759846.795118:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233151232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759846.795188:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759846.795261:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151232 00000100:00100000:2.0:1782759846.795268:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151232 00000100:00100000:2.0:1782759846.795332:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3543 00000100:00100000:2.0:1782759846.795340:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233151232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759846.795399:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445670912 avail 1299431424 00000100:00100000:2.0:1782759846.795444:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233151232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759846.795451:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3543 00000100:00100000:2.0:1782759846.795494:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233151232:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759846.858821:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782759847.347366:0:162248:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64j: Nodemap enforces projid_set RBAC role ========================================================== 15:04:06 (1782759846) 00000100:00100000:3.0:1782759847.460718:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759847.462532:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641152 00000100:00100000:2.0:1782759847.462545:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641152 00000100:00100000:2.0:1782759847.462656:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 38 00000100:00100000:2.0:1782759847.462678:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:95b27dde-c150-4adf-930b-37620c52929b+6:116292:x1869355218641152:12345-192.168.202.31@tcp:700:mkdir.0 00000100:00100000:2.0:1782759847.462782:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:95b27dde-c150-4adf-930b-37620c52929b+6:116292:x1869355218641152:12345-192.168.202.31@tcp:700:mkdir.0 Request processed in 116us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759847.462799:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 38 00000100:00080000:0.0:1782759847.462991:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759847.466357:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759847.466497:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641408 00000100:00100000:0.0:1782759847.466507:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641408 00000100:00100000:0.0:1782759847.466571:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3131 00000100:00100000:0.0:1782759847.466601:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+6:116292:x1869355218641408:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:0.0:1782759847.466652:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759847.466680:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e110 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27846 expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.466705:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759847.466710:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759847.466809:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.466825:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.466835:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.466848:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.466854:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.466859:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467529:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467542:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467549:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759847.467563:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004831ea8 reply state 000000006280921d transno 4294968042 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467602:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467609:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759847.467611:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759847.467614:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759847.467620:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782759847.467628:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467635:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467642:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467648:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467654:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759847.467658:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467666:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467674:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759847.467676:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759847.467762:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467769:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e117 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759847.467781:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004831ea8 reply state 000000006280921d transno 4294968042 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467847:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759847.467853:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff8cdecda0aa00) 00010000:00010000:0.0:1782759847.467855:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759847.467857:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1782759847.469100:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:116292:x1869355218641408:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 2513us (2744us total) trans 4294968042 rc 0/0 00000100:00100000:0.0:1782759847.469111:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3131 00000100:00100000:3.0:1782759847.823929:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233151488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824008:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824059:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233152000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824083:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824102:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233152512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824123:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824148:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1782759847.824154:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233151360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824181:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824201:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233151872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824223:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824240:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233152384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824283:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824303:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233152896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824324:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824350:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233151616:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824372:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824389:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233152128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824410:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824426:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233152640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824446:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824463:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759847.824468:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233151744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824488:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824501:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233152256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824520:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824536:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233152768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824555:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759847.824673:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151488 00000100:00100000:3.0:1782759847.824680:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151488 00000100:00100000:3.0:1782759847.824714:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152000 00000100:00100000:3.0:1782759847.824717:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152000 00000100:00100000:3.0:1782759847.824753:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152512 00000100:00100000:3.0:1782759847.824756:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152512 00000100:00100000:3.0:1782759847.824768:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152128 00000100:00100000:3.0:1782759847.824770:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152128 00000100:00100000:3.0:1782759847.824781:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152640 00000100:00100000:3.0:1782759847.824783:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152640 00000100:00100000:3.0:1782759847.824798:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151744 00000100:00100000:3.0:1782759847.824800:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151744 00000100:00100000:3.0:1782759847.824812:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5560 00000100:00100000:3.0:1782759847.824819:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233151488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824873:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233151488:12345-0@lo:400:kworker.0 Request processed in 53us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.824880:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5560 00000100:00100000:3.0:1782759847.824903:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5561 00000100:00100000:3.0:1782759847.824909:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233152000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824934:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233152000:12345-0@lo:400:kworker.0 Request processed in 25us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.824939:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5561 00000100:00100000:3.0:1782759847.824950:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5562 00000100:00100000:3.0:1782759847.824955:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233152512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.824979:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233152512:12345-0@lo:400:kworker.0 Request processed in 24us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.824985:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5562 00000100:00100000:3.0:1782759847.824996:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5563 00000100:00100000:3.0:1782759847.825002:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233152128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825031:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233152128:12345-0@lo:400:kworker.0 Request processed in 30us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825037:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5563 00000100:00100000:3.0:1782759847.825057:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5564 00000100:00100000:3.0:1782759847.825062:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233152640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825089:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233152640:12345-0@lo:400:kworker.0 Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825095:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5564 00000100:00100000:3.0:1782759847.825105:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5565 00000100:00100000:3.0:1782759847.825111:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233151744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825135:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233151744:12345-0@lo:400:kworker.0 Request processed in 25us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825140:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5565 00000100:00100000:3.0:1782759847.825165:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151872 00000100:00100000:3.0:1782759847.825169:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151872 00000100:00100000:3.0:1782759847.825208:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151616 00000100:00100000:3.0:1782759847.825211:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151616 00000100:00100000:3.0:1782759847.825223:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3544 00000100:00100000:3.0:1782759847.825228:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233151872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825258:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233151872:12345-0@lo:400:kworker.0 Request processed in 30us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825264:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3544 00000100:00100000:3.0:1782759847.825274:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3545 00000100:00100000:3.0:1782759847.825279:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233151616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825302:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233151616:12345-0@lo:400:kworker.0 Request processed in 24us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825307:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3545 00000100:00100000:3.0:1782759847.825323:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152384 00000100:00100000:3.0:1782759847.825325:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152384 00000100:00100000:3.0:1782759847.825347:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152896 00000100:00100000:3.0:1782759847.825349:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152896 00000100:00100000:3.0:1782759847.825360:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152256 00000100:00100000:3.0:1782759847.825363:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152256 00000100:00100000:3.0:1782759847.825384:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233152768 00000100:00100000:3.0:1782759847.825386:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233152768 00000100:00100000:3.0:1782759847.825398:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3281 00000100:00100000:3.0:1782759847.825403:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233152384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825431:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233152384:12345-0@lo:400:kworker.0 Request processed in 28us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825437:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3281 00000100:00100000:3.0:1782759847.825447:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3282 00000100:00100000:3.0:1782759847.825453:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233152896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825482:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233152896:12345-0@lo:400:kworker.0 Request processed in 29us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825487:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3282 00000100:00100000:3.0:1782759847.825497:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3283 00000100:00100000:3.0:1782759847.825502:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233152256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825525:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233152256:12345-0@lo:400:kworker.0 Request processed in 24us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825530:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3283 00000100:00100000:3.0:1782759847.825540:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3284 00000100:00100000:3.0:1782759847.825545:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233152768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825569:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233152768:12345-0@lo:400:kworker.0 Request processed in 24us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759847.825575:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3284 00000100:00080000:3.0:1782759847.825638:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759847.825642:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759847.825645:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759847.825646:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759847.825681:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233151744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825692:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233152256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825703:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233152768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825713:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233151616:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825722:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233152128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825743:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233152640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825796:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233151872:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825807:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233152384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825816:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233152896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825826:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233151488:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825836:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233152000:0@lo:400:kworker.0 00000100:00100000:3.0:1782759847.825844:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233152512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759847.826124:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233151360 00000100:00100000:0.0:1782759847.826130:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233151360 00000100:00100000:0.0:1782759847.826164:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553 00000100:00100000:0.0:1782759847.826171:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233151360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759847.826218:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233151360:12345-0@lo:400:kworker.0 Request processed in 47us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759847.826225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553 00000100:00100000:0.0:1782759847.826267:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233151360:0@lo:400:kworker.0 00010000:00010000:2.0:1782759847.885123:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759848.336817:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759848.336864:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233153024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759848.336931:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759848.337017:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153024 00000100:00100000:0.0:1782759848.337024:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153024 00000100:00100000:0.0:1782759848.337068:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1782759848.337077:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233153024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759848.337122:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759848.337162:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233153024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759848.337169:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1782759848.337215:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7216680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233153024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759848.337528:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233153152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759848.337558:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759848.337685:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153152 00000100:00100000:1.0:1782759848.337691:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153152 00000100:00100000:1.0:1782759848.337716:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1782759848.337724:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233153152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759848.337754:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759848.337789:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233153152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759848.337795:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:3.0:1782759848.339708:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233153152:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1782759848.859332:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00010000:00010000:0.0:1782759848.906823:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759849.184620:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759849.184653:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759849.184687:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759849.184711:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759849.184744:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759849.187893:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641920 00000100:00100000:1.0:1782759849.187910:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641920 00000100:00100000:1.0:1782759849.187989:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642048 00000100:00100000:1.0:1782759849.187993:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642048 00000100:00100000:1.0:1782759849.188023:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3285 00000100:00100000:1.0:1782759849.188033:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218641920:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759849.188122:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218641920:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 91us (3467us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759849.188130:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3285 00000100:00100000:1.0:1782759849.188147:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3286 00000100:00100000:1.0:1782759849.188154:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642048:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759849.188176:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642048:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759849.188181:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3286 00000100:00080000:1.0:1782759849.188199:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759849.188203:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759849.188473:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641664 00000100:00100000:3.0:1782759849.188479:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641664 00000100:00100000:3.0:1782759849.188525:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641792 00000100:00100000:3.0:1782759849.188528:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641792 00000100:00100000:3.0:1782759849.188633:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5566 00000100:00100000:3.0:1782759849.188649:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218641664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759849.188688:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218641664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 49us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759849.188694:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5566 00000100:00100000:3.0:1782759849.188707:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5567 00000100:00100000:3.0:1782759849.188713:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218641792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759849.188748:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218641792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (4036us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759849.188758:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5567 00000100:00080000:1.0:1782759849.188991:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759849.188995:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759849.189223:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218641536 00000100:00100000:2.0:1782759849.189228:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218641536 00000100:00100000:2.0:1782759849.189289:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3554 00000100:00100000:2.0:1782759849.189298:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218641536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759849.189335:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218641536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 39us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759849.189342:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3554 00000100:00100000:1.0:1782759849.354842:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233153280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759849.354844:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233153408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759849.357682:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233153536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759849.360727:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759849.360908:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153280 00000100:00100000:0.0:1782759849.360919:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153280 00000100:00100000:0.0:1782759849.360984:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1782759849.360994:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233153280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759849.361028:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759849.361102:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233153280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759849.361108:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00080000:1.0:1782759849.361417:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759849.361461:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233153280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759849.366945:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759849.367042:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153408 00000100:00100000:2.0:1782759849.367050:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153408 00000100:00100000:2.0:1782759849.367120:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:2.0:1782759849.367130:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233153408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759849.367156:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759849.367218:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233153408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759849.367225:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00080000:1.0:1782759849.367244:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759849.367345:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233153408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759849.369477:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759849.370346:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153536 00000100:00100000:0.0:1782759849.370356:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153536 00000100:00100000:0.0:1782759849.370431:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3546 00000100:00100000:0.0:1782759849.370442:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233153536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759849.370477:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436676096 avail 1290436608 00000100:00100000:0.0:1782759849.370557:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233153536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759849.370569:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3546 00000100:00100000:1.0:1782759849.371085:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233153536:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1782759849.874187:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968042 is committed 00010000:00010000:3.0:1782759849.874919:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.874933:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.874941:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.874948:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759849.874952:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.874960:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.874978:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff8cdecda0aa00) 00010000:00010000:3.0:1782759849.874982:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759849.874986:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.874993:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e11e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875013:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875023:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875029:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875035:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759849.875038:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875043:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875052:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a100) 00010000:00010000:3.0:1782759849.875054:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759849.875057:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759849.875062:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e125 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1782759849.878557:0:7461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000001:00100000:2.0:1782759849.884611:0:8440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00010000:00010000:2.0:1782759849.930970:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759850.955101:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759851.317447:0:162444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe29c2cf00 20000000:00000080:0.0:1782759851.317465:0:162444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcc402400 uarg=0000000000000000 10000000:01000000:0.0:1782759851.317903:0:162444:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759851.317922:0:162444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759851.317940:0:162444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759851.317948:0:162444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759851.317984:0:162444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759851.317997:0:162444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 23 pid: 6524 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759851.318012:0:162444:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7217100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162444:1869355233153664:0@lo:104: 00000100:00100000:0.0:1782759851.318071:0:162444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759851.318160:0:162444:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759851.318236:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153664 00000100:00100000:1.0:1782759851.318242:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153664 00000100:00100000:1.0:1782759851.318316:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1782759851.318326:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:162444:x1869355233153664:12345-0@lo:104: 00010000:00010000:1.0:1782759851.318347:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759851.318412:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759851.318418:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:162444:x1869355233153664:12345-0@lo:104: Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759851.318426:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00010000:00010000:2.0:1782759851.318471:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759851.318477:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318492:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759851.318496:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318504:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759851.318511:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759851.318517:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759851.318545:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318551:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759851.318597:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318604:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e0bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e0c3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318619:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759851.318620:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759851.318622:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759851.318644:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233153792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759851.318677:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759851.318722:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153792 00000100:00100000:2.0:1782759851.318726:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153792 00010000:00010000:2.0:1782759851.318752:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 24 pid: 6524 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759851.318778:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1782759851.318785:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233153792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759851.318795:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759851.318800:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 24 pid: 6524 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318809:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 24 pid: 6524 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318823:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318830:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318842:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318849:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318856:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318861:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318867:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759851.318871:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318884:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318892:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759851.318902:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759851.318931:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233153792:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759851.318938:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1782759851.319005:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233153792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759851.319089:0:162444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e0c3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e0bc expref: 23 pid: 6524 timeout: 4041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759851.319099:0:162444:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7217100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162444:1869355233153664:0@lo:104: 00010000:00010000:3.0:1782759851.319112:0:162444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759851.319121:0:162444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759851.319132:0:162444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759851.319138:0:162444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e12c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759851.914974:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233153920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759851.915057:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759851.915195:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233153920 00000100:00100000:2.0:1782759851.915204:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233153920 00000100:00100000:2.0:1782759851.915288:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3547 00000100:00100000:2.0:1782759851.915299:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233153920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759851.915338:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445666816 avail 1299427328 00000100:00100000:2.0:1782759851.915396:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233153920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759851.915404:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3547 00000100:00100000:1.0:1782759851.915529:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233153920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759851.981752:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759852.201116:0:162492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa8087650 20000000:00000080:3.0:1782759852.201130:0:162492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcc007400 uarg=0000000000000000 10000000:01000000:3.0:1782759852.201433:0:162492:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759852.201452:0:162492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201467:0:162492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201476:0:162492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201481:0:162492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201485:0:162492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201489:0:162492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201493:0:162492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759852.201496:0:162492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201505:0:162492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201514:0:162492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201518:0:162492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759852.201522:0:162492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e133 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759852.580125:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759852.580132:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759852.580137:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759852.580190:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.580203:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.580220:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759852.580247:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233154048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759852.580326:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759852.580383:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4604900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759852.580461:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154048 00000100:00100000:1.0:1782759852.580469:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154048 00000100:00100000:1.0:1782759852.580523:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555 00000100:00100000:1.0:1782759852.580533:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233154048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759852.580548:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759852.580603:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e13a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759852.580627:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759852.580638:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759852.580648:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759852.580725:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233154048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759852.580733:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555 00000100:00100000:0.0:1782759852.581296:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233154048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759852.581313:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.581323:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759852.581343:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759852.581349:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759852.581357:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759852.939506:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233154176:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.939608:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759852.939821:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233154688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.939853:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759852.939874:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233155200:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.939914:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759852.939930:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233155712:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.939950:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759852.940261:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233154304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759852.940297:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759852.940320:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233154816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759852.940342:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759852.940360:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233155328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759852.940381:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759852.940496:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155200 00000100:00100000:1.0:1782759852.940504:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155200 00000100:00100000:1.0:1782759852.940555:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155712 00000100:00100000:1.0:1782759852.940559:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155712 00000100:00100000:1.0:1782759852.940601:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3287 00000100:00100000:1.0:1782759852.940610:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233155200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.941136:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233154432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.941264:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154176 00000100:00100000:0.0:1782759852.941269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154176 00000100:00100000:0.0:1782759852.941304:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556 00000100:00100000:0.0:1782759852.941313:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233154176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.943598:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233154560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.944408:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233154176:12345-0@lo:400:kworker.0 Request processed in 3091us (4795us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.944424:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556 00000100:00100000:0.0:1782759852.944497:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233154176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.944819:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154304 00000100:00100000:0.0:1782759852.944827:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154304 00000100:00100000:0.0:1782759852.944868:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154816 00000100:00100000:0.0:1782759852.944871:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154816 00000100:00100000:0.0:1782759852.944888:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155328 00000100:00100000:0.0:1782759852.944890:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155328 00000100:00100000:0.0:1782759852.944919:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5568 00000100:00100000:0.0:1782759852.944925:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233154304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.944984:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233154304:12345-0@lo:400:kworker.0 Request processed in 58us (4686us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.944990:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5568 00000100:00100000:0.0:1782759852.945003:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5569 00000100:00100000:0.0:1782759852.945008:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233154816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.945035:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233154816:12345-0@lo:400:kworker.0 Request processed in 27us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.945041:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5569 00000100:00100000:0.0:1782759852.945231:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5570 00000100:00100000:0.0:1782759852.945239:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233155328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.945272:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233155328:12345-0@lo:400:kworker.0 Request processed in 34us (4890us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.945277:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5570 00000100:00100000:0.0:1782759852.945308:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3288 00000100:00100000:0.0:1782759852.945316:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233155712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.945358:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233155712:12345-0@lo:400:kworker.0 Request processed in 43us (5406us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.945365:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3288 00000100:00100000:0.0:1782759852.945421:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233155712:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.945550:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759852.945755:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233154944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.945793:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759852.945815:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233155456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.945838:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759852.945872:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154688 00000100:00100000:3.0:1782759852.945878:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154688 00000100:00100000:3.0:1782759852.945922:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154432 00000100:00100000:3.0:1782759852.945925:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154432 00000100:00100000:3.0:1782759852.945940:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3548 00000100:00100000:3.0:1782759852.945946:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233154688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.946140:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3549 00000100:00100000:0.0:1782759852.946150:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233154432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.946260:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233154432:12345-0@lo:400:kworker.0 Request processed in 112us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.946267:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3549 00000100:00100000:3.0:1782759852.946384:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233154688:12345-0@lo:400:kworker.0 Request processed in 437us (6529us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759852.946400:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3548 00000100:00100000:3.0:1782759852.946421:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154944 00000100:00100000:3.0:1782759852.946425:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154944 00000100:00100000:3.0:1782759852.946451:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155456 00000100:00100000:3.0:1782759852.946454:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155456 00000100:00100000:3.0:1782759852.946470:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5571 00000100:00100000:3.0:1782759852.946475:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233154944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.946505:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233154944:12345-0@lo:400:kworker.0 Request processed in 30us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759852.946510:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5571 00000100:00100000:3.0:1782759852.946521:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5572 00000100:00100000:3.0:1782759852.946527:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233155456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.946549:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233155456:12345-0@lo:400:kworker.0 Request processed in 23us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759852.946554:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5572 00000100:00100000:3.0:1782759852.947039:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233154432:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.947064:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233154944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.947075:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233155456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.947562:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759852.947624:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233155072:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.947661:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759852.947679:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233155584:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.947711:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759852.947889:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155072 00000100:00100000:0.0:1782759852.947896:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155072 00000100:00100000:0.0:1782759852.947928:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155584 00000100:00100000:0.0:1782759852.947931:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155584 00000100:00100000:0.0:1782759852.947948:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3289 00000100:00100000:0.0:1782759852.947955:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233155072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.948020:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233155072:12345-0@lo:400:kworker.0 Request processed in 65us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.948027:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3289 00000100:00100000:0.0:1782759852.948042:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3290 00000100:00100000:0.0:1782759852.948057:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233155584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759852.948085:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233155584:12345-0@lo:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759852.948090:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3290 00000100:00100000:0.0:1782759852.948123:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233154688:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.948368:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233154560 00000100:00100000:3.0:1782759852.948373:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233154560 00000100:00100000:3.0:1782759852.948877:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5573 00000100:00100000:3.0:1782759852.948886:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233154560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.948934:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233154560:12345-0@lo:400:kworker.0 Request processed in 50us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759852.948940:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5573 00000100:00100000:2.0:1782759852.949650:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233154560:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.949666:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233155072:0@lo:400:kworker.0 00000100:00100000:2.0:1782759852.949678:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233155584:0@lo:400:kworker.0 00000100:00080000:2.0:1782759852.950035:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759852.950041:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759852.950045:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759852.950113:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759852.951284:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233155200:12345-0@lo:400:kworker.0 Request processed in 10667us (11360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759852.951299:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3287 00000100:00100000:1.0:1782759852.951366:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233154304:0@lo:400:kworker.0 00000100:00100000:1.0:1782759852.951380:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233154816:0@lo:400:kworker.0 00000100:00100000:1.0:1782759852.951409:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233155328:0@lo:400:kworker.0 00000100:00100000:3.0:1782759852.951635:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233155200:0@lo:400:kworker.0 00010000:00010000:3.0:1782759853.011830:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759853.451951:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759853.451984:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233155840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759853.452087:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759853.452168:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155840 00000100:00100000:3.0:1782759853.452182:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155840 00000100:00100000:3.0:1782759853.452242:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1782759853.452251:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233155840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759853.452292:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759853.452345:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233155840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759853.452352:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:3.0:1782759853.452415:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233155840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759853.452594:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759853.452604:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233155968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759853.452754:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759853.452782:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233155968 00000100:00100000:2.0:1782759853.452786:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233155968 00000100:00100000:2.0:1782759853.452895:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:2.0:1782759853.452903:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233155968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759853.452915:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759853.452947:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233155968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759853.452968:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00000100:00100000:2.0:1782759853.453002:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233155968:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759854.027892:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759854.302305:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759854.302361:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759854.302388:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759854.302408:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759854.302434:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759854.302463:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642176 00000100:00100000:1.0:1782759854.302473:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642176 00000100:00100000:1.0:1782759854.302521:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3557 00000100:00100000:1.0:1782759854.302533:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218642176:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759854.302652:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218642176:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 121us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.302661:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3557 00000100:00100000:1.0:1782759854.302712:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642560 00000100:00100000:1.0:1782759854.302717:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642560 00000100:00100000:2.0:1782759854.302861:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642304 00000100:00100000:2.0:1782759854.302866:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642304 00000100:00100000:2.0:1782759854.302902:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642432 00000100:00100000:2.0:1782759854.302905:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642432 00000100:00100000:2.0:1782759854.302932:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5574 00000100:00100000:2.0:1782759854.302950:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218642304:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759854.302984:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218642304:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 46us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759854.302992:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5574 00000100:00100000:2.0:1782759854.303009:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5575 00000100:00100000:2.0:1782759854.303018:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642432:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759854.303062:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642432:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759854.303070:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5575 00000100:00100000:1.0:1782759854.303309:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642688 00000100:00100000:1.0:1782759854.303314:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642688 00000100:00100000:1.0:1782759854.303352:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3291 00000100:00100000:1.0:1782759854.303358:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218642560:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759854.303388:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218642560:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.303395:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3291 00000100:00100000:1.0:1782759854.303408:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3292 00000100:00100000:1.0:1782759854.303414:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642688:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759854.303436:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642688:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.303442:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3292 00000100:00080000:1.0:1782759854.303916:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759854.303922:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759854.303924:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759854.303927:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759854.476242:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233156096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759854.476309:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759854.476362:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156096 00000100:00100000:3.0:1782759854.476368:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156096 00000100:00080000:1.0:1782759854.476396:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759854.476414:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:3.0:1782759854.476420:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233156096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759854.476447:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759854.476488:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233156096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759854.476493:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1782759854.476542:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759854.476554:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233156224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759854.476760:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759854.476855:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156224 00000100:00100000:3.0:1782759854.476859:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156224 00000100:00100000:3.0:1782759854.476891:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3550 00000100:00100000:3.0:1782759854.476897:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233156224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759854.476916:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436676096 avail 1290436608 00000100:00100000:3.0:1782759854.476946:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233156224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.476947:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233156096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759854.476956:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3550 00000100:00100000:0.0:1782759854.477031:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233156224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759854.477724:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759854.477737:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233156352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759854.477775:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759854.477822:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156352 00000100:00100000:1.0:1782759854.477826:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156352 00000100:00100000:1.0:1782759854.477865:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:1.0:1782759854.477873:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233156352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759854.477889:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759854.477923:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233156352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759854.477930:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000100:00080000:1.0:1782759854.477950:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759854.477972:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233156352:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1782759855.051121:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759855.513358:0:162639:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdaa7e46c0 20000000:00000080:1.0:1782759855.513380:0:162639:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf744000 uarg=0000000000000000 10000000:01000000:1.0:1782759855.514176:0:162639:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759855.514195:0:162639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.514212:0:162639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.514221:0:162639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.514258:0:162639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.514271:0:162639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 23 pid: 6524 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759855.514285:0:162639:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162639:1869355233156480:0@lo:104: 00000100:00100000:1.0:1782759855.514350:0:162639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759855.514458:0:162639:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759855.514501:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156480 00000100:00100000:3.0:1782759855.514510:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156480 00000100:00100000:3.0:1782759855.514651:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:3.0:1782759855.514660:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:162639:x1869355233156480:12345-0@lo:104: 00010000:00010000:3.0:1782759855.515080:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759855.515247:0:162639:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162639:1869355233156480:0@lo:104: 00010000:00010000:2.0:1782759855.515268:0:162639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759855.515312:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759855.515319:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:162639:x1869355233156480:12345-0@lo:104: Request processed in 661us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759855.515327:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00010000:00010000:0.0:1782759855.515451:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759855.515458:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759855.515466:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759855.515470:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759855.515479:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759855.515485:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759855.515491:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759855.515527:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759855.515534:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759855.515559:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759855.515566:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf802200/0xd5b45c7f5c60e13a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e141 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759855.515845:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759855.515862:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233156608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759855.515902:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759855.515940:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156608 00000100:00100000:1.0:1782759855.515945:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156608 00010000:00010000:1.0:1782759855.515966:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 24 pid: 6524 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759855.516004:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1782759855.516012:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233156608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759855.516022:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759855.516028:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 24 pid: 6524 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516038:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 24 pid: 6524 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516056:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e141 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e13a expref: 24 pid: 6524 timeout: 4045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516070:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516078:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516091:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516098:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516104:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516111:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516116:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759855.516120:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516127:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516138:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759855.516150:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759855.516179:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233156608:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759855.516186:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:1.0:1782759855.516215:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233156608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759855.516416:0:162639:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759855.516425:0:162639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759855.516444:0:162639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413400/0xd5b45c7f5c60e148 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759855.524445:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759855.524453:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759855.524457:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759856.075241:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759856.413159:0:162687:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0eaee890 20000000:00000080:0.0:1782759856.413177:0:162687:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcc400000 uarg=0000000000000000 10000000:01000000:0.0:1782759856.413419:0:162687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759856.413440:0:162687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413456:0:162687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413466:0:162687:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413473:0:162687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413479:0:162687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413486:0:162687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413492:0:162687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759856.413497:0:162687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413504:0:162687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413516:0:162687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413528:0:162687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759856.413534:0:162687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e14f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759856.590799:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759856.590808:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759856.590813:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759856.590869:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.590882:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.590893:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759856.590920:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233156736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759856.591003:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759856.591052:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc456cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759856.591077:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156736 00000100:00100000:1.0:1782759856.591083:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156736 00000100:00100000:1.0:1782759856.591132:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1782759856.591141:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233156736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759856.591156:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759856.591170:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e156 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.591199:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.591209:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.591219:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759856.591258:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233156736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759856.591266:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1782759856.591316:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233156736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759856.591331:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.591341:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759856.591359:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759856.591364:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759856.591372:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759857.037215:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233156864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759857.037290:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759857.037812:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156864 00000100:00100000:2.0:1782759857.037822:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156864 00000100:00100000:2.0:1782759857.037994:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3551 00000100:00100000:2.0:1782759857.038007:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233156864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759857.038053:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445666816 avail 1299427328 00000100:00100000:2.0:1782759857.038112:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233156864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759857.038120:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3551 00000100:00100000:1.0:1782759857.038199:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233156864:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759857.099398:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759857.177502:0:162736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc0108510 20000000:00000080:2.0:1782759857.177521:0:162736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcbc10400 uarg=0000000000000000 10000000:01000000:2.0:1782759857.178125:0:162736:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759857.178146:0:162736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.178164:0:162736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.178173:0:162736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.178214:0:162736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.178229:0:162736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 23 pid: 6524 timeout: 4047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759857.178257:0:162736:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162736:1869355233156992:0@lo:104: 00000100:00100000:2.0:1782759857.178322:0:162736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759857.178421:0:162736:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3600 going to sleep for 11 seconds 00000100:00100000:0.0:1782759857.178501:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233156992 00000100:00100000:0.0:1782759857.178509:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233156992 00000100:00100000:0.0:1782759857.178743:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:0.0:1782759857.179253:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:162736:x1869355233156992:12345-0@lo:104: 00010000:00010000:0.0:1782759857.179270:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759857.179411:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759857.179418:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:162736:x1869355233156992:12345-0@lo:104: Request processed in 171us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759857.179426:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00010000:00010000:3.0:1782759857.179502:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759857.179511:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179519:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759857.179523:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179532:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759857.179540:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759857.179556:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759857.179615:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179622:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759857.179642:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179657:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5413200/0xd5b45c7f5c60e156 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e15d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179676:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759857.179678:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759857.179680:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759857.179723:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233157120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759857.179780:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759857.179830:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157120 00000100:00100000:3.0:1782759857.179836:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157120 00010000:00010000:3.0:1782759857.179859:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 24 pid: 6524 timeout: 4047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759857.179883:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1782759857.179890:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233157120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759857.179900:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759857.179906:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 24 pid: 6524 timeout: 4047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179916:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 24 pid: 6524 timeout: 4047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179934:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179942:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179957:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179965:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179972:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179978:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179984:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759857.179988:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.179995:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.180003:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759857.180012:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759857.180041:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233157120:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759857.180048:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00100000:3.0:1782759857.180082:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233157120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759857.181071:0:162736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e15d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e156 expref: 23 pid: 6524 timeout: 4047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759857.181089:0:162736:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ae3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162736:1869355233156992:0@lo:104: 00010000:00010000:2.0:1782759857.181116:0:162736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.181126:0:162736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.181133:0:162736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759857.181139:0:162736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e164 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759858.069254:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233157248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.069336:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.069382:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233157760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.069409:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.069428:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233158272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.069451:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.069468:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233158784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.069488:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.069511:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1782759858.069517:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233157632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.069560:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759858.069673:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233157504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759858.069703:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759858.069726:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233158016:0@lo:400:kworker.0 00000100:00100000:3.0:1782759858.069935:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157760 00000100:00100000:3.0:1782759858.069942:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157760 00000100:00100000:3.0:1782759858.070009:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157504 00000100:00100000:3.0:1782759858.070012:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157504 00000100:00100000:3.0:1782759858.070030:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3552 00000100:00100000:3.0:1782759858.070038:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233157760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759858.070090:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233157760:12345-0@lo:400:kworker.0 Request processed in 53us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759858.070098:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3552 00000100:00100000:3.0:1782759858.070114:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3553 00000100:00100000:3.0:1782759858.070120:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233157504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759858.070151:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233157504:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759858.070157:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3553 00000100:00100000:1.0:1782759858.070398:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233158144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070423:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.070438:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233158656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070460:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.070491:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233157760:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070522:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233157376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070546:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.070565:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233157888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070680:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.070700:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233158400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070720:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.070752:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157248 00000100:00100000:1.0:1782759858.070827:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157248 00000100:00100000:1.0:1782759858.070858:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559 00000100:00100000:1.0:1782759858.070864:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233157248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.070900:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233157248:12345-0@lo:400:kworker.0 Request processed in 36us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.070907:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559 00000100:00100000:1.0:1782759858.070941:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158272 00000100:00100000:1.0:1782759858.070945:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158272 00000100:00100000:1.0:1782759858.070977:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158784 00000100:00100000:1.0:1782759858.070980:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158784 00000100:00100000:1.0:1782759858.070992:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158144 00000100:00100000:1.0:1782759858.070995:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158144 00000100:00100000:1.0:1782759858.071003:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158656 00000100:00100000:1.0:1782759858.071005:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158656 00000100:00100000:1.0:1782759858.071019:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3293 00000100:00100000:1.0:1782759858.071025:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.071057:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233158272:12345-0@lo:400:kworker.0 Request processed in 32us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.071063:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3293 00000100:00100000:1.0:1782759858.071074:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3294 00000100:00100000:1.0:1782759858.071079:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233158784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.071104:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233158784:12345-0@lo:400:kworker.0 Request processed in 24us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.071109:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3294 00000100:00100000:1.0:1782759858.071120:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3295 00000100:00100000:1.0:1782759858.071126:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233158144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.071149:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233158144:12345-0@lo:400:kworker.0 Request processed in 23us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.071155:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3295 00000100:00100000:1.0:1782759858.071164:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3296 00000100:00100000:1.0:1782759858.071170:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233158656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.071192:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233158656:12345-0@lo:400:kworker.0 Request processed in 22us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.071197:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3296 00000100:00100000:0.0:1782759858.071689:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157632 00000100:00100000:0.0:1782759858.071699:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157632 00000100:00100000:1.0:1782759858.076453:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157376 00000100:00100000:1.0:1782759858.076467:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157376 00000100:00100000:1.0:1782759858.076520:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233157888 00000100:00100000:1.0:1782759858.076524:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233157888 00000100:00100000:1.0:1782759858.076542:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158400 00000100:00100000:1.0:1782759858.076544:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158400 00000100:00100000:1.0:1782759858.076563:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5576 00000100:00100000:1.0:1782759858.076598:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.076698:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233157632:12345-0@lo:400:kworker.0 Request processed in 102us (7137us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.076706:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5576 00000100:00100000:1.0:1782759858.076725:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5577 00000100:00100000:1.0:1782759858.076731:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233157376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.076925:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233157376:12345-0@lo:400:kworker.0 Request processed in 193us (6377us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.076933:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5577 00000100:00100000:1.0:1782759858.076948:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5578 00000100:00100000:1.0:1782759858.076954:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233157888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.076983:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233157888:12345-0@lo:400:kworker.0 Request processed in 30us (6303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.076991:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5578 00000100:00100000:1.0:1782759858.077001:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5579 00000100:00100000:1.0:1782759858.077006:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233158400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077030:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233158400:12345-0@lo:400:kworker.0 Request processed in 24us (6308us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.077035:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5579 00000100:00080000:1.0:1782759858.077062:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759858.077067:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759858.077071:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759858.077121:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233157376:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077133:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233157888:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077143:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233158400:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077184:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233157632:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077196:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233158144:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077208:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233158656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077219:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233157248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077230:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233158272:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077241:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233158784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077291:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.077373:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233158528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077404:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759858.077436:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233157504:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077457:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158016 00000100:00100000:1.0:1782759858.077461:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158016 00000100:00100000:1.0:1782759858.077487:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158528 00000100:00100000:1.0:1782759858.077489:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158528 00000100:00100000:1.0:1782759858.077503:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5580 00000100:00100000:1.0:1782759858.077508:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077545:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc137800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233158016:12345-0@lo:400:kworker.0 Request processed in 37us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.077552:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5580 00000100:00100000:1.0:1782759858.077563:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5581 00000100:00100000:1.0:1782759858.077723:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233158528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077823:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233158528:12345-0@lo:400:kworker.0 Request processed in 186us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759858.077830:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5581 00000100:00080000:1.0:1782759858.077845:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759858.077863:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233158016:0@lo:400:kworker.0 00000100:00100000:1.0:1782759858.077872:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233158528:0@lo:400:kworker.0 00010000:00010000:0.0:1782759858.124242:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759858.178308:0:162784:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8e940ac0 20000000:00000080:3.0:1782759858.178326:0:162784:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcc005800 uarg=0000000000000000 10000000:01000000:3.0:1782759858.178482:0:162784:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759858.178503:0:162784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178519:0:162784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178530:0:162784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178541:0:162784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178548:0:162784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178554:0:162784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178561:0:162784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759858.178565:0:162784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178573:0:162784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178700:0:162784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178709:0:162784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759858.178716:0:162784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e16b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759858.571081:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759858.571106:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233158912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759858.571191:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759858.571453:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233158912 00000100:00100000:2.0:1782759858.571461:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233158912 00000100:00100000:2.0:1782759858.571528:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:2.0:1782759858.571539:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233158912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759858.571568:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759858.571650:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233158912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759858.571658:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1782759858.571791:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233158912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759858.588303:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233159040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759858.588393:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759858.588460:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159040 00000100:00100000:2.0:1782759858.588468:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159040 00000100:00100000:2.0:1782759858.588530:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:2.0:1782759858.588540:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233159040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759858.588564:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759858.588626:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233159040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759858.588634:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000100:00100000:2.0:1782759858.588731:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233159040:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1782759858.763821:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759858.763828:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759858.763832:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759858.763876:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.763889:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.763900:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759858.763924:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233159168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759858.763991:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759858.764039:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded237c240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759858.764065:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159168 00000100:00100000:0.0:1782759858.764071:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159168 00000100:00100000:0.0:1782759858.764120:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560 00000100:00100000:0.0:1782759858.764129:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233159168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759858.764143:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759858.764155:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e172 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.764177:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.764187:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.764197:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803600, rc 0) 00000100:00100000:0.0:1782759858.764249:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233159168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759858.764256:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560 00000100:00100000:0.0:1782759858.764305:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233159168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759858.764319:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.764328:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759858.764343:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759858.764347:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759858.764355:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1782759859.114171:0:162832:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6423d7a0 20000000:00000080:0.0:1782759859.114189:0:162832:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcc401c00 uarg=0000000000000000 00010000:00010000:0.0:1782759859.115151:0:162832:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759859.115170:0:162832:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759859.115186:0:162832:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759859.115197:0:162832:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759859.117338:0:162832:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759859.117369:0:162832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.117389:0:162832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.117399:0:162832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.117445:0:162832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.117458:0:162832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 23 pid: 6525 timeout: 4049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759859.117474:0:162832:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162832:1869355233159296:0@lo:104: 00000100:00100000:0.0:1782759859.117541:0:162832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759859.117624:0:162832:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded237c240 going to sleep for 11 seconds 00000100:00100000:2.0:1782759859.117713:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159296 00000100:00100000:2.0:1782759859.117722:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159296 00000100:00100000:2.0:1782759859.117791:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1782759859.117804:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:162832:x1869355233159296:12345-0@lo:104: 00010000:00010000:2.0:1782759859.117816:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.117878:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759859.117884:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:162832:x1869355233159296:12345-0@lo:104: Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759859.117891:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00010000:00010000:2.0:1782759859.117912:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759859.117918:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.117926:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759859.117942:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.117951:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759859.117968:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759859.117975:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759859.118024:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118031:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759859.118060:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118066:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e172 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e179 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118086:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759859.118087:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759859.118089:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759859.118112:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233159424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759859.118141:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759859.118175:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159424 00000100:00100000:2.0:1782759859.118179:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159424 00010000:00010000:2.0:1782759859.118197:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 24 pid: 6525 timeout: 4049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759859.118232:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1782759859.118247:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233159424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759859.118258:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759859.118263:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 24 pid: 6525 timeout: 4049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118273:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 24 pid: 6525 timeout: 4049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118288:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118296:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118307:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118313:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118320:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118327:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118331:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759859.118335:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118342:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118351:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759859.118362:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759859.118391:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233159424:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759859.118398:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1782759859.118432:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233159424:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759859.118836:0:162832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e179 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e172 expref: 23 pid: 6525 timeout: 4049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759859.118847:0:162832:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:162832:1869355233159296:0@lo:104: 00010000:00010000:0.0:1782759859.118861:0:162832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.118870:0:162832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.118876:0:162832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.118882:0:162832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e180 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 162832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759859.156141:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759859.423379:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759859.423417:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759859.423449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759859.423469:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759859.423491:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759859.426147:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643200 00000100:00100000:0.0:1782759859.426162:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643200 00000100:00100000:0.0:1782759859.426240:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643328 00000100:00100000:0.0:1782759859.426243:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643328 00000100:00100000:0.0:1782759859.426270:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3297 00000100:00100000:0.0:1782759859.426281:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643200:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759859.426366:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643200:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759859.426373:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3297 00000100:00100000:0.0:1782759859.426389:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3298 00000100:00100000:0.0:1782759859.426396:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759859.426420:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759859.426427:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3298 00000100:00080000:2.0:1782759859.427217:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759859.427222:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759859.429466:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642944 00000100:00100000:3.0:1782759859.429482:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642944 00000100:00100000:3.0:1782759859.429595:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643072 00000100:00100000:3.0:1782759859.429598:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643072 00000100:00100000:3.0:1782759859.429642:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5582 00000100:00100000:3.0:1782759859.429655:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642944:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759859.432963:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218642944:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 3302us (9584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759859.432979:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5582 00000100:00080000:2.0:1782759859.433117:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759859.433123:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759859.433897:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5583 00000100:00100000:3.0:1782759859.433913:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643072:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759859.434233:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643072:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 325us (10761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759859.434241:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5583 00000100:00100000:2.0:1782759859.439703:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218642816 00000100:00100000:2.0:1782759859.439720:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218642816 00000100:00100000:2.0:1782759859.440938:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3561 00000100:00100000:2.0:1782759859.440973:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218642816:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759859.441150:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218642816:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 188us (17698us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759859.441840:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3561 00000100:00100000:1.0:1782759859.594886:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233159552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759859.594886:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233159680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759859.598908:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233159808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759859.599031:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759859.601142:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159552 00000100:00100000:3.0:1782759859.601157:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159552 00000100:00100000:3.0:1782759859.601243:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1782759859.601254:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233159552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759859.601289:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759859.601387:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc137b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233159552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759859.601395:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00000100:00100000:1.0:1782759859.602852:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233159552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759859.603845:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759859.604305:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159680 00000100:00100000:3.0:1782759859.604314:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159680 00000100:00100000:3.0:1782759859.604373:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3554 00000100:00100000:3.0:1782759859.604383:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233159680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759859.604420:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436676096 avail 1290436608 00000100:00100000:3.0:1782759859.604487:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233159680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759859.604494:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3554 00000100:00100000:0.0:1782759859.604938:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233159680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759859.607219:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759859.607611:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159808 00000100:00100000:1.0:1782759859.607622:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159808 00000100:00100000:1.0:1782759859.607688:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:1.0:1782759859.607698:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233159808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759859.607727:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759859.607791:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233159808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759859.607798:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1782759859.609318:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233159808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759860.171538:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759860.878720:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759860.878728:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759860.878734:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759860.878790:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759860.878804:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759860.878815:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759860.878841:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233159936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759860.878916:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759860.878973:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759860.879018:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233159936 00000100:00100000:2.0:1782759860.879035:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233159936 00000100:00100000:2.0:1782759860.879138:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562 00000100:00100000:2.0:1782759860.879151:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233159936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759860.879172:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759860.879194:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e187 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759860.879229:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759860.879242:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759860.879253:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759860.879340:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233159936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759860.879348:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562 00000100:00100000:3.0:1782759860.879456:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233159936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759860.879480:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759860.879491:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759860.879516:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759860.879522:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759860.879530:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759861.196549:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759862.157187:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233160064:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759862.157264:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759862.157358:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160064 00000100:00100000:0.0:1782759862.157366:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160064 00000100:00100000:0.0:1782759862.157436:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3555 00000100:00100000:0.0:1782759862.157446:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233160064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759862.157483:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445666816 avail 1299427328 00000100:00100000:0.0:1782759862.160792:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233160064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3338us (3518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759862.160806:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3555 00000100:00100000:3.0:1782759862.161381:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233160064:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759862.219128:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759863.183490:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233160576:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.183536:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233160448:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.183571:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759863.183571:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759863.183669:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233160192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759863.183752:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233160320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.186858:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233160960:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.186928:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.186959:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233161472:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.186997:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.187048:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160448 00000100:00100000:2.0:1782759863.187056:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160448 00000100:00100000:2.0:1782759863.187129:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3556 00000100:00100000:2.0:1782759863.187140:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233160448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.187204:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233160448:12345-0@lo:400:kworker.0 Request processed in 67us (3633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.187211:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3556 00000100:00100000:2.0:1782759863.187235:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160576 00000100:00100000:2.0:1782759863.187238:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160576 00000100:00100000:2.0:1782759863.187267:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160960 00000100:00100000:2.0:1782759863.187270:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160960 00000100:00100000:2.0:1782759863.187295:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161472 00000100:00100000:2.0:1782759863.187298:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161472 00000100:00100000:2.0:1782759863.187319:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5584 00000100:00100000:2.0:1782759863.187325:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233160576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.187359:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233160576:12345-0@lo:400:kworker.0 Request processed in 35us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.187366:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5584 00000100:00100000:2.0:1782759863.187378:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5585 00000100:00100000:2.0:1782759863.187385:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233160960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.187410:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233160960:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.187416:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5585 00000100:00100000:2.0:1782759863.187427:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5586 00000100:00100000:2.0:1782759863.187434:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233161472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.187460:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233161472:12345-0@lo:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.187466:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5586 00000100:00080000:2.0:1782759863.187491:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759863.187526:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233160448:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.187538:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233160960:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.187548:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233161472:0@lo:400:kworker.0 00000100:00100000:0.0:1782759863.189365:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233160576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759863.189402:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233161088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759863.189457:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759863.189497:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233161600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759863.189518:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.190497:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161088 00000100:00100000:2.0:1782759863.190505:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161088 00000100:00100000:2.0:1782759863.190560:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161600 00000100:00100000:2.0:1782759863.190564:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161600 00000100:00100000:2.0:1782759863.190617:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1782759863.190637:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233161088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.190699:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233161088:12345-0@lo:400:kworker.0 Request processed in 74us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.190708:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3299 00000100:00100000:2.0:1782759863.190737:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3300 00000100:00100000:2.0:1782759863.190746:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233161600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.190774:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233161600:12345-0@lo:400:kworker.0 Request processed in 31us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.190779:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3300 00000100:00080000:2.0:1782759863.190796:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759863.190800:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759863.190950:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759863.191113:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233160832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759863.191142:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759863.191159:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233161344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759863.191179:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759863.191248:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233161088:0@lo:400:kworker.0 00000100:00100000:1.0:1782759863.191257:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233161600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.191340:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160320 00000100:00100000:2.0:1782759863.191346:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160320 00000100:00100000:2.0:1782759863.191381:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160832 00000100:00100000:2.0:1782759863.191385:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160832 00000100:00100000:2.0:1782759863.191407:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161344 00000100:00100000:2.0:1782759863.191410:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161344 00000100:00100000:2.0:1782759863.191430:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5587 00000100:00100000:2.0:1782759863.191438:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233160320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.191478:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233160320:12345-0@lo:400:kworker.0 Request processed in 41us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.191484:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5587 00000100:00100000:2.0:1782759863.191495:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5588 00000100:00100000:2.0:1782759863.191502:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233160832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.191527:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233160832:12345-0@lo:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.191533:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5588 00000100:00100000:2.0:1782759863.191544:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5589 00000100:00100000:2.0:1782759863.191552:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233161344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.191596:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233161344:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.191615:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5589 00000100:00080000:2.0:1782759863.191637:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759863.191661:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233160320:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.191670:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233160832:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.191678:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233161344:0@lo:400:kworker.0 00000100:00100000:3.0:1782759863.194545:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759863.194685:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233160704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759863.194748:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759863.194773:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233161216:0@lo:400:kworker.0 00000100:00100000:3.0:1782759863.194798:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759863.194816:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233161728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759863.194838:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.196463:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160192 00000100:00100000:2.0:1782759863.196475:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160192 00000100:00100000:2.0:1782759863.196554:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563 00000100:00100000:2.0:1782759863.196565:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233160192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.196697:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233160192:12345-0@lo:400:kworker.0 Request processed in 135us (2159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.196705:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563 00000100:00100000:2.0:1782759863.196752:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161216 00000100:00100000:2.0:1782759863.196756:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161216 00000100:00100000:2.0:1782759863.196796:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161728 00000100:00100000:2.0:1782759863.196799:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161728 00000100:00100000:2.0:1782759863.196822:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3301 00000100:00100000:2.0:1782759863.196829:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233161216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.196862:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233161216:12345-0@lo:400:kworker.0 Request processed in 34us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.196869:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3301 00000100:00100000:2.0:1782759863.196880:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3302 00000100:00100000:2.0:1782759863.196887:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233161728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.196916:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233161728:12345-0@lo:400:kworker.0 Request processed in 31us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.196922:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3302 00000100:00100000:2.0:1782759863.197421:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233160192:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.197439:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233161216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759863.197451:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233161728:0@lo:400:kworker.0 00000100:00080000:2.0:1782759863.197489:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759863.197494:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759863.197637:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233160704 00000100:00100000:1.0:1782759863.197643:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233160704 00000100:00100000:1.0:1782759863.197695:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3557 00000100:00100000:1.0:1782759863.197703:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233160704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759863.197823:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233160704:12345-0@lo:400:kworker.0 Request processed in 120us (3073us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759863.197830:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3557 00000100:00100000:1.0:1782759863.197861:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233160704:0@lo:400:kworker.0 00010000:00010000:1.0:1782759863.244137:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759863.466755:0:163027:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff47bf1150 20000000:00000080:2.0:1782759863.466780:0:163027:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf80cc00 uarg=0000000000000000 00010000:00010000:2.0:1782759863.467015:0:163027:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759863.467035:0:163027:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759863.467863:0:163027:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759863.467886:0:163027:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759863.468393:0:163027:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759863.468420:0:163027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.468437:0:163027:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.468446:0:163027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.468483:0:163027:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.468498:0:163027:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 23 pid: 6526 timeout: 4053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759863.468513:0:163027:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163027:1869355233161856:0@lo:104: 00000100:00100000:2.0:1782759863.468616:0:163027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.468664:0:163027:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded1803300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759863.469044:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161856 00000100:00100000:1.0:1782759863.469053:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161856 00000100:00100000:1.0:1782759863.469111:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1782759863.469123:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:163027:x1869355233161856:12345-0@lo:104: 00010000:00010000:1.0:1782759863.469138:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.469216:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759863.469222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:163027:x1869355233161856:12345-0@lo:104: Request processed in 102us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759863.469230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00010000:00010000:3.0:1782759863.469513:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759863.469521:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759863.469530:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759863.469534:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759863.469543:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759863.469551:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759863.469556:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759863.469636:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759863.469644:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759863.469668:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759863.469676:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e187 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e18e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759863.469695:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759863.469696:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759863.469698:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759863.469707:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759863.469718:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233161984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759863.469753:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759863.470281:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233161984 00000100:00100000:1.0:1782759863.470287:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233161984 00010000:00010000:1.0:1782759863.470313:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 24 pid: 6526 timeout: 4053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759863.470348:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1782759863.470357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233161984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759863.470370:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759863.470376:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 24 pid: 6526 timeout: 4053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470387:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 24 pid: 6526 timeout: 4053 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470405:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470413:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470428:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470438:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470444:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470452:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470457:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759863.470462:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470469:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470476:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759863.470485:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759863.470534:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233161984:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759863.470542:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1782759863.470644:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233161984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759863.471221:0:163027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e18e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e187 expref: 23 pid: 6526 timeout: 4053 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759863.471234:0:163027:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163027:1869355233161856:0@lo:104: 00010000:00010000:2.0:1782759863.471258:0:163027:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.471266:0:163027:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.471272:0:163027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759863.471282:0:163027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649200/0xd5b45c7f5c60e195 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759863.704613:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233162112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759863.704679:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.704757:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162112 00000100:00100000:2.0:1782759863.704764:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162112 00000100:00100000:2.0:1782759863.705074:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1782759863.705087:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233162112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759863.705122:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759863.705179:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233162112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.705186:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:2.0:1782759863.705364:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedb51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233162112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759863.709449:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233162240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759863.709523:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759863.711329:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162240 00000100:00100000:2.0:1782759863.711342:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162240 00000100:00100000:2.0:1782759863.711423:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1782759863.711435:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233162240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759863.711464:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759863.711547:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233162240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759863.711554:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1782759863.711641:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233162240:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759864.267167:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759864.555560:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759864.555632:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759864.555657:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759864.555730:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643712 00000100:00100000:2.0:1782759864.555741:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643712 00000100:00100000:2.0:1782759864.555807:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5590 00000100:00100000:2.0:1782759864.555826:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759864.555905:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.555913:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5590 00000100:00100000:2.0:1782759864.555931:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643584 00000100:00100000:2.0:1782759864.555933:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643584 00000100:00100000:2.0:1782759864.555956:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5591 00000100:00100000:2.0:1782759864.555979:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759864.556008:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218643584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 46us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.556014:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5591 00000100:00100000:1.0:1782759864.556294:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643456 00000100:00100000:1.0:1782759864.556298:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643456 00000100:00100000:1.0:1782759864.556333:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3564 00000100:00100000:1.0:1782759864.556341:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218643456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759864.556377:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218643456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 37us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759864.556383:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3564 00000100:00080000:0.0:1782759864.556504:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759864.556508:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759864.560219:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759864.560263:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759864.562945:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643840 00000100:00100000:1.0:1782759864.562962:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643840 00000100:00100000:1.0:1782759864.563030:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218643968 00000100:00100000:1.0:1782759864.563034:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218643968 00000100:00100000:1.0:1782759864.563065:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1120 00000100:00100000:1.0:1782759864.563076:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+5:2401:x1869355218643840:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782759864.563110:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e0fb 00000100:00080000:1.0:1782759864.563118:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cddc68b1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759864.563176:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967449 00000100:00100000:1.0:1782759864.563354:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+2:2401:x1869355218643840:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 279us (3145us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759864.563362:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1120 00000100:00100000:1.0:1782759864.563380:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1121 00000100:00100000:1.0:1782759864.563388:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+5:2401:x1869355218643968:12345-192.168.202.31@tcp:9:kworker.0 00000020:00000080:1.0:1782759864.563400:0:8446:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e102 00000100:00080000:1.0:1782759864.563405:0:8446:0:(import.c:65:import_set_state_nolock()) ffff8cddc47fa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759864.563430:0:8446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967443 00000100:00100000:1.0:1782759864.563502:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+2:2401:x1869355218643968:12345-192.168.202.31@tcp:9:kworker.0 Request processed in 114us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759864.563509:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1121 00010000:00010000:1.0:1782759864.563545:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759864.563686:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782759864.563694:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759864.563698:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1782759864.650945:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759864.650953:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759864.650959:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759864.651020:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759864.651033:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759864.651043:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759864.651069:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233162368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759864.651133:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759864.651181:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759864.651242:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162368 00000100:00100000:2.0:1782759864.651250:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162368 00000100:00100000:2.0:1782759864.651310:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565 00000100:00100000:2.0:1782759864.651319:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233162368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759864.651334:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759864.651347:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e19c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.651370:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.651381:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759864.651389:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759864.651436:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233162368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759864.651443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565 00000100:00100000:0.0:1782759864.652824:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8df100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233162368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759864.652852:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759864.652863:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759864.652887:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759864.652893:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759864.652900:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759864.714856:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233162496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759864.714937:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759864.715033:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162496 00000100:00100000:1.0:1782759864.715041:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162496 00000100:00100000:1.0:1782759864.715090:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1782759864.715098:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233162496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759864.715130:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759864.715182:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233162496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759864.715189:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1782759864.715240:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233162496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759864.720817:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233162624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759864.720893:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759864.720943:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759864.720948:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233162752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759864.720976:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759864.724765:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162624 00000100:00100000:1.0:1782759864.724781:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162624 00000100:00100000:1.0:1782759864.724863:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3558 00000100:00100000:1.0:1782759864.724873:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233162624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759864.724913:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436676096 avail 1290436608 00000100:00100000:1.0:1782759864.725000:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233162624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759864.725007:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3558 00000100:00100000:3.0:1782759864.726539:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162752 00000100:00100000:3.0:1782759864.726548:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162752 00000100:00100000:3.0:1782759864.726624:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1782759864.726632:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233162752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759864.726655:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759864.726718:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233162752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (5740us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759864.726724:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000100:00100000:3.0:1782759864.726774:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233162752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759864.726791:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233162624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782759865.293459:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759866.315704:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759866.565050:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.568679:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218644096 00000100:00100000:1.0:1782759866.568694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218644096 00000100:00100000:1.0:1782759866.568777:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3132 00000100:00100000:1.0:1782759866.568787:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:116599:x1869355218644096:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759866.568806:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1782759866.568820:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782759866.568827:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2784d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.568884:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e1b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.568899:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.568910:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759866.568957:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759866.568961:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759866.568985:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.569007:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2784d expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.569022:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2784d expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.569031:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759866.569035:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759866.569039:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413400, rc 0) 00000100:00100000:1.0:1782759866.569106:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+6:116599:x1869355218644096:12345-192.168.202.31@tcp:101:touch.0 Request processed in 320us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.569114:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3132 00000100:00100000:1.0:1782759866.573694:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.573775:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218644224 00000100:00100000:3.0:1782759866.573784:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218644224 00000100:00100000:3.0:1782759866.573841:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3133 00000100:00100000:3.0:1782759866.573859:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:116599:x1869355218644224:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759866.573879:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.573895:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e1b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27854 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.573949:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.573964:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.573975:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.573986:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.573991:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.573995:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574063:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1cd lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574067:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1cd lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574071:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1cd lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759866.574102:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759866.574105:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759866.574121:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1cd lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574131:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574139:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574143:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574147:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574150:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759866.574153:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574157:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574165:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759866.574166:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759866.574169:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574172:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e1bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574180:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574184:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574190:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574195:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759866.574197:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574202:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574209:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff8cddc34f4e00) 00010000:00010000:3.0:1782759866.574211:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759866.574213:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574218:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e1c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574244:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e1b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27854 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574255:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1cd lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27854 expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.574259:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759866.574261:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759866.574262:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6800, rc 0) 00000100:00100000:3.0:1782759866.574314:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+7:116599:x1869355218644224:12345-192.168.202.31@tcp:101:touch.0 Request processed in 466us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.574319:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3133 00000100:00100000:0.0:1782759866.576291:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.576342:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218644352 00000100:00100000:3.0:1782759866.576349:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218644352 00000100:00100000:3.0:1782759866.576412:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 114 00000100:00100000:3.0:1782759866.576419:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:95b27dde-c150-4adf-930b-37620c52929b+7:116599:x1869355218644352:12345-192.168.202.31@tcp:900:touch.0 00000100:00100000:3.0:1782759866.576477:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:95b27dde-c150-4adf-930b-37620c52929b+7:116599:x1869355218644352:12345-192.168.202.31@tcp:900:touch.0 Request processed in 59us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.576483:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 114 00000100:00100000:1.0:1782759866.581393:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.583713:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218644608 00000100:00100000:3.0:1782759866.583729:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218644608 00000100:00100000:3.0:1782759866.583796:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3134 00000100:00100000:3.0:1782759866.583806:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:116599:x1869355218644608:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759866.583829:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.583832:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782759866.583860:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1cd lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27854 expref: 7 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.583877:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc34f4300) 00010000:00010000:3.0:1782759866.583887:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782759866.583903:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e1d4 lrc: 2/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2785b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584007:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 3/0,1 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584022:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584030:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584084:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584092:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584099:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759866.584675:0:6531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x23:0x0], index 0: 0 00010000:00010000:3.0:1782759866.584818:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e1e9 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584829:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584837:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e1e9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584871:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584879:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584885:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584892:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584898:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759866.584903:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584911:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 5/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584920:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc34f4600) 00010000:00010000:3.0:1782759866.584924:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759866.584928:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 3/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584934:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e1db lrc: 0/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759866.584944:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007521b6ea reply state 00000000538e4cfd transno 4294968043 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584955:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.584961:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cddc34f4700) 00010000:00010000:3.0:1782759866.584964:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759866.584966:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782759866.584994:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e1d4 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2785b expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.585010:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e1e9 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2785b expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.585018:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f4f00) 00010000:00010000:3.0:1782759866.585020:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759866.585023:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7600, rc 0) 00000100:00100000:3.0:1782759866.585095:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+9:116599:x1869355218644608:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1289us (3707us total) trans 4294968043 rc 0/0 00000100:00100000:3.0:1782759866.585103:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3134 00000100:00100000:2.0:1782759866.595933:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.596055:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218644864 00000100:00100000:1.0:1782759866.596065:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218644864 00000100:00100000:1.0:1782759866.596133:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3135 00000100:00100000:1.0:1782759866.596143:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+9:116599:x1869355218644864:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:1.0:1782759866.596204:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759866.596232:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e1e9 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2785b expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.596251:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f4f00) 00010000:00010000:1.0:1782759866.596261:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759866.596319:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.596333:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.596342:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759866.596468:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006eaafca8 reply state 00000000469498af transno 4294968044 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.596480:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.596486:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:1.0:1782759866.596489:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759866.596491:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759866.596615:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+10:116599:x1869355218644864:12345-192.168.202.31@tcp:36:touch.0 Request processed in 473us (690us total) trans 4294968044 rc 0/0 00000100:00100000:1.0:1782759866.596627:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3135 00000100:00100000:2.0:1782759866.603441:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.603556:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218644992 00000100:00100000:3.0:1782759866.603566:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218644992 00000100:00100000:3.0:1782759866.603648:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3136 00000100:00100000:3.0:1782759866.603659:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+10:116599:x1869355218644992:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759866.603697:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.603719:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1fe lrc: 2/0,0 mode: --/CR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27862 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.603783:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1fe lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27862 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.603798:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1fe lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27862 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.603819:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:3.0:1782759866.603822:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759866.603826:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6800, rc 0) 00000100:00100000:3.0:1782759866.603883:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+11:116599:x1869355218644992:12345-192.168.202.31@tcp:101:touch.0 Request processed in 226us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.603890:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3136 00000100:00100000:0.0:1782759866.615318:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.615356:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218645120 00000100:00100000:0.0:1782759866.615365:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218645120 00000100:00100000:0.0:1782759866.615406:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1122 00000100:00100000:0.0:1782759866.615421:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1869355218645120:12345-192.168.202.31@tcp:8:touch.0 00010000:00080000:0.0:1782759866.615454:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 95b27dde-c150-4adf-930b-37620c52929b@192.168.202.31@tcp t0 exp 0000000000000000 cur 3906 last 0 00000020:00000080:0.0:1782759866.615487:0:8445:0:(genops.c:1406:class_connect()) connect: client 95b27dde-c150-4adf-930b-37620c52929b, cookie 0xd5b45c7f5c60e205 00002000:00100000:0.0:1782759866.615500:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95b27dde-c150-4adf-930b-37620c52929b/ffff8cddc5526800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782759866.615518:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782759866.615606:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782759866.615634:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cddc5524800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782759866.615699:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218645120:12345-192.168.202.31@tcp:8:touch.0 Request processed in 278us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.615707:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1122 00000100:00100000:3.0:1782759866.638176:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.641658:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218645248 00000100:00100000:1.0:1782759866.641672:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218645248 00000100:00100000:1.0:1782759866.641743:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1123 00000100:00100000:1.0:1782759866.641754:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+6:0:x1869355218645248:12345-192.168.202.31@tcp:2:touch.0 00000100:00080000:1.0:1782759866.641927:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1782759866.652559:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967450 is committed 00000001:00100000:3.0:1782759866.652601:0:8440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000001:00100000:3.0:1782759866.652607:0:8440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000020:00000080:3.0:1782759866.652611:0:8440:0:(genops.c:906:class_export_put()) final put ffff8cddc68b2000/95b27dde-c150-4adf-930b-37620c52929b 00000100:00100000:3.0:1782759866.654993:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+5:0:x1869355218645248:12345-192.168.202.31@tcp:2:touch.0 Request processed in 13229us (16814us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1782759866.655007:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1123 00000020:00000080:2.0:1782759866.655315:0:62521:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc68b2000/95b27dde-c150-4adf-930b-37620c52929b for lustre-OST0000 00000020:00000080:2.0:1782759866.655374:0:62521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc68b1000 for lustre-OST0000 00000100:00100000:3.0:1782759866.658111:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.658158:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218645504 00000100:00100000:0.0:1782759866.658170:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218645504 00000100:00100000:0.0:1782759866.658228:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 464 00000100:00100000:0.0:1782759866.658239:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+11:116599:x1869355218645504:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:0.0:1782759866.658525:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+12:116599:x1869355218645504:12345-192.168.202.31@tcp:35:touch.0 Request processed in 288us (422us total) trans 4294968045 rc 0/0 00000100:00100000:0.0:1782759866.658533:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 464 00000100:00100000:3.0:1782759866.676032:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.676553:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218645632 00000100:00100000:0.0:1782759866.676565:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218645632 00000100:00100000:0.0:1782759866.676674:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3137 00000100:00100000:0.0:1782759866.676685:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+12:116600:x1869355218645632:12345-192.168.202.31@tcp:101:mkdir.0 00010000:00010000:0.0:1782759866.676715:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759866.676739:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e20c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27869 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676803:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676832:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676844:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676859:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676866:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676874:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676964:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e221 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676973:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e221 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.676981:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e221 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759866.677019:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759866.677023:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759866.677045:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e221 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677059:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677066:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677073:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677079:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677085:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759866.677089:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677097:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677109:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759866.677113:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759866.677118:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677125:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802000/0xd5b45c7f5c60e213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677145:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677151:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677157:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677162:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759866.677164:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677169:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677176:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7e283c66 (ffff8cdecda0a200) 00010000:00010000:0.0:1782759866.677178:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759866.677182:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677187:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e21a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7e283c66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677217:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e20c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27869 expref: 14 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677230:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e221 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27869 expref: 13 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.677241:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:0.0:1782759866.677244:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782759866.677246:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802400, rc 0) 00000100:00100000:0.0:1782759866.677320:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+13:116600:x1869355218645632:12345-192.168.202.31@tcp:101:mkdir.0 Request processed in 637us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.677327:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3137 00000100:00100000:2.0:1782759866.679753:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.679880:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218645760 00000100:00100000:3.0:1782759866.679890:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218645760 00000100:00100000:3.0:1782759866.679972:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00100000:3.0:1782759866.679984:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:95b27dde-c150-4adf-930b-37620c52929b+5:116600:x1869355218645760:12345-192.168.202.31@tcp:700:mkdir.0 00000100:00080000:1.0:1782759866.680114:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759866.680174:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedb51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:95b27dde-c150-4adf-930b-37620c52929b+5:116600:x1869355218645760:12345-192.168.202.31@tcp:700:mkdir.0 Request processed in 192us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.680182:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 39 00000100:00100000:3.0:1782759866.687364:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.687699:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218646016 00000100:00100000:1.0:1782759866.687710:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218646016 00000100:00100000:1.0:1782759866.687777:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3138 00000100:00100000:1.0:1782759866.687788:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:116600:x1869355218646016:12345-192.168.202.31@tcp:36:mkdir.0 00000100:00100000:1.0:1782759866.687940:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc137100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233162880:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782759866.687994:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.688039:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233162880 00000100:00100000:3.0:1782759866.688043:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233162880 00000100:00100000:1.0:1782759866.688047:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdecd626e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.688083:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3559 00000100:00100000:3.0:1782759866.688089:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233162880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.688152:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233162880:12345-0@lo:1000:mdt00_001.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.688231:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc137100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233162880:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.688279:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3559 00000100:00100000:1.0:1782759866.688302:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc137100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163008:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782759866.688328:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.688352:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e90d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782759866.688398:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163008 00000100:00100000:2.0:1782759866.688403:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163008 00000100:00100000:2.0:1782759866.688445:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3560 00000100:00100000:2.0:1782759866.688453:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233163008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759866.688534:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233163008:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.688541:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3560 00000100:00100000:3.0:1782759866.688638:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc137100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163008:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.688694:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163136:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.688721:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.688748:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.688877:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163136 00000100:00100000:1.0:1782759866.688882:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163136 00000100:00100000:1.0:1782759866.688943:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3561 00000100:00100000:1.0:1782759866.688950:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233163136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782759866.689024:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233163136:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (301us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759866.689032:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3561 00000100:00100000:3.0:1782759866.689050:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163136:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782759866.689089:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 3/0,1 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.689097:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 3/0,1 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.689104:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 3/0,1 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759866.689110:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163264:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1782759866.689127:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.689145:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230780 going to sleep for 11 seconds 00000100:00100000:2.0:1782759866.690884:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163264 00000100:00100000:2.0:1782759866.690899:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163264 00000100:00100000:3.0:1782759866.691009:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3562 00000100:00100000:3.0:1782759866.691021:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:6532:x1869355233163264:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759866.691036:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.691052:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e22f lrc: 2/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e228 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.691077:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e22f lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e228 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.691087:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e22f lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e228 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.691093:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:3.0:1782759866.691095:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759866.691098:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7e00, rc 0) 00000100:00100000:3.0:1782759866.691152:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6532:x1869355233163264:12345-0@lo:101:mdt00_001.0 Request processed in 135us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.691159:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3562 00000100:00100000:0.0:1782759866.691638:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163264:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1782759866.691657:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.691669:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759866.691691:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000422:0x1:0x0] 00010000:00010000:0.0:1782759866.691728:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.691736:0:6532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.691744:0:6532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759866.691761:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163392:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1782759866.691798:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.691853:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163392 00000100:00100000:0.0:1782759866.691854:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.691860:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163392 00000100:00100000:3.0:1782759866.691890:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3563 00000100:00100000:3.0:1782759866.691897:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:6532:x1869355233163392:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1782759866.691907:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.691961:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 2/0,0 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e236 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.691982:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 3/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e236 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.691992:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 3/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e236 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.692000:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc34f4300) 00010000:00010000:3.0:1782759866.692003:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759866.692005:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7000, rc 0) 00000100:00100000:3.0:1782759866.692045:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163392:12345-0@lo:101:mdt00_001.0 Request processed in 148us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.692051:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3563 00000100:00100000:0.0:1782759866.692089:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163392:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1782759866.692101:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 4/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.692109:0:6532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 4/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782759866.692121:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000422:0x1:0x0] 00000100:00100000:0.0:1782759866.692149:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163520:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.692174:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.692194:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.692206:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163520 00000100:00100000:3.0:1782759866.692210:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163520 00000100:00100000:3.0:1782759866.692225:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3564 00000100:00100000:3.0:1782759866.692228:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.692281:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163520:12345-0@lo:1000:mdt00_001.0 Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.692287:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3564 00000100:00100000:0.0:1782759866.692414:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163520:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.692451:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163648:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.692473:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.692494:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759866.692531:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163648 00000100:00100000:2.0:1782759866.692535:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163648 00000100:00100000:2.0:1782759866.692625:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3565 00000100:00100000:2.0:1782759866.692635:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759866.692714:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163648:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782759866.692720:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3565 00000100:00100000:0.0:1782759866.692824:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163648:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.692911:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.692938:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.692963:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.692981:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163776 00000100:00100000:3.0:1782759866.692986:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163776 00000100:00100000:3.0:1782759866.693017:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3566 00000100:00100000:3.0:1782759866.693022:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.693068:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163776:12345-0@lo:1000:mdt00_001.0 Request processed in 46us (130us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782759866.693073:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3566 00000100:00100000:0.0:1782759866.693096:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.693144:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163904:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.693168:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.693189:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759866.693227:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233163904 00000100:00100000:2.0:1782759866.693231:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233163904 00000100:00100000:2.0:1782759866.693262:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567 00000100:00100000:2.0:1782759866.693271:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782759866.693329:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233163904:12345-0@lo:1000:mdt00_001.0 Request processed in 61us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.693335:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567 00000100:00100000:0.0:1782759866.693442:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233163904:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.693482:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233164032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.693508:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.693531:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782759866.693603:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164032 00000100:00100000:3.0:1782759866.693608:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164032 00000100:00100000:3.0:1782759866.693639:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568 00000100:00100000:3.0:1782759866.693646:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233164032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782759866.693725:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233164032:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.693732:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568 00000100:00100000:0.0:1782759866.693765:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233164032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.693803:0:6532:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233164160:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782759866.693843:0:6532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759866.693868:0:6532:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.693947:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164160 00000100:00100000:1.0:1782759866.693951:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164160 00000100:00100000:1.0:1782759866.693987:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3569 00000100:00100000:1.0:1782759866.693995:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233164160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782759866.694056:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6532:x1869355233164160:12345-0@lo:1000:mdt00_001.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.694062:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3569 00000100:00100000:0.0:1782759866.694189:0:6532:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:6532:1869355233164160:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1782759866.694947:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].37, 1000 off68952 00000040:00080000:0.0:1782759866.695011:0:6532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].37, 1152 off73688 00000004:00080000:0.0:1782759866.695018:0:6532:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc45c3e40 with version 74 00000004:00080000:2.0:1782759866.700443:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 74 rpc_version 74 00000020:00100000:3.0:1782759866.705133:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1782759866.705148:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cddcbb75880 x1869355233164416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782759866.705170:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233164416:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1782759866.705229:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759866.705281:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc230240 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.705289:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164416 00000100:00100000:1.0:1782759866.705298:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164416 00000100:00100000:1.0:1782759866.705370:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3570 00000100:00100000:1.0:1782759866.705380:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7476:x1869355233164416:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1782759866.705887:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7476:x1869355233164416:12345-0@lo:1000:osp_up0-1.0 Request processed in 507us (655us total) trans 4294968046 rc 0/0 00000100:00100000:1.0:1782759866.705896:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3570 00000100:00100000:3.0:1782759866.706559:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233164416:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1782759866.707010:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707028:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707041:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759866.707060:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f171eb4 reply state 00000000f18a43b0 transno 4294967789 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707071:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707078:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:0.0:1782759866.707081:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759866.707085:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759866.707092:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00080000:0.0:1782759866.707101:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000422:0x1:0x0] 00010000:00010000:0.0:1782759866.707114:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707124:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707131:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707148:0:6532:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1782759866.707152:0:6532:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000422:0x1:0x0] 00010000:00010000:0.0:1782759866.707157:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 4/0,1 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.707164:0:6532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 3/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759866.707267:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:116600:x1869355218646016:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 19478us (19909us total) trans 4294967789 rc 0/0 00000100:00100000:0.0:1782759866.707276:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3138 00010000:00010000:1.0:1782759866.707610:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759866.707617:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 2/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.707625:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759866.707631:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759866.707639:0:6519:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.707675:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 2/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.707687:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759866.707718:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 1/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.707726:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdecd8a7400/0xd5b45c7f5c60e228 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xd5b45c7f5c60e22f expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.707743:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759866.707745:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759866.707746:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759866.707793:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233164544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759866.707855:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.708021:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164544 00000100:00100000:1.0:1782759866.708029:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164544 00000100:00100000:1.0:1782759866.708079:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1782759866.708086:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3662:x1869355233164544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759866.708097:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759866.708113:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e22f lrc: 0/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xd5b45c7f5c60e228 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.708125:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:1.0:1782759866.708129:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759866.708158:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355233164544:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.708164:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1782759866.714837:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233164544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759866.727773:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759866.727940:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218646144 00000100:00100000:2.0:1782759866.727951:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218646144 00000100:00100000:2.0:1782759866.728023:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3139 00000100:00100000:2.0:1782759866.728036:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+13:116601:x1869355218646144:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759866.728056:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759866.728075:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e24b lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27870 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728131:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728144:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728156:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728170:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728178:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728190:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728278:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728288:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728295:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759866.728339:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759866.728344:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759866.728367:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728379:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728388:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728394:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728400:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728407:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728416:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.728421:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728428:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728440:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:2.0:1782759866.728443:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.728447:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728453:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e252 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728468:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728474:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728480:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728485:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.728487:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728493:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728503:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cddc34f4700) 00010000:00010000:2.0:1782759866.728506:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.728509:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728515:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e259 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728539:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e24b lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27870 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728553:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27870 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.728561:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759866.728564:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759866.728566:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:3.0:1782759866.728890:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+14:116601:x1869355218646144:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 856us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.728899:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3139 00000100:00100000:3.0:1782759866.731960:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.733871:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218646272 00000100:00100000:0.0:1782759866.733887:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218646272 00000100:00100000:0.0:1782759866.733960:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1124 00000100:00100000:0.0:1782759866.733971:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218646272:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759866.733989:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759866.734012:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d097fdf/0xd5b45c7f5c60e267 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27877 expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759866.734038:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x6a42c1bb, atime: 0x6a42c1bb, ctime: 0x6a42c1bb, blocks: 0x0 00010000:00010000:0.0:1782759866.734059:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=3907s v=(0 0) 00010000:00010000:0.0:1782759866.734063:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782759866.734072:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d097fdf/0xd5b45c7f5c60e267 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27877 expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.734093:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d097fdf/0xd5b45c7f5c60e267 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27877 expref: 6 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.734106:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802000, rc 0) 00000100:00100000:0.0:1782759866.734175:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218646272:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 206us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.734182:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1124 00000100:00100000:3.0:1782759866.737926:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.738043:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218646528 00000100:00100000:1.0:1782759866.738055:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218646528 00000100:00100000:1.0:1782759866.738121:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3140 00000100:00100000:1.0:1782759866.738132:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+14:116601:x1869355218646528:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759866.738155:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759866.738176:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e26e lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2787e expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.738516:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e275 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.738531:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e275 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.738543:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e275 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759866.738555:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782759866.738698:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e26e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2787e expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.738716:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e275 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2787e expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.738725:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:1.0:1782759866.738728:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782759866.738732:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413c00, rc 0) 00000100:00100000:1.0:1782759866.738801:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+16:116601:x1869355218646528:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 670us (884us total) trans 4294968047 rc 0/0 00000100:00100000:1.0:1782759866.738808:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3140 00000100:00100000:3.0:1782759866.741865:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759866.742648:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218646784 00000100:00100000:2.0:1782759866.742660:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218646784 00000100:00100000:2.0:1782759866.742736:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3141 00000100:00100000:2.0:1782759866.742748:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+16:116601:x1869355218646784:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759866.742808:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759866.742850:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e260 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27870 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.742870:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759866.742875:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759866.742897:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.742910:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.742920:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759866.743929:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 88 off10704 00000004:00080000:2.0:1782759866.743944:0:8593:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3907020366044ns, next at 3908020363804ns, rc = 0 00000004:00010000:2.0:1782759866.744012:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c774e29c reply state 0000000024ae31cc transno 4294968048 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.744030:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.744037:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759866.744040:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1782759866.744043:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759866.744377:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+17:116601:x1869355218646784:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 1628us (2516us total) trans 4294968048 rc 0/0 00000100:00100000:2.0:1782759866.744386:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3141 00000100:00100000:3.0:1782759866.775355:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759866.775622:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218646912 00000100:00100000:2.0:1782759866.775633:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218646912 00000100:00100000:2.0:1782759866.775698:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3142 00000100:00100000:2.0:1782759866.775708:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+17:116602:x1869355218646912:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759866.775730:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759866.775748:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e28a lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27885 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775820:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775834:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775844:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775854:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775864:0:42628:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 2/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e236 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775873:0:42628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 4/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.775902:0:42628:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 3/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e236 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759866.775917:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233164672:0@lo:104: 00000100:00100000:2.0:1782759866.775959:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759866.776055:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.778358:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164672 00000100:00100000:1.0:1782759866.778371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164672 00000100:00100000:0.0:1782759866.778986:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:0.0:1782759866.778998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355233164672:12345-0@lo:104: 00010000:00010000:0.0:1782759866.779022:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 3/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.779314:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759866.779321:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:42628:x1869355233164672:12345-0@lo:104: Request processed in 325us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.779329:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00010000:00010000:1.0:1782759866.779389:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759866.779398:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 3/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.779407:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803400 already unused, calling callback (ffffffffc1959eb0) 00010000:00010000:1.0:1782759866.779412:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 4/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759866.779421:0:9533:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 4/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.779456:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 2/0,0 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.779462:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759866.779489:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 1/0,0 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.779496:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8cdedf803400/0xd5b45c7f5c60e236 lrc: 0/0,0 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e23d expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.779517:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759866.779519:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759866.779521:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759866.779562:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759866.779611:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233164800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759866.779655:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759866.779755:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164800 00000100:00100000:1.0:1782759866.779761:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164800 00010000:00010000:1.0:1782759866.779785:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 4/0,0 mode: PW/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e236 expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759866.779913:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:1.0:1782759866.779921:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3662:x1869355233164800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759866.779934:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1782759866.780644:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:42628:1869355233164672:0@lo:104: 00010000:00010000:2.0:1782759866.780674:0:42628:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759866.796380:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968048 is committed 00000004:00080000:3.0:1782759866.796396:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000001:00080000:3.0:1782759866.796426:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968046 is committed 00000100:00100000:1.0:1782759866.796749:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759866.796769:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233164928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782759866.796853:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782759866.796954:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e23d lrc: 0/0,0 mode: --/PW res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e236 expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.796972:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc34f4300) 00010000:00010000:1.0:1782759866.796979:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.796989:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.796997:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 4/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.797019:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759866.797056:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb8dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233164800:12345-0@lo:103:ldlm_bl.0 Request processed in 17135us (17400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.797066:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1782759866.797142:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233164928 00000100:00100000:0.0:1782759866.797149:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233164928 00000100:00100000:0.0:1782759866.797206:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:0.0:1782759866.797214:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233164928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1782759866.797417:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759866.797420:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1782759867 -> 1782759867 00002000:00010000:0.0:1782759866.797423:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1782759867 -> 1782759867 00002000:00010000:0.0:1782759866.797425:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1782759867 -> 1782759867 00002000:00010000:0.0:1782759866.797426:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782759866.797464:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355233164928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (610us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1782759866.797470:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000004:00080000:0.0:1782759866.797510:0:3665:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4f6d880/2, rc 0, transno 4294967451 00000100:00100000:0.0:1782759866.797516:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233164928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782759866.797538:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233164800:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782759866.797773:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782759866.797914:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797924:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797931:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797936:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.797941:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797948:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797960:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cddc34f4700) 00010000:00010000:2.0:1782759866.797963:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.797967:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797973:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e1e2 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.797994:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798000:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798005:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798010:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.798013:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798019:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798025:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759866.798028:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.798031:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798036:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e1f7 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798047:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798053:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798057:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798063:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.798066:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798072:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798079:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759866.798081:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759866.798084:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798090:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e283 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798112:0:42628:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798120:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759866.798221:0:42628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:42628:1869355233165056:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1782759866.798276:0:42628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759866.798304:0:42628:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc489d300 going to sleep for 11 seconds 00000100:00100000:1.0:1782759866.798401:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165056 00000100:00100000:1.0:1782759866.798406:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165056 00000100:00100000:1.0:1782759866.798462:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571 00000100:00100000:1.0:1782759866.798471:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42628:x1869355233165056:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1782759866.798545:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:42628:x1869355233165056:12345-0@lo:1000:mdt00_005.0 Request processed in 75us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.798553:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571 00000100:00100000:2.0:1782759866.798825:0:42628:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:42628:1869355233165056:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1782759866.798872:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e29f lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798885:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e29f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798895:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e29f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759866.798919:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e29f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798932:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798939:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798946:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798953:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798958:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.798962:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798968:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798978:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:2.0:1782759866.798980:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.798984:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.798989:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e291 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799001:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799008:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799014:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799019:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.799023:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799029:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799037:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc34f4300) 00010000:00010000:2.0:1782759866.799040:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.799043:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799049:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e298 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799085:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e28a lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27885 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799100:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e29f lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27885 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.799107:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759866.799418:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759866.799422:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759866.799476:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+10:116602:x1869355218646912:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 23769us (24134us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.799482:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3142 00000100:00100000:3.0:1782759866.806337:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759866.807803:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218647040 00000100:00100000:2.0:1782759866.807816:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218647040 00000100:00100000:2.0:1782759866.807894:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00100000:2.0:1782759866.807905:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:95b27dde-c150-4adf-930b-37620c52929b+10:116602:x1869355218647040:12345-192.168.202.31@tcp:900:lfs.0 00000100:00100000:2.0:1782759866.808350:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:95b27dde-c150-4adf-930b-37620c52929b+10:116602:x1869355218647040:12345-192.168.202.31@tcp:900:lfs.0 Request processed in 446us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.808358:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 115 00000100:00100000:3.0:1782759866.819956:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.820133:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218647168 00000100:00100000:0.0:1782759866.820143:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218647168 00000100:00100000:0.0:1782759866.820208:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3143 00000100:00100000:0.0:1782759866.820220:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+7:116602:x1869355218647168:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759866.820252:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759866.820273:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e2a6 lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2788c expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.820329:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e2ad lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.820348:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e2ad lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.820360:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e2ad lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759866.820407:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759866.820411:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1782759866.820445:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e2a6 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2788c expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.820463:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e2ad lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2788c expref: 8 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.820471:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:0.0:1782759866.820474:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759866.820478:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803c00, rc 0) 00000100:00100000:0.0:1782759866.820543:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+8:116602:x1869355218647168:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 326us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759866.820551:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3143 00000100:00100000:3.0:1782759866.824090:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.824242:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218647424 00000100:00100000:0.0:1782759866.824252:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218647424 00000100:00100000:0.0:1782759866.824310:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3144 00000100:00100000:0.0:1782759866.824320:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+8:116602:x1869355218647424:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759866.824340:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759866.824397:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2b4 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27893 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759866.824505:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1782759866.824673:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2b4 lrc: 1/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27893 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.824687:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759866.824690:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759866.824695:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2b4 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27893 expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.824713:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803000, rc 0) 00000100:00100000:0.0:1782759866.824778:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+9:116602:x1869355218647424:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 459us (699us total) trans 4294967790 rc 301/301 00000100:00100000:0.0:1782759866.824785:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3144 00000100:00100000:3.0:1782759866.832828:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.833182:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218647680 00000100:00100000:0.0:1782759866.833193:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218647680 00000100:00100000:0.0:1782759866.833259:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3145 00000100:00100000:0.0:1782759866.833270:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+9:116602:x1869355218647680:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759866.833328:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759866.833356:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e2ad lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2788c expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.833378:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:0.0:1782759866.833382:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759866.833401:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.833420:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.833430:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759866.834200:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029140726 reply state 000000009314cdc9 transno 4294967791 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.834217:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759866.834224:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:0.0:1782759866.834227:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782759866.834229:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759866.834237:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782759866.834318:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+10:116602:x1869355218647680:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 1049us (1498us total) trans 4294967791 rc 0/0 00000100:00100000:0.0:1782759866.834326:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3145 00000100:00100000:3.0:1782759866.839836:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.840542:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218647936 00000100:00100000:1.0:1782759866.840554:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218647936 00000100:00100000:1.0:1782759866.840653:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 465 00000100:00100000:1.0:1782759866.840673:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+10:116602:x1869355218647936:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759866.840938:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+11:116602:x1869355218647936:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 275us (1111us total) trans 4294967792 rc 0/0 00000100:00100000:1.0:1782759866.841415:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 465 00000100:00100000:3.0:1782759866.848761:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.848833:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218648192 00000100:00100000:1.0:1782759866.848843:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218648192 00000100:00100000:1.0:1782759866.848918:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3146 00000100:00100000:1.0:1782759866.848929:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+10:116602:x1869355218648192:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759866.849118:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759866.849140:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e2c9 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2789a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849214:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849228:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849252:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849267:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849275:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849286:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849336:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e2de lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849344:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e2de lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849351:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e2de lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849366:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849372:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849377:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849383:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849388:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759866.849392:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849399:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849410:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:1.0:1782759866.849413:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759866.849417:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849422:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e2d0 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849435:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849440:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849445:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849450:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759866.849452:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849457:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849463:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc34f6a00) 00010000:00010000:1.0:1782759866.849465:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759866.849468:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849473:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e2d7 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849506:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e2c9 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2789a expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849524:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e2de lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2789a expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.849530:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:1.0:1782759866.849532:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759866.849534:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413000, rc 0) 00000100:00100000:1.0:1782759866.849639:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+11:116602:x1869355218648192:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 712us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.849648:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3146 00000100:00100000:2.0:1782759866.853928:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.855818:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218648448 00000100:00100000:3.0:1782759866.855833:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218648448 00000100:00100000:3.0:1782759866.855906:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3147 00000100:00100000:3.0:1782759866.855919:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+11:116602:x1869355218648448:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759866.855947:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.855968:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e2e5 lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278a1 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759866.856091:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1782759866.856219:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e2e5 lrc: 1/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278a1 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.856236:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:3.0:1782759866.856240:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759866.856245:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e2e5 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278a1 expref: 13 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.856260:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759866.857391:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+12:116602:x1869355218648448:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1468us (3466us total) trans 4294967793 rc 301/301 00000100:00100000:3.0:1782759866.857403:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3147 00000100:00100000:2.0:1782759866.859452:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.859691:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218648576 00000100:00100000:3.0:1782759866.859702:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218648576 00000100:00100000:3.0:1782759866.859765:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 421 00000100:00100000:3.0:1782759866.859775:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95b27dde-c150-4adf-930b-37620c52929b+11:2405:x1869355218648576:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759866.859791:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759866.859819:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e2de lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2789a expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.859841:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:3.0:1782759866.859846:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759866.859904:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95b27dde-c150-4adf-930b-37620c52929b+10:2405:x1869355218648576:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 130us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.859912:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 421 00000100:00100000:0.0:1782759866.859995:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759866.860062:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218648704 00000100:00100000:3.0:1782759866.860068:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218648704 00000100:00100000:3.0:1782759866.860107:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3148 00000100:00100000:3.0:1782759866.860115:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+12:116602:x1869355218648704:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759866.860149:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759866.860169:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e2f3 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278a8 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.860249:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e2fa lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.860262:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e2fa lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.860272:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e2fa lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759866.860315:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759866.860319:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759866.860339:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e2fa lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.860367:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e2f3 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278a8 expref: 14 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.860386:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e2fa lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278a8 expref: 13 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759866.860394:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:3.0:1782759866.860396:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759866.860399:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7800, rc 0) 00000100:00100000:3.0:1782759866.860437:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+13:116602:x1869355218648704:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 323us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759866.860443:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3148 00000100:00100000:0.0:1782759866.871910:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.876514:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218648832 00000100:00100000:1.0:1782759866.876531:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218648832 00000100:00100000:1.0:1782759866.876662:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 466 00000100:00100000:1.0:1782759866.876682:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+13:116602:x1869355218648832:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759866.886699:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+13:116602:x1869355218648832:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 10006us (14783us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759866.886714:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 466 00000100:00100000:2.0:1782759866.890844:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759866.891063:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649088 00000100:00100000:0.0:1782759866.891073:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649088 00000100:00100000:0.0:1782759866.891164:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 467 00000100:00100000:0.0:1782759866.891174:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+13:116602:x1869355218649088:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759866.891412:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+14:116602:x1869355218649088:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 238us (575us total) trans 4294967794 rc 0/0 00000100:00100000:0.0:1782759866.891421:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 467 00000100:00100000:0.0:1782759866.922915:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759866.923953:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649216 00000100:00100000:2.0:1782759866.923965:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649216 00000100:00100000:2.0:1782759866.924044:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3149 00000100:00100000:2.0:1782759866.924056:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+10:116604:x1869355218649216:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759866.924079:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759866.924103:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e301 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278af expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924341:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924359:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924370:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924386:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924392:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924403:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924473:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924482:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924488:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759866.924541:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759866.924545:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759866.924625:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924636:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924647:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924653:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924660:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924832:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924844:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.924849:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924858:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924871:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:2.0:1782759866.924874:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.924878:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924884:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e308 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924901:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924906:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924911:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924915:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759866.924918:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924924:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.924934:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cddc3500800) 00010000:00010000:2.0:1782759866.924936:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759866.924938:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.925106:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e30f lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.925144:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e301 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278af expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.925219:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278af expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759866.925228:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759866.925230:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759866.925232:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648000, rc 0) 00000100:00100000:2.0:1782759866.925311:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec48a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+11:116604:x1869355218649216:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1257us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759866.925319:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3149 00000100:00100000:3.0:1782759866.982471:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759866.982692:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649472 00000100:00100000:1.0:1782759866.982701:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649472 00000100:00100000:1.0:1782759866.982760:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3150 00000100:00100000:1.0:1782759866.982773:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+14:116607:x1869355218649472:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759866.982801:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759866.982825:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e31d lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278b6 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.982927:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e324 lrc: 3/1,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.983098:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e324 lrc: 3/1,0 mode: CR/CR res: [0x240000406:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.983113:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e324 lrc: 3/1,0 mode: CR/CR res: [0x240000406:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759866.983126:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782759866.983253:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e31d lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278b6 expref: 17 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.983276:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e324 lrc: 3/0,0 mode: CR/CR res: [0x240000406:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278b6 expref: 16 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759866.983285:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:1.0:1782759866.983288:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782759866.983292:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759866.983413:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+16:116607:x1869355218649472:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 642us (952us total) trans 4294967795 rc 0/0 00000100:00100000:1.0:1782759866.983420:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3150 00000100:00100000:3.0:1782759867.274940:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759867.274963:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233165184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759867.275033:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759867.275154:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165184 00000100:00100000:1.0:1782759867.275163:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165184 00000100:00100000:1.0:1782759867.275230:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572 00000100:00100000:1.0:1782759867.275240:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233165184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759867.275279:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1782759867.277434:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233165184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2185us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759867.277447:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1782759867.282379:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968046 gen 2 00000004:00080000:3.0:1782759867.282392:0:3664:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968046 committed transno 4294968046 00000100:00100000:3.0:1782759867.282430:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233165184:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759867.338699:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759867.757897:0:163224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa1d49450 20000000:00000080:2.0:1782759867.757929:0:163224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc7309000 uarg=0000000000000000 00010000:00010000:2.0:1782759867.758181:0:163224:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1782759867.758220:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759867.758224:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759867.758246:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e1fe lrc: 0/0,0 mode: --/CR res: [0x200000422:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27862 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758278:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759867.758281:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759867.758285:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e316 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278af expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758300:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:2.0:1782759867.758302:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782759867.758306:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e275 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x2:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2787e expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758324:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759867.758327:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759867.758330:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e1b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2784d expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758341:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:2.0:1782759867.758343:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1782759867.758347:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e221 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27869 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758364:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759867.758366:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759867.758369:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e29f lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27885 expref: 5 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758385:0:163224:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1782759867.758414:0:163224:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1782759867.758435:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:2.0:1782759867.758437:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782759867.758441:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e324 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278b6 expref: 15 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758454:0:163224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:2.0:1782759867.758457:0:163224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759867.758460:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e2fa lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278a8 expref: 14 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758471:0:163224:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 2 locks, left on hash table 0. 10000000:01000000:2.0:1782759867.758487:0:163224:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759867.758502:0:163224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758515:0:163224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758523:0:163224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758569:0:163224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.758777:0:163224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 23 pid: 6526 timeout: 4058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759867.758794:0:163224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163224:1869355233165312:0@lo:104: 00000100:00100000:2.0:1782759867.758858:0:163224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759867.758947:0:163224:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded8655840 going to sleep for 11 seconds 00000100:00100000:2.0:1782759867.763675:0:140593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759867.763706:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165312 00000100:00100000:2.0:1782759867.763716:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165312 00000100:00100000:2.0:1782759867.764132:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1782759867.764146:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb9c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:163224:x1869355233165312:12345-0@lo:104: 00010000:00010000:2.0:1782759867.764166:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.764347:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759867.764354:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb9c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:163224:x1869355233165312:12345-0@lo:104: Request processed in 213us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759867.764362:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00010000:00010000:1.0:1782759867.764435:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759867.764442:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764451:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759867.764455:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764464:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759867.764471:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759867.764477:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759867.764517:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764524:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759867.764555:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764574:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803600/0xd5b45c7f5c60e19c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e1a3 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764613:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759867.764614:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759867.764616:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759867.764624:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759867.764637:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233165440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759867.764680:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759867.764726:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165440 00000100:00100000:1.0:1782759867.764730:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165440 00010000:00010000:1.0:1782759867.764753:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 24 pid: 6526 timeout: 4058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759867.764777:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1782759867.764783:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233165440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759867.764793:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759867.764799:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 24 pid: 6526 timeout: 4058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764809:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 24 pid: 6526 timeout: 4058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764827:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764834:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764848:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764856:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764862:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764868:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764875:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759867.764879:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764886:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764893:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759867.764902:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759867.764930:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233165440:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759867.764936:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00100000:1.0:1782759867.764979:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233165440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759867.767790:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648e00/0xd5b45c7f5c60e1a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e19c expref: 23 pid: 6526 timeout: 4058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759867.767811:0:163224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163224:1869355233165312:0@lo:104: 00010000:00010000:3.0:1782759867.767843:0:163224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.771448:0:163224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.771466:0:163224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759867.771474:0:163224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e332 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759868.300412:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233165952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.300478:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.300532:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233166464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.300570:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.300751:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233166976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.300775:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.300841:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759868.300849:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233165568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.300876:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.300896:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233166080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.300917:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.300933:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233166592:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.300953:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.300978:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233165696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.301001:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.301018:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233166208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.301036:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.301051:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233166720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.301071:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.301088:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1782759868.301094:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233165824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.301115:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.301131:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233166336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.301152:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759868.301332:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165568 00000100:00100000:0.0:1782759868.301340:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165568 00000100:00100000:0.0:1782759868.301379:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166080 00000100:00100000:0.0:1782759868.301382:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166080 00000100:00100000:0.0:1782759868.301405:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166592 00000100:00100000:0.0:1782759868.301408:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166592 00000100:00100000:0.0:1782759868.301429:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166208 00000100:00100000:0.0:1782759868.301431:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166208 00000100:00100000:0.0:1782759868.301442:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166720 00000100:00100000:0.0:1782759868.301444:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166720 00000100:00100000:0.0:1782759868.301456:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165824 00000100:00100000:0.0:1782759868.301458:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165824 00000100:00100000:0.0:1782759868.301472:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5592 00000100:00100000:0.0:1782759868.301479:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233165568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301537:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233165568:12345-0@lo:400:kworker.0 Request processed in 58us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.301544:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5592 00000100:00100000:0.0:1782759868.301575:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5593 00000100:00100000:0.0:1782759868.301616:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233166080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301645:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233166080:12345-0@lo:400:kworker.0 Request processed in 42us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.301651:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5593 00000100:00100000:0.0:1782759868.301665:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5594 00000100:00100000:0.0:1782759868.301671:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233166592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301698:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233166592:12345-0@lo:400:kworker.0 Request processed in 27us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.301703:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5594 00000100:00100000:0.0:1782759868.301714:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5595 00000100:00100000:0.0:1782759868.301720:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233166208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301746:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233166208:12345-0@lo:400:kworker.0 Request processed in 26us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.301752:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5595 00000100:00100000:0.0:1782759868.301763:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5596 00000100:00100000:0.0:1782759868.301769:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233166720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301794:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233166720:12345-0@lo:400:kworker.0 Request processed in 26us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.301801:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5596 00000100:00100000:0.0:1782759868.301811:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5597 00000100:00100000:0.0:1782759868.301817:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233165824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301841:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233165824:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.301847:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5597 00000100:00080000:0.0:1782759868.301862:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759868.301866:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759868.301894:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233165568:0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301904:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233166080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.301913:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233166592:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.307750:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233166848:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.307817:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759868.309123:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166464 00000100:00100000:3.0:1782759868.309138:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166464 00000100:00100000:3.0:1782759868.309228:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166976 00000100:00100000:3.0:1782759868.309231:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166976 00000100:00100000:3.0:1782759868.309249:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166336 00000100:00100000:3.0:1782759868.309252:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166336 00000100:00100000:3.0:1782759868.309282:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3303 00000100:00100000:3.0:1782759868.309289:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233166464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759868.309379:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233166464:12345-0@lo:400:kworker.0 Request processed in 90us (8820us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.309387:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3303 00000100:00100000:3.0:1782759868.309403:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3304 00000100:00100000:3.0:1782759868.309409:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233166976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759868.309439:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233166976:12345-0@lo:400:kworker.0 Request processed in 30us (8663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.309445:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3304 00000100:00100000:3.0:1782759868.309457:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3305 00000100:00100000:3.0:1782759868.309464:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233166336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759868.309494:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233166336:12345-0@lo:400:kworker.0 Request processed in 31us (8341us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.309499:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3305 00000100:00080000:1.0:1782759868.309612:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759868.309616:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759868.309723:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165952 00000100:00100000:3.0:1782759868.309728:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165952 00000100:00100000:3.0:1782759868.309777:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233165696 00000100:00100000:3.0:1782759868.309781:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233165696 00000100:00100000:3.0:1782759868.309795:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3573 00000100:00100000:3.0:1782759868.309800:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233165952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759868.309836:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233165952:12345-0@lo:400:kworker.0 Request processed in 35us (9358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.309843:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3573 00000100:00100000:3.0:1782759868.309855:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574 00000100:00100000:3.0:1782759868.309861:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233165696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759868.309888:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233165696:12345-0@lo:400:kworker.0 Request processed in 28us (8887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759868.309894:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574 00000100:00100000:0.0:1782759868.310217:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233165952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.310234:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc533800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233166464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759868.310246:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233166976:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.310788:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233165696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.310804:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233166208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.310815:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233166720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.310839:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233165824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.310851:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233166336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.310898:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233166848 00000100:00100000:2.0:1782759868.310902:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233166848 00000100:00100000:2.0:1782759868.310992:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3306 00000100:00100000:2.0:1782759868.311001:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233166848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759868.311048:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233166848:12345-0@lo:400:kworker.0 Request processed in 49us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.311055:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3306 00000100:00100000:2.0:1782759868.311084:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233166848:0@lo:400:kworker.0 00000100:00080000:1.0:1782759868.311240:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1782759868.365913:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759868.828780:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233167232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759868.828862:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.829814:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233167104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759868.829856:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759868.829905:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167232 00000100:00100000:2.0:1782759868.829912:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167232 00000100:00100000:2.0:1782759868.829958:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167104 00000100:00100000:2.0:1782759868.829960:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167104 00000100:00100000:2.0:1782759868.829976:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:2.0:1782759868.829984:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233167232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759868.830013:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759868.837029:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:0.0:1782759868.837052:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233167104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759868.837079:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759868.837173:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233167104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (7315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759868.837181:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:2.0:1782759868.843942:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233167232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 13946us (15068us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759868.843959:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00000100:00100000:2.0:1782759868.844039:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233167104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759868.853020:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc530000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233167232:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759869.386712:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759869.672431:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759869.672508:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759869.672557:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759869.672656:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759869.672683:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649600 00000100:00100000:2.0:1782759869.672693:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649600 00000100:00100000:2.0:1782759869.672759:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3566 00000100:00100000:2.0:1782759869.672770:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218649600:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759869.672847:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218649600:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759869.672854:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3566 00000100:00100000:3.0:1782759869.673041:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649984 00000100:00100000:3.0:1782759869.673047:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649984 00000100:00100000:3.0:1782759869.673103:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3307 00000100:00100000:3.0:1782759869.673112:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218649984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759869.673144:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218649984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.673151:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3307 00000100:00100000:3.0:1782759869.673169:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649728 00000100:00100000:3.0:1782759869.673173:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649728 00000100:00100000:3.0:1782759869.673201:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218649856 00000100:00100000:3.0:1782759869.673204:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218649856 00000100:00100000:3.0:1782759869.673225:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5598 00000100:00100000:3.0:1782759869.673230:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218649728:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759869.673260:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218649728:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.673266:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5598 00000100:00100000:3.0:1782759869.673277:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5599 00000100:00100000:3.0:1782759869.673284:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+14:2404:x1869355218649856:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759869.673311:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+14:2404:x1869355218649856:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.673316:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5599 00000100:00080000:2.0:1782759869.673633:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759869.673638:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759869.673640:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1782759869.775825:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759869.775834:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759869.775840:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759869.775893:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.775906:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.775917:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759869.775942:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233167360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759869.784705:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759869.784764:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97480 going to sleep for 11 seconds 00000100:00100000:1.0:1782759869.784796:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167360 00000100:00100000:1.0:1782759869.784806:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167360 00000100:00100000:1.0:1782759869.784858:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3567 00000100:00100000:1.0:1782759869.784868:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233167360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759869.784886:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759869.784907:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e339 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.784936:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.784946:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.784957:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759869.785004:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233167360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759869.785011:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3567 00000100:00100000:1.0:1782759869.785065:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233167360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759869.785083:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.785094:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759869.785115:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759869.785121:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759869.785129:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759869.836739:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233167488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759869.836811:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759869.836876:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167488 00000100:00100000:2.0:1782759869.836884:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167488 00000100:00100000:2.0:1782759869.836933:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1782759869.836942:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233167488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759869.836975:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759869.837021:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233167488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759869.837028:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000100:00100000:2.0:1782759869.837073:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233167488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759869.839746:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233167616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759869.839821:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759869.840020:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167616 00000100:00100000:0.0:1782759869.840028:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167616 00000100:00100000:0.0:1782759869.840078:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:0.0:1782759869.840086:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233167616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759869.840109:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759869.840169:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233167616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759869.840177:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:0.0:1782759869.840224:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233167616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759869.840799:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233167744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759869.840839:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759869.841281:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167744 00000100:00100000:3.0:1782759869.841287:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167744 00000100:00100000:3.0:1782759869.841332:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3575 00000100:00100000:3.0:1782759869.841339:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233167744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759869.841366:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:3.0:1782759869.848231:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233167744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6880us (7379us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759869.848246:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3575 00000100:00100000:1.0:1782759869.850221:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233167744:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1782759870.411237:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782759870.873716:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000020:00000080:3.0:1782759870.873727:0:9523:0:(genops.c:906:class_export_put()) final put ffff8cddc47f9800/95b27dde-c150-4adf-930b-37620c52929b 00000020:00000080:0.0:1782759870.874030:0:1371:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc47f9800/95b27dde-c150-4adf-930b-37620c52929b for lustre-OST0001 00000020:00000080:0.0:1782759870.874085:0:1371:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc47fa000 for lustre-OST0001 00000100:00100000:0.0:1782759870.931356:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759870.931511:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218650240 00000100:00100000:3.0:1782759870.931521:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218650240 00000100:00100000:3.0:1782759870.931735:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3151 00000100:00100000:3.0:1782759870.931746:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:116682:x1869355218650240:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759870.931799:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759870.931804:0:6532:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e316) 00010000:00010000:3.0:1782759870.931806:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759870.931876:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:116682:x1869355218650240:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 132us (528us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759870.931883:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3151 00000100:00100000:1.0:1782759870.972974:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759870.973027:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218650496 00000100:00100000:1.0:1782759870.973038:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218650496 00000100:00100000:1.0:1782759870.973093:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3152 00000100:00100000:1.0:1782759870.973105:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+14:116683:x1869355218650496:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759870.973156:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759870.973161:0:6531:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e2fa) 00010000:00010000:1.0:1782759870.973164:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759870.973234:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+14:116683:x1869355218650496:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 131us (269us total) trans 0 rc -13/-13 00000100:00100000:1.0:1782759870.973243:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3152 00000100:00100000:3.0:1782759871.005926:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759871.006103:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218650624 00000100:00100000:2.0:1782759871.006115:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218650624 00000100:00100000:2.0:1782759871.006219:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3153 00000100:00100000:2.0:1782759871.006239:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:116685:x1869355218650624:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759871.006262:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759871.006283:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e347 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278bd expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006346:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006359:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006372:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006383:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006389:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006395:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006462:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006470:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006476:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759871.006515:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759871.006519:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759871.006550:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006560:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006568:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006574:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006606:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006613:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006620:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759871.006624:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006630:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006642:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759871.006646:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759871.006651:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006657:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e34e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006674:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006679:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006685:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006690:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759871.006693:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006698:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006704:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cddc3500b00) 00010000:00010000:2.0:1782759871.006707:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759871.006709:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006714:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e355 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006748:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e347 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278bd expref: 7 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006763:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278bd expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.006774:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc3500f00) 00010000:00010000:2.0:1782759871.006777:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759871.006779:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759871.006836:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+6:116685:x1869355218650624:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 608us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759871.006844:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3153 00000100:00080000:1.0:1782759871.009334:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759871.054217:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759871.054349:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218650752 00000100:00100000:2.0:1782759871.054360:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218650752 00000100:00100000:2.0:1782759871.054470:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3154 00000100:00100000:2.0:1782759871.054482:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:116688:x1869355218650752:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759871.054514:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759871.054571:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e363 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278c4 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054688:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054702:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054712:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054737:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054744:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054755:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054811:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e378 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054818:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e378 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054825:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e378 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759871.054848:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e378 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054863:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054870:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054877:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054883:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054888:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759871.054893:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054912:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054924:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc3500500) 00010000:00010000:2.0:1782759871.054926:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759871.054932:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054939:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e36a lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054954:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054960:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054965:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054970:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759871.054973:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054979:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054986:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc3500b00) 00010000:00010000:2.0:1782759871.054988:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759871.054991:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.054996:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e371 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.055030:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e363 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278c4 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.055044:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e378 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278c4 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.055051:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc3500100) 00010000:00010000:2.0:1782759871.055053:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759871.055055:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759871.055118:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:116688:x1869355218650752:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 639us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759871.055125:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3154 00000100:00100000:1.0:1782759871.066184:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759871.066259:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759871.066391:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218650880 00000100:00100000:3.0:1782759871.066401:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218650880 00000100:00100000:3.0:1782759871.066474:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3155 00000100:00100000:3.0:1782759871.066484:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+14:116688:x1869355218650880:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759871.066513:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759871.066542:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e37f lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278cb expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759871.066643:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e386 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759871.066657:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e386 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759871.066669:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e386 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759871.066715:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759871.066719:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1782759871.066753:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e37f lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278cb expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759871.066772:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e386 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278cb expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759871.066780:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:3.0:1782759871.066783:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759871.066786:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759871.066843:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+15:116688:x1869355218650880:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 360us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759871.066850:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3155 00000100:00100000:2.0:1782759871.067259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218651008 00000100:00100000:2.0:1782759871.067265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218651008 00000100:00100000:2.0:1782759871.067320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 422 00000100:00100000:2.0:1782759871.067329:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218651008:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759871.067339:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759871.067354:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e378 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278c4 expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.067366:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc3500100) 00010000:00010000:2.0:1782759871.067375:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759871.067403:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218651008:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 76us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759871.067409:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 422 00000100:00080000:1.0:1782759871.067524:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759871.108884:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759871.109195:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218651264 00000100:00100000:3.0:1782759871.109206:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218651264 00000100:00100000:3.0:1782759871.109271:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3156 00000100:00100000:3.0:1782759871.109282:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+6:116690:x1869355218651264:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:3.0:1782759871.109337:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759871.109365:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e35c lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278bd expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759871.109385:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc3500f00) 00010000:00010000:3.0:1782759871.109397:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759871.109474:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:116690:x1869355218651264:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 193us (600us total) trans 0 rc -13/-13 00000100:00100000:3.0:1782759871.109481:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3156 00000100:00100000:3.0:1782759871.145170:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759871.145287:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218651520 00000100:00100000:2.0:1782759871.145297:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218651520 00000100:00100000:2.0:1782759871.145364:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3157 00000100:00100000:2.0:1782759871.145375:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+15:116691:x1869355218651520:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759871.145427:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759871.145454:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e386 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278cb expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759871.145474:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:2.0:1782759871.145479:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759871.145642:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+14:116691:x1869355218651520:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 269us (481us total) trans 0 rc -13/-13 00000100:00100000:2.0:1782759871.145650:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3157 00010000:00010000:1.0:1782759871.434892:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759872.063464:0:163420:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd50f549c0 20000000:00000080:3.0:1782759872.063481:0:163420:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec93abc00 uarg=0000000000000000 00010000:00010000:3.0:1782759872.063717:0:163420:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759872.063735:0:163420:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759872.063757:0:163420:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759872.063770:0:163420:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759872.063785:0:163420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759872.063812:0:163420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.064070:0:163420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.064080:0:163420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.064122:0:163420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.064137:0:163420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 23 pid: 6525 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759872.064153:0:163420:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163420:1869355233167872:0@lo:104: 00000100:00100000:3.0:1782759872.066243:0:163420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759872.066306:0:163420:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc2700b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759872.066475:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233167872 00000100:00100000:1.0:1782759872.066484:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233167872 00000100:00100000:1.0:1782759872.066547:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1782759872.066556:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:163420:x1869355233167872:12345-0@lo:104: 00010000:00010000:1.0:1782759872.066572:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759872.066808:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759872.066815:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:163420:x1869355233167872:12345-0@lo:104: Request processed in 260us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759872.066823:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00010000:00010000:2.0:1782759872.066881:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759872.066889:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759872.066897:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759872.066902:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759872.066911:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759872.066918:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759872.066924:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759872.066964:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759872.066975:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759872.067009:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759872.067017:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5413600/0xd5b45c7f5c60e339 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e340 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759872.067034:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759872.067036:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759872.067037:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759872.067045:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759872.067056:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233168000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759872.067093:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759872.067246:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168000 00000100:00100000:0.0:1782759872.067251:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168000 00010000:00010000:0.0:1782759872.067273:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 24 pid: 6525 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759872.067309:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1782759872.067316:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233168000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759872.067327:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759872.067332:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 24 pid: 6525 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067343:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 24 pid: 6525 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067360:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067369:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067381:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067388:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067396:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067402:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067408:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759872.067411:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067418:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067426:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759872.067434:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759872.067464:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233168000:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759872.067470:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1782759872.067498:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233168000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759872.069053:0:163420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e340 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e339 expref: 23 pid: 6525 timeout: 4062 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759872.069072:0:163420:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163420:1869355233167872:0@lo:104: 00010000:00010000:3.0:1782759872.069092:0:163420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.069104:0:163420:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.069110:0:163420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.069118:0:163420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e38d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759872.395331:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759872.395355:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233168128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759872.395428:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759872.395613:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168128 00000100:00100000:2.0:1782759872.395621:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168128 00000100:00100000:2.0:1782759872.395688:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3576 00000100:00100000:2.0:1782759872.395699:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233168128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759872.395735:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759872.395798:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233168128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759872.395804:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3576 00000100:00100000:2.0:1782759872.395843:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233168128:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759872.459535:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782759872.909045:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967451 is committed 00000001:00080000:2.0:1782759872.909835:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967795 is committed 00000020:00080000:2.0:1782759872.909870:0:7461:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8cddc45c3f00 refcount 2 committed 0 result 0 batchid 36 00000020:00080000:2.0:1782759872.909877:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecdb16600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8cddc45c3e40 00010000:00010000:3.0:1782759872.909886:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759872.909891:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].37 00000020:00080000:2.0:1782759872.909897:0:7461:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8cdecdb16700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cdec1343200 00000020:00080000:2.0:1782759872.909904:0:7461:0:(update_trans.c:73:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].37 00010000:00010000:3.0:1782759872.909905:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 2/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.909916:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.909923:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759872.909928:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.909938:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 4/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.909958:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:3.0:1782759872.909961:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759872.909966:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 2/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.909977:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e244 lrc: 0/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.909997:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.910003:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.910008:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.910013:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759872.910016:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.910021:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.910027:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:3.0:1782759872.910029:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759872.910031:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 2/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759872.910036:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e2c2 lrc: 0/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1782759872.910098:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 36 committed batchid 35 00000020:00080000:0.0:1782759872.910174:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 35 00000100:00100000:1.0:1782759873.419533:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233168640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.419726:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233168256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.419771:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.419818:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233168768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.419844:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.419864:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233169280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.419888:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.419905:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233169792:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.419926:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.419948:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759873.419954:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233168384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.419964:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233168512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.419977:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759873.419991:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.419994:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233168896:0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420009:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233169024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420016:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759873.420029:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.420030:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233169408:0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420044:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233169536:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420049:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759873.420063:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.420078:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168768 00000100:00100000:0.0:1782759873.420086:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168768 00000100:00100000:2.0:1782759873.420087:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168256 00000100:00100000:2.0:1782759873.420090:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168256 00000100:00100000:0.0:1782759873.420136:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168512 00000100:00100000:0.0:1782759873.420139:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168512 00000100:00100000:2.0:1782759873.420140:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3568 00000100:00100000:2.0:1782759873.420149:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233168256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420153:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577 00000100:00100000:0.0:1782759873.420174:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233168768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420207:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233168256:12345-0@lo:400:kworker.0 Request processed in 58us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.420207:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233168768:12345-0@lo:400:kworker.0 Request processed in 33us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759873.420214:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3568 00000100:00100000:0.0:1782759873.420214:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577 00000100:00100000:0.0:1782759873.420229:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3578 00000100:00100000:0.0:1782759873.420233:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233168512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420245:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169280 00000100:00100000:2.0:1782759873.420248:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169280 00000100:00100000:0.0:1782759873.420264:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233168512:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.420269:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3578 00000100:00100000:2.0:1782759873.420283:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169792 00000100:00100000:2.0:1782759873.420285:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169792 00000100:00100000:0.0:1782759873.420287:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168384 00000100:00100000:0.0:1782759873.420290:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168384 00000100:00100000:2.0:1782759873.420304:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1782759873.420310:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5600 00000100:00100000:2.0:1782759873.420312:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233169280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420315:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233168384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420342:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc533800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233169280:12345-0@lo:400:kworker.0 Request processed in 32us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.420342:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233168384:12345-0@lo:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759873.420348:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3308 00000100:00100000:0.0:1782759873.420349:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5600 00000100:00100000:0.0:1782759873.420358:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168896 00000100:00100000:2.0:1782759873.420359:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1782759873.420360:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168896 00000100:00100000:2.0:1782759873.420366:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233169792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420372:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169024 00000100:00100000:0.0:1782759873.420374:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169024 00000100:00100000:0.0:1782759873.420383:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169408 00000100:00100000:0.0:1782759873.420386:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169408 00000100:00100000:2.0:1782759873.420394:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233169792:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.420396:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169536 00000100:00100000:0.0:1782759873.420398:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169536 00000100:00100000:2.0:1782759873.420400:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3309 00000100:00100000:0.0:1782759873.420412:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5601 00000100:00100000:0.0:1782759873.420417:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233168896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420426:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5602 00000100:00100000:2.0:1782759873.420432:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233169024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420444:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233168896:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.420450:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5601 00000100:00100000:2.0:1782759873.420455:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233169024:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759873.420460:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5602 00000100:00100000:0.0:1782759873.420463:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5603 00000100:00100000:0.0:1782759873.420468:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233169408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420471:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5604 00000100:00100000:2.0:1782759873.420477:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233169536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.420493:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233169408:12345-0@lo:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759873.420497:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233169536:12345-0@lo:400:kworker.0 Request processed in 22us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.420498:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5603 00000100:00100000:2.0:1782759873.420502:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5604 00000100:00100000:0.0:1782759873.420800:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233168384:0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420988:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233168512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.420998:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233169024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759873.421006:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233169536:0@lo:400:kworker.0 00000100:00080000:2.0:1782759873.421033:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759873.421037:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759873.421040:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759873.421042:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759873.426187:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc36fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233168896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.426211:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233169408:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.426222:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233168256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.426235:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233168768:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.426245:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967451 gen 2 00000004:00080000:0.0:1782759873.426250:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4f6d880, transno 4294967451 00000100:00100000:0.0:1782759873.426262:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233169280:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.426274:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233169792:0@lo:400:kworker.0 00000100:00100000:1.0:1782759873.426921:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.427037:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233168640 00000100:00100000:0.0:1782759873.427045:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233168640 00000100:00100000:0.0:1782759873.427106:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5605 00000100:00100000:0.0:1782759873.427115:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233168640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.427278:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233168640:12345-0@lo:400:kworker.0 Request processed in 163us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.427287:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5605 00000100:00100000:0.0:1782759873.427325:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233168640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.427336:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233169152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.427368:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.427395:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233169664:0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.427416:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759873.432057:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169152 00000100:00100000:1.0:1782759873.432076:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169152 00000100:00100000:1.0:1782759873.432294:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169664 00000100:00100000:1.0:1782759873.432298:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169664 00000100:00100000:0.0:1782759873.432362:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3310 00000100:00100000:0.0:1782759873.432378:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233169152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.432485:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233169152:12345-0@lo:400:kworker.0 Request processed in 111us (5115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.432492:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3310 00000100:00100000:0.0:1782759873.432556:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233169152:0@lo:400:kworker.0 00000100:00080000:2.0:1782759873.434615:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759873.434634:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759873.439791:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3311 00000100:00100000:0.0:1782759873.439815:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233169664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759873.440791:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233169664:12345-0@lo:400:kworker.0 Request processed in 981us (13368us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.440804:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3311 00000100:00100000:1.0:1782759873.449777:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233169664:0@lo:400:kworker.0 00010000:00010000:1.0:1782759873.482790:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759873.931407:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759873.937095:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233169920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759873.937181:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759873.937367:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233169920 00000100:00100000:0.0:1782759873.937376:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233169920 00000100:00100000:0.0:1782759873.937433:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:0.0:1782759873.937442:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233169920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759873.937475:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759873.937538:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233169920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759873.937545:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000100:00100000:2.0:1782759873.937646:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233169920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759873.938713:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759873.938729:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233170048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759873.938842:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759873.938922:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170048 00000100:00100000:3.0:1782759873.938929:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170048 00000100:00100000:3.0:1782759873.938974:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:3.0:1782759873.938982:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233170048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759873.939001:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759873.939040:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233170048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759873.939048:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00000100:00100000:1.0:1782759873.939482:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233170048:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1782759873.994670:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759873.994679:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759873.994684:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759873.994734:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759873.994746:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759873.994757:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759873.994783:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233170176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759873.994851:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759873.994909:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e97480 going to sleep for 11 seconds 00000100:00100000:3.0:1782759873.994963:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170176 00000100:00100000:3.0:1782759873.994972:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170176 00000100:00100000:3.0:1782759873.995034:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3569 00000100:00100000:3.0:1782759873.995044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233170176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759873.995058:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759873.995072:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e394 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759873.995095:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759873.995105:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759873.995114:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6c00, rc 0) 00000100:00100000:3.0:1782759873.995162:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233170176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759873.995168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3569 00000100:00100000:1.0:1782759873.996369:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233170176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759873.996391:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759873.996401:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759873.996425:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759873.996431:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759873.996438:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759874.509082:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759874.783881:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759874.783927:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759874.783952:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759874.783985:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759874.784017:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218651904 00000100:00100000:3.0:1782759874.784028:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218651904 00000100:00100000:3.0:1782759874.784087:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218651776 00000100:00100000:3.0:1782759874.784090:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218651776 00000100:00100000:3.0:1782759874.784127:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5606 00000100:00100000:3.0:1782759874.784137:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218651904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759874.784216:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218651904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759874.784224:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5606 00000100:00100000:3.0:1782759874.784242:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5607 00000100:00100000:3.0:1782759874.784249:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218651776:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759874.784273:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218651776:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759874.784279:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5607 00000100:00100000:3.0:1782759874.784296:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218652032 00000100:00100000:3.0:1782759874.784300:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218652032 00000100:00100000:3.0:1782759874.784329:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3312 00000100:00100000:3.0:1782759874.784335:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218652032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759874.784360:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218652032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759874.784366:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3312 00000100:00080000:3.0:1782759874.784381:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759874.784386:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759874.784388:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759874.784552:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218651648 00000100:00100000:2.0:1782759874.784558:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218651648 00000100:00100000:2.0:1782759874.784616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3570 00000100:00100000:2.0:1782759874.784625:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218651648:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759874.784655:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218651648:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759874.784662:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3570 00000100:00100000:2.0:1782759874.954993:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759874.955017:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233170304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759874.955094:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759874.955152:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170304 00000100:00100000:2.0:1782759874.955158:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170304 00000100:00100000:2.0:1782759874.955226:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579 00000100:00100000:2.0:1782759874.955236:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233170304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759874.955271:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:2.0:1782759874.955315:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233170304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759874.955323:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579 00000100:00100000:2.0:1782759874.955369:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233170304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759874.955459:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759874.955469:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233170432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759874.955517:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759874.955555:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170432 00000100:00100000:1.0:1782759874.955560:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170432 00000100:00100000:1.0:1782759874.955617:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:1.0:1782759874.955625:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233170432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759874.955646:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759874.955684:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233170432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759874.955690:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00000100:00100000:1.0:1782759874.955722:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233170432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759874.956689:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233170560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759874.956731:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759874.956790:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170560 00000100:00100000:1.0:1782759874.956797:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170560 00000100:00100000:1.0:1782759874.956831:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:1.0:1782759874.956839:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233170560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759874.956857:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759874.956895:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233170560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759874.956901:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00000100:00100000:1.0:1782759874.956940:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233170560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759875.310387:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759875.310824:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218652160 00000100:00100000:0.0:1782759875.310836:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218652160 00000100:00100000:0.0:1782759875.310906:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3158 00000100:00100000:0.0:1782759875.310917:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:116765:x1869355218652160:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759875.310939:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759875.310974:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e3a2 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278d2 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311041:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311057:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311070:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311082:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311088:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311094:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311175:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311187:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311194:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759875.311238:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782759875.311242:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759875.311262:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311271:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311281:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311287:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311292:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311299:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311305:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759875.311309:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311316:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311332:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0ae00) 00010000:00010000:0.0:1782759875.311335:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759875.311339:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311346:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e3a9 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311361:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311367:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311374:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311380:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759875.311382:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311389:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311396:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cdecda0a700) 00010000:00010000:0.0:1782759875.311398:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759875.311400:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311405:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e3b0 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311439:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e3a2 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278d2 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311455:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278d2 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.311461:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:0.0:1782759875.311463:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759875.311466:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802200, rc 0) 00000100:00100000:0.0:1782759875.311544:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+6:116765:x1869355218652160:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 628us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759875.311552:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3158 00000100:00100000:3.0:1782759875.321163:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759875.322021:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218652416 00000100:00100000:2.0:1782759875.322039:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218652416 00000100:00100000:2.0:1782759875.322134:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3159 00000100:00100000:2.0:1782759875.322150:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+6:116765:x1869355218652416:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759875.322202:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759875.322233:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e3b7 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278d2 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.322259:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ab00) 00010000:00010000:2.0:1782759875.322273:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759875.322303:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,1 mode: --/PW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.322318:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.322328:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782759875.322630:0:12673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 88 off10792 00000004:00080000:2.0:1782759875.322642:0:12673:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3915599063926ns, next at 3916599061286ns, rc = 0 00000004:00010000:2.0:1782759875.322696:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8c57f50 reply state 00000000ececf640 transno 4294968049 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.322710:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.322718:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34ffe00) 00010000:00010000:2.0:1782759875.322720:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1782759875.322723:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782759875.322885:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+7:116765:x1869355218652416:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 740us (1735us total) trans 4294968049 rc 0/0 00000100:00100000:2.0:1782759875.322894:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3159 00000100:00100000:0.0:1782759875.352926:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759875.353193:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218652544 00000100:00100000:1.0:1782759875.353204:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218652544 00000100:00100000:1.0:1782759875.353268:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3160 00000100:00100000:1.0:1782759875.353279:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:116766:x1869355218652544:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759875.353304:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759875.353330:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e3c5 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278d9 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353404:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353419:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353430:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353444:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353450:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353456:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353522:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e3da lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353530:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e3da lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353536:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e3da lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759875.353558:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e3da lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353574:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353617:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353622:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353629:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353634:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759875.353639:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353646:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353658:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759875.353662:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759875.353667:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353673:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e3cc lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353687:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353692:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353697:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353701:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759875.353703:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353709:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353716:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc34f6100) 00010000:00010000:1.0:1782759875.353719:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759875.353721:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353726:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e3d3 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353755:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e3c5 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278d9 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353779:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e3da lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278d9 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.353786:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:1.0:1782759875.353790:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759875.353793:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413000, rc 0) 00000100:00100000:1.0:1782759875.353857:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc36fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+8:116766:x1869355218652544:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 580us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759875.353865:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3160 00000100:00100000:1.0:1782759875.363904:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759875.363978:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759875.364014:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218652672 00000100:00100000:1.0:1782759875.364025:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218652672 00000100:00100000:1.0:1782759875.364104:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3161 00000100:00100000:1.0:1782759875.364116:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:116766:x1869355218652672:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759875.364137:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759875.364160:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e3e1 lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278e0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.364219:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e3e8 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.364233:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e3e8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.364245:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e3e8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759875.364301:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759875.364305:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1782759875.364342:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e3e1 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278e0 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.364363:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e3e8 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278e0 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.364373:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6900) 00010000:00010000:1.0:1782759875.364375:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759875.364379:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759875.364440:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+6:116766:x1869355218652672:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 326us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759875.364448:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3161 00000100:00100000:2.0:1782759875.364825:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218652800 00000100:00100000:2.0:1782759875.364832:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218652800 00000100:00100000:2.0:1782759875.364890:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 423 00000100:00100000:2.0:1782759875.364901:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95b27dde-c150-4adf-930b-37620c52929b+8:2404:x1869355218652800:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759875.364912:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759875.364928:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e3da lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278d9 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.364942:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:2.0:1782759875.364950:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759875.364993:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95b27dde-c150-4adf-930b-37620c52929b+7:2404:x1869355218652800:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 95us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759875.364999:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 423 00000100:00100000:3.0:1782759875.373126:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759875.373614:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218653056 00000100:00100000:2.0:1782759875.373628:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218653056 00000100:00100000:2.0:1782759875.373712:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3162 00000100:00100000:2.0:1782759875.373726:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+6:116766:x1869355218653056:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:2.0:1782759875.373777:0:6532:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759875.373804:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e3e8 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278e0 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.373820:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6900) 00010000:00010000:2.0:1782759875.373830:0:6532:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759875.373857:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,1 mode: --/PW res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.373871:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.373881:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759875.374099:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005faacfcb reply state 00000000474b9e71 transno 4294967796 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.374112:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759875.374119:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ffc00) 00010000:00010000:2.0:1782759875.374121:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1782759875.374124:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759875.374131:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1782759875.374209:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:116766:x1869355218653056:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 487us (1098us total) trans 4294967796 rc 0/0 00000100:00100000:2.0:1782759875.374216:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3162 00000100:00100000:0.0:1782759875.387168:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759875.387317:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218653312 00000100:00100000:3.0:1782759875.387335:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218653312 00000100:00100000:3.0:1782759875.387809:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3163 00000100:00100000:3.0:1782759875.387828:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:116766:x1869355218653312:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759875.387858:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759875.387891:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e3f6 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278e7 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.387997:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388014:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388029:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388048:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388055:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388064:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388139:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e40b lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388147:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e40b lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388167:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e40b lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388185:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388382:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388391:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388398:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388406:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759875.388412:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388544:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388563:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdee7e02d00) 00010000:00010000:3.0:1782759875.388567:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759875.388573:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388621:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e3fd lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388757:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388763:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388769:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388775:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759875.388778:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388784:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388792:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cdee7e02c00) 00010000:00010000:3.0:1782759875.388794:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759875.388797:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388856:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e404 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388905:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e3f6 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278e7 expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388923:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e40b lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278e7 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.388929:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdee7e02600) 00010000:00010000:3.0:1782759875.388931:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759875.388934:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7600, rc 0) 00000100:00100000:3.0:1782759875.389025:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+8:116766:x1869355218653312:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1202us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759875.389039:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3163 00000100:00100000:1.0:1782759875.402476:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759875.402620:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759875.402659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218653568 00000100:00100000:1.0:1782759875.402671:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218653568 00000100:00100000:1.0:1782759875.402731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 424 00000100:00100000:1.0:1782759875.402742:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95b27dde-c150-4adf-930b-37620c52929b+8:2405:x1869355218653568:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759875.402772:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759875.402798:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e40b lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278e7 expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.402815:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdee7e02600) 00010000:00010000:1.0:1782759875.402826:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759875.402879:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218653568:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 139us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759875.402887:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 424 00000100:00100000:1.0:1782759875.402910:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218653696 00000100:00100000:1.0:1782759875.402914:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218653696 00000100:00100000:1.0:1782759875.402940:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3164 00000100:00100000:1.0:1782759875.402946:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:116766:x1869355218653696:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759875.402968:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759875.402985:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e412 lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278ee expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759875.403102:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782759875.403217:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e412 lrc: 1/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278ee expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.403227:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ffc00) 00010000:00010000:1.0:1782759875.403229:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759875.403234:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e412 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278ee expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759875.403243:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413600, rc 0) 00000100:00100000:1.0:1782759875.403266:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:116766:x1869355218653696:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 320us (647us total) trans 4294967797 rc 301/301 00000100:00100000:1.0:1782759875.403272:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3164 00000100:00100000:3.0:1782759875.409551:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759875.409628:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218653952 00000100:00100000:3.0:1782759875.409638:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218653952 00000100:00100000:3.0:1782759875.409691:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 468 00000100:00100000:3.0:1782759875.409701:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+8:116766:x1869355218653952:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759875.409928:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+9:116766:x1869355218653952:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 227us (386us total) trans 4294967798 rc 0/0 00000100:00100000:3.0:1782759875.409937:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 468 00000100:00100000:1.0:1782759875.418319:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759875.418404:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654080 00000100:00100000:0.0:1782759875.418550:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654080 00000100:00100000:0.0:1782759875.418822:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3165 00000100:00100000:0.0:1782759875.418837:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+9:116766:x1869355218654080:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759875.418873:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759875.419383:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e420 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278f5 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.419789:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e427 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.419861:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e427 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.419882:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e427 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759875.419944:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759875.419950:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759875.419977:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e427 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.420014:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e420 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278f5 expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.420044:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e427 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278f5 expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759875.420056:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ffc00) 00010000:00010000:0.0:1782759875.420059:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759875.420064:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802800, rc 0) 00000100:00100000:0.0:1782759875.420159:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+10:116766:x1869355218654080:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1325us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759875.420168:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3165 00000100:00100000:1.0:1782759875.425196:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759875.425293:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654208 00000100:00100000:3.0:1782759875.425306:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654208 00000100:00100000:3.0:1782759875.425375:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 469 00000100:00100000:3.0:1782759875.425390:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+10:116766:x1869355218654208:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:3.0:1782759875.439389:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+10:116766:x1869355218654208:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 13991us (14193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759875.439407:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 469 00000100:00100000:0.0:1782759875.497979:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759875.498131:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654336 00000100:00100000:3.0:1782759875.498144:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654336 00000100:00100000:3.0:1782759875.498240:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3166 00000100:00100000:3.0:1782759875.498253:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:116768:x1869355218654336:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759875.498281:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759875.498315:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e42e lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb278fc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498402:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498421:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498745:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498764:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498772:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498778:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498897:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498906:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.498912:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759875.498977:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759875.498983:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759875.499010:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499021:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499037:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499043:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499050:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499058:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499064:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759875.499069:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499078:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499091:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdee7e02d00) 00010000:00010000:3.0:1782759875.499094:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759875.499099:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499106:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e435 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499123:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499128:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499135:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499140:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759875.499143:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499148:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499155:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cdee7e02c00) 00010000:00010000:3.0:1782759875.499157:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759875.499160:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499165:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e43c lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499515:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e42e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278fc expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499535:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278fc expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759875.499543:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34ffe00) 00010000:00010000:3.0:1782759875.499545:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759875.499548:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759875.499845:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+8:116768:x1869355218654336:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1593us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759875.499859:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3166 00010000:00010000:3.0:1782759875.531841:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759876.559438:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759877.296826:0:163663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffff4aae2c0 20000000:00000080:3.0:1782759877.296851:0:163663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4a12000 uarg=0000000000000000 00010000:00010000:3.0:1782759877.298286:0:163663:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759877.298341:0:163663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34ffe00) 00010000:00010000:3.0:1782759877.298346:0:163663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759877.298362:0:163663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e443 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278fc expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.298381:0:163663:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782759877.298410:0:163663:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759877.298433:0:163663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ffc00) 00010000:00010000:3.0:1782759877.298436:0:163663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759877.298440:0:163663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e427 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb278f5 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.298452:0:163663:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1782759877.298511:0:163663:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759877.298529:0:163663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.298544:0:163663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.298553:0:163663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.299175:0:163663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.299193:0:163663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 23 pid: 6524 timeout: 4067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759877.299211:0:163663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3bd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163663:1869355233170688:0@lo:104: 00000100:00100000:3.0:1782759877.299299:0:163663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759877.299410:0:163663:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3513900 going to sleep for 11 seconds 00000100:00100000:1.0:1782759877.299937:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170688 00000100:00100000:1.0:1782759877.299949:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170688 00000100:00100000:1.0:1782759877.300054:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1782759877.300066:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:163663:x1869355233170688:12345-0@lo:104: 00010000:00010000:1.0:1782759877.300083:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759877.300207:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759877.300215:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:163663:x1869355233170688:12345-0@lo:104: Request processed in 151us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759877.300224:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:3.0:1782759877.300288:0:163663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3bd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163663:1869355233170688:0@lo:104: 00010000:00010000:3.0:1782759877.300314:0:163663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.300493:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759877.300502:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.300509:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759877.300514:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.300528:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759877.300536:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759877.300541:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759877.300740:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.300747:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782759877.300798:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1782759877.300843:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.300852:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e394 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e39b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.300870:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759877.300872:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759877.300874:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759877.301022:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233170816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759877.301140:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759877.301239:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170816 00000100:00100000:0.0:1782759877.301245:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170816 00010000:00010000:0.0:1782759877.301273:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 24 pid: 6524 timeout: 4067 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759877.301337:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1782759877.301346:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233170816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759877.301361:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759877.301366:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 24 pid: 6524 timeout: 4067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301380:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 24 pid: 6524 timeout: 4067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301398:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e39b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e394 expref: 24 pid: 6524 timeout: 4067 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301415:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301424:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301442:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301449:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301456:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301462:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301468:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759877.301472:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.301489:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.301871:0:163663:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759877.301880:0:163663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.309310:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.309339:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e44a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759877.309367:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759877.309908:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233170816:12345-0@lo:103:ldlm_bl.0 Request processed in 8556us (8761us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759877.309921:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1782759877.310022:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233170816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759877.519200:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759877.519232:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233170944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759877.519326:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759877.519415:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233170944 00000100:00100000:2.0:1782759877.519425:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233170944 00000100:00100000:2.0:1782759877.519526:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3580 00000100:00100000:2.0:1782759877.519539:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233170944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759877.519603:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759877.519663:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233170944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759877.519671:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3580 00000100:00100000:2.0:1782759877.519727:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233170944:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759877.585456:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759878.496351:0:163712:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbee35570 20000000:00000080:2.0:1782759878.496381:0:163712:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc7309800 uarg=0000000000000000 00010000:00010000:2.0:1782759878.497158:0:163712:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759878.497179:0:163712:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759878.497200:0:163712:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759878.497212:0:163712:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759878.497237:0:163712:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759878.497265:0:163712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497285:0:163712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497297:0:163712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497304:0:163712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497311:0:163712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497320:0:163712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497326:0:163712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759878.497331:0:163712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497339:0:163712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497360:0:163712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497368:0:163712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.497375:0:163712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e451 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759878.544280:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233171200:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544379:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544458:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233171712:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544493:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544511:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233172224:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544534:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544563:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1782759878.544569:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233171072:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544632:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544658:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233171584:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544687:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544708:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233172096:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544734:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544754:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233172608:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544778:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544808:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233171328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544835:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544854:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233171840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544875:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.544893:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc736aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233172352:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.544917:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.545192:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759878.545200:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233171456:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.545225:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.545244:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233171968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.545267:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.545282:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233172480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.545303:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759878.545340:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171200 00000100:00100000:1.0:1782759878.545349:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171200 00000100:00100000:0.0:1782759878.545545:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172096 00000100:00100000:0.0:1782759878.545550:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172096 00000100:00100000:0.0:1782759878.545623:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172608 00000100:00100000:0.0:1782759878.545626:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172608 00000100:00100000:0.0:1782759878.545642:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171968 00000100:00100000:0.0:1782759878.545645:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171968 00000100:00100000:0.0:1782759878.545675:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172480 00000100:00100000:0.0:1782759878.545678:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172480 00000100:00100000:0.0:1782759878.545698:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3313 00000100:00100000:0.0:1782759878.545708:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233172096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.545784:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233172096:12345-0@lo:400:kworker.0 Request processed in 77us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.545792:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3313 00000100:00100000:0.0:1782759878.545810:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3314 00000100:00100000:0.0:1782759878.545816:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233172608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.545840:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233172608:12345-0@lo:400:kworker.0 Request processed in 24us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.545845:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3314 00000100:00100000:0.0:1782759878.545856:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3315 00000100:00100000:0.0:1782759878.545861:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233171968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.545892:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233171968:12345-0@lo:400:kworker.0 Request processed in 30us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.545898:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3315 00000100:00100000:0.0:1782759878.545907:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3316 00000100:00100000:0.0:1782759878.545914:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233172480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.545953:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233172480:12345-0@lo:400:kworker.0 Request processed in 40us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.545959:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3316 00000100:00080000:0.0:1782759878.545977:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759878.545981:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759878.546025:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233172096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.546484:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233172608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.546568:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171584 00000100:00100000:0.0:1782759878.546662:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171584 00000100:00100000:0.0:1782759878.546727:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171328 00000100:00100000:0.0:1782759878.546731:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171328 00000100:00100000:0.0:1782759878.546746:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1782759878.546753:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233171584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.546815:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233171584:12345-0@lo:400:kworker.0 Request processed in 62us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.546821:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581 00000100:00100000:0.0:1782759878.546833:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582 00000100:00100000:0.0:1782759878.546839:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233171328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.546867:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233171328:12345-0@lo:400:kworker.0 Request processed in 29us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.546873:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:0.0:1782759878.546902:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171072 00000100:00100000:0.0:1782759878.546906:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171072 00000100:00100000:1.0:1782759878.547709:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171712 00000100:00100000:1.0:1782759878.547720:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171712 00000100:00100000:1.0:1782759878.547773:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172224 00000100:00100000:1.0:1782759878.547776:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172224 00000100:00100000:1.0:1782759878.547796:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171840 00000100:00100000:1.0:1782759878.547799:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171840 00000100:00100000:1.0:1782759878.547816:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172352 00000100:00100000:1.0:1782759878.547818:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172352 00000100:00100000:1.0:1782759878.547833:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233171456 00000100:00100000:1.0:1782759878.547836:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233171456 00000100:00100000:1.0:1782759878.547852:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5608 00000100:00100000:1.0:1782759878.547861:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233171200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.548032:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3571 00000100:00100000:0.0:1782759878.548489:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233171072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.550712:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233171200:12345-0@lo:400:kworker.0 Request processed in 2843us (6325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759878.550729:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5608 00000100:00100000:1.0:1782759878.550772:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5609 00000100:00100000:1.0:1782759878.550786:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233171712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.550823:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233171712:12345-0@lo:400:kworker.0 Request processed in 43us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759878.550830:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5609 00000100:00100000:1.0:1782759878.550843:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5610 00000100:00100000:1.0:1782759878.550851:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233172224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.550896:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233172224:12345-0@lo:400:kworker.0 Request processed in 47us (6361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759878.550903:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5610 00000100:00100000:1.0:1782759878.550916:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5611 00000100:00100000:1.0:1782759878.550923:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233171840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.551174:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233171072:12345-0@lo:400:kworker.0 Request processed in 537us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.551186:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3571 00000100:00100000:0.0:1782759878.551247:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5612 00000100:00100000:0.0:1782759878.551258:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233172352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.551298:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233172352:12345-0@lo:400:kworker.0 Request processed in 43us (6380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.551304:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5612 00000100:00100000:0.0:1782759878.551320:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5613 00000100:00100000:0.0:1782759878.551327:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233171456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.551357:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233171456:12345-0@lo:400:kworker.0 Request processed in 31us (6131us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759878.551362:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5613 00000001:00080000:2.0:1782759878.552343:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967798 is committed 00000020:00080000:2.0:1782759878.552370:0:7461:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0001: 36 batchid updated 00000100:00100000:0.0:1782759878.552713:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233171072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.552738:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233171584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.552753:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233171200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.552766:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233171712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.552780:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233172224:0@lo:400:kworker.0 00010000:00010000:2.0:1782759878.553155:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.553170:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 2/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.553180:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.553187:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759878.553192:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.553201:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 4/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.553224:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ffc00) 00010000:00010000:2.0:1782759878.553228:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759878.553234:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 2/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.553242:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e3ef lrc: 0/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1782759878.553280:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 36 00000004:00080000:2.0:1782759878.553362:0:7484:0:(osp_trans.c:1591:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8cddc20719c0 with version 75 00000020:00080000:2.0:1782759878.553376:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 36 cancel update log [0x200000401:0x2:0x0].37: rc = 0 00000100:00100000:1.0:1782759878.553566:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ae0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233171840:12345-0@lo:400:kworker.0 Request processed in 2640us (8685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759878.557800:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5611 00000100:00080000:1.0:1782759878.557886:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759878.557893:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1782759878.558126:0:7476:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8cdec77ec6c0 version 75 rpc_version 75 00000020:00100000:0.0:1782759878.558187:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1782759878.558200:0:7476:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8cdedf90a300 x1869355233172864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782759878.558233:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233172864:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759878.558527:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759878.558569:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78000 going to sleep for 11 seconds 00000020:00080000:2.0:1782759878.558844:0:7484:0:(update_trans.c:1303:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 36 cancel update log [0x240000400:0x2:0x0].37: rc = 0 00000020:00080000:2.0:1782759878.558859:0:7484:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 36 00000100:00100000:1.0:1782759878.559004:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233171456:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.559033:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233171968:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.559328:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233172480:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.559343:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233171328:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.559357:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233171840:0@lo:400:kworker.0 00000100:00100000:1.0:1782759878.559370:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc736aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233172352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759878.559523:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172864 00000100:00100000:0.0:1782759878.559532:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172864 00000100:00100000:0.0:1782759878.560012:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3583 00000100:00100000:0.0:1782759878.560028:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:7476:x1869355233172864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1782759878.560356:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7476:x1869355233172864:12345-0@lo:1000:osp_up0-1.0 Request processed in 332us (1830us total) trans 4294968050 rc 0/0 00000100:00100000:0.0:1782759878.560365:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3583 00000100:00100000:1.0:1782759878.565319:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf90a300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7476:1869355233172864:0@lo:1000:osp_up0-1.0 10000000:01000000:2.0:1782759878.602667:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759878.602677:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759878.602685:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759878.602753:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.602767:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759878.602780:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759878.602817:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233172992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759878.602917:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759878.602992:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79bb40 going to sleep for 11 seconds 00010000:00010000:1.0:1782759878.603808:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759878.604451:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233172992 00000100:00100000:3.0:1782759878.604466:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233172992 00000100:00100000:3.0:1782759878.604549:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1782759878.604562:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233172992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759878.604603:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759878.604627:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e458 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.604660:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.604673:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.604685:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7e00, rc 0) 00000100:00100000:3.0:1782759878.604774:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233172992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759878.604783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3572 00000100:00100000:3.0:1782759878.604852:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233172992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759878.604871:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.604881:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759878.604906:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759878.604912:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759878.604920:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759879.051025:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759879.051059:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233173120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759879.051170:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759879.051258:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173120 00000100:00100000:1.0:1782759879.051269:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173120 00000100:00100000:1.0:1782759879.051329:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1782759879.051339:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233173120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759879.051378:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759879.051709:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233173248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759879.051754:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759879.051963:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7217b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233173120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 623us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759879.051972:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:1.0:1782759879.051992:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173248 00000100:00100000:1.0:1782759879.051997:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173248 00000100:00100000:1.0:1782759879.052022:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1782759879.052029:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc736aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233173248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759879.052042:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759879.052072:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc736aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233173248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759879.052078:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00000100:00100000:1.0:1782759879.052141:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233173248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759879.052176:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233173120:0@lo:13:osp-pre-1-1.0 00000020:00000080:0.0:1782759879.569347:0:163760:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe750d9f10 20000000:00000080:0.0:1782759879.569371:0:163760:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf965c00 uarg=0000000000000000 00010000:00010000:0.0:1782759879.571012:0:163760:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759879.571040:0:163760:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759879.571064:0:163760:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759879.571078:0:163760:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759879.571103:0:163760:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759879.571128:0:163760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.571149:0:163760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.571161:0:163760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.571213:0:163760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.571231:0:163760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 23 pid: 6524 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759879.571250:0:163760:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163760:1869355233173376:0@lo:104: 00000100:00100000:0.0:1782759879.571335:0:163760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759879.572009:0:163760:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cded38c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759879.572072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173376 00000100:00100000:2.0:1782759879.572081:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173376 00000100:00100000:2.0:1782759879.572197:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1782759879.572211:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:163760:x1869355233173376:12345-0@lo:104: 00010000:00010000:2.0:1782759879.572230:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759879.572327:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759879.572334:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:163760:x1869355233173376:12345-0@lo:104: Request processed in 127us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759879.572342:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00010000:00010000:3.0:1782759879.572415:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759879.572425:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572434:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759879.572439:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572449:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759879.572457:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759879.572473:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759879.572518:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572526:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759879.572550:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572558:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648600/0xd5b45c7f5c60e458 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e45f expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572603:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759879.572605:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759879.572607:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759879.572636:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233173504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759879.572684:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759879.572730:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173504 00000100:00100000:3.0:1782759879.572735:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173504 00010000:00010000:3.0:1782759879.572760:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 24 pid: 6524 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759879.572784:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1782759879.572792:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233173504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759879.572805:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759879.572811:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 24 pid: 6524 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572822:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 24 pid: 6524 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572844:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572855:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572873:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572881:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572888:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572895:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572900:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759879.572906:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572914:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572923:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759879.572934:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759879.572962:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233173504:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759879.572969:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1782759879.573044:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cded3b87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233173504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759879.573162:0:163760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e45f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e458 expref: 23 pid: 6524 timeout: 4069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759879.573173:0:163760:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:163760:1869355233173376:0@lo:104: 00010000:00010000:0.0:1782759879.573190:0:163760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.573201:0:163760:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.573208:0:163760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759879.573215:0:163760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e466 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759879.631551:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759879.906716:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759879.906773:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759879.906818:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759879.906918:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759879.907056:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654592 00000100:00100000:0.0:1782759879.907071:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654592 00000100:00100000:0.0:1782759879.907163:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654720 00000100:00100000:0.0:1782759879.907166:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654720 00000100:00100000:0.0:1782759879.907198:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5614 00000100:00100000:0.0:1782759879.907209:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2403:x1869355218654592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759879.907320:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3b87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2403:x1869355218654592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 112us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759879.907328:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5614 00000100:00100000:0.0:1782759879.907347:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5615 00000100:00100000:0.0:1782759879.907354:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218654720:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759879.907384:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218654720:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759879.907390:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5615 00000100:00100000:0.0:1782759879.907413:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654848 00000100:00100000:0.0:1782759879.907416:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654848 00000100:00100000:0.0:1782759879.907450:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3317 00000100:00100000:0.0:1782759879.907456:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218654848:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759879.907495:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218654848:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759879.907501:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3317 00000100:00100000:2.0:1782759879.907611:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654464 00000100:00100000:2.0:1782759879.907621:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654464 00000100:00080000:3.0:1782759879.907646:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759879.907652:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759879.907654:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759879.907671:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3573 00000100:00100000:2.0:1782759879.907679:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218654464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759879.907724:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218654464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 46us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759879.907731:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3573 00000004:00080000:1.0:1782759880.076092:0:8598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3920352509883ns, next at 3921352505763ns, rc = 0 00000100:00100000:1.0:1782759880.076155:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233173632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759880.076255:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759880.076358:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173632 00000100:00100000:1.0:1782759880.076367:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173632 00000100:00100000:1.0:1782759880.076452:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:0.0:1782759880.076644:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233173760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759880.076688:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759880.076725:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173760 00000100:00100000:0.0:1782759880.076729:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173760 00000100:00100000:0.0:1782759880.076778:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:0.0:1782759880.076802:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233173760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759880.076849:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759880.076904:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233173760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759880.076911:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:0.0:1782759880.076971:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233173760:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1782759880.077028:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759880.077293:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759880.077306:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233173888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759880.077343:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759880.077383:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233173888 00000100:00100000:2.0:1782759880.077387:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233173888 00000100:00080000:0.0:1782759880.077474:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759880.078540:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233173632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759880.078597:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759880.078677:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233173632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2423us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759880.078801:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233173632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759880.084890:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:2.0:1782759880.084932:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233173888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759880.084973:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759880.085089:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233173888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 183us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759880.085098:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00000100:00100000:2.0:1782759880.085180:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233173888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759880.090725:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00000004:00080000:2.0:1782759880.589096:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 109 committed 00000001:00080000:2.0:1782759880.589142:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968050 is committed 00000001:00080000:2.0:1782759880.589181:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968049 is committed 00000004:00080000:2.0:1782759880.589187:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 108 committed 00000100:00100000:0.0:1782759880.589357:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759880.589460:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233174016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782759880.589561:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759880.589673:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174016 00000100:00100000:0.0:1782759880.589682:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174016 00000100:00100000:0.0:1782759880.589753:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1782759880.589763:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233174016:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1782759880.590060:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759880.590075:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759880.590084:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759880.590091:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759880.590098:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759880.590108:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759880.590128:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34ffe00) 00010000:00010000:3.0:1782759880.590131:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759880.590136:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759880.590143:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e3be lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782759880.592220:0:8600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759880.592232:0:8600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1782759867 -> 1782759867 00002000:00010000:0.0:1782759880.592235:0:8600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1782759867 -> 1782759867 00002000:00010000:0.0:1782759880.592237:0:8600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1782759867 -> 1782759867 00002000:00010000:0.0:1782759880.592239:0:8600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782759880.592353:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233174016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2585us (2786us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1782759880.592366:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000004:00080000:0.0:1782759880.592472:0:3664:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddcc3dca80/2, rc 0, transno 4294967452 00000100:00100000:0.0:1782759880.592479:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233174016:0@lo:2:osp-syn-0-0.0 00000020:00000080:2.0:1782759880.612041:0:163808:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc70ea9c10 20000000:00000080:2.0:1782759880.612070:0:163808:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf62f400 uarg=0000000000000000 00010000:00010000:2.0:1782759880.612500:0:163808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759880.612524:0:163808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759880.612555:0:163808:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759880.612570:0:163808:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759880.612621:0:163808:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759880.612648:0:163808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612665:0:163808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612675:0:163808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612681:0:163808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612686:0:163808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612691:0:163808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612695:0:163808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759880.612699:0:163808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612709:0:163808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612720:0:163808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612725:0:163808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759880.612730:0:163808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648000/0xd5b45c7f5c60e46d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 163808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759880.652045:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759881.291514:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759881.291521:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759881.291526:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759881.291569:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.291599:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.291610:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759881.291634:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233174144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759881.291701:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759881.291742:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759881.291765:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174144 00000100:00100000:3.0:1782759881.291772:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174144 00000100:00100000:3.0:1782759881.291816:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3574 00000100:00100000:3.0:1782759881.291823:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233174144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759881.291836:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759881.291849:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e474 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.291871:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.291881:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.291890:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7400, rc 0) 00000100:00100000:3.0:1782759881.291922:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233174144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759881.291928:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3574 00000100:00100000:3.0:1782759881.291976:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233174144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759881.291989:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.291996:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759881.292012:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759881.292016:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759881.292023:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759881.685252:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759882.637058:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759882.637088:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233174272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759882.637183:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759882.637298:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174272 00000100:00100000:2.0:1782759882.637308:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174272 00000100:00100000:2.0:1782759882.637409:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:2.0:1782759882.637419:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233174272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759882.637482:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759882.637544:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233174272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759882.637551:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:2.0:1782759882.637619:0:3663:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294968050 gen 2 00000004:00080000:2.0:1782759882.637626:0:3663:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968050 committed transno 4294968050 00000100:00100000:2.0:1782759882.637669:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233174272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759882.700355:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759883.658802:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233174400:0@lo:400:kworker.0 00000100:00100000:2.0:1782759883.658884:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759883.665296:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233174784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.665382:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759883.665729:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233174528:0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.665772:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759883.665796:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759883.665802:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233174656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.665828:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759883.665862:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174784 00000100:00100000:1.0:1782759883.665871:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174784 00000100:00100000:1.0:1782759883.665923:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174528 00000100:00100000:1.0:1782759883.665927:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174528 00000100:00100000:1.0:1782759883.665949:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5616 00000100:00100000:1.0:1782759883.665959:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233174784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.666015:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233174784:12345-0@lo:400:kworker.0 Request processed in 56us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759883.666022:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5616 00000100:00100000:1.0:1782759883.666039:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5617 00000100:00100000:1.0:1782759883.666045:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233174528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.666090:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233174528:12345-0@lo:400:kworker.0 Request processed in 45us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759883.666096:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5617 00000100:00100000:1.0:1782759883.666132:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233174784:0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.666161:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233174528:0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.667415:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174656 00000100:00100000:0.0:1782759883.667437:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174656 00000100:00100000:0.0:1782759883.667528:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3586 00000100:00100000:0.0:1782759883.667538:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233174656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.667645:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233174656:12345-0@lo:400:kworker.0 Request processed in 108us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759883.667653:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3586 00000100:00100000:0.0:1782759883.667704:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233174656:0@lo:400:kworker.0 00000100:00100000:1.0:1782759883.669780:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174400 00000100:00100000:1.0:1782759883.669793:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174400 00000100:00100000:1.0:1782759883.669951:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3575 00000100:00100000:1.0:1782759883.669961:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233174400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.670307:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759883.670319:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233174912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.670359:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759883.670396:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233174912 00000100:00100000:3.0:1782759883.670399:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233174912 00000100:00100000:3.0:1782759883.670481:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3587 00000100:00100000:3.0:1782759883.670488:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233174912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.670534:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233174912:12345-0@lo:400:kworker.0 Request processed in 47us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759883.670542:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3587 00000100:00100000:3.0:1782759883.670574:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233174912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.670620:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759883.670628:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233175040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.670655:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759883.670692:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233175168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.670711:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759883.670974:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175040 00000100:00100000:0.0:1782759883.670979:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175040 00000100:00100000:0.0:1782759883.671013:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175168 00000100:00100000:0.0:1782759883.671016:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175168 00000100:00100000:0.0:1782759883.671035:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5618 00000100:00100000:0.0:1782759883.671042:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233175040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.671150:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233175040:12345-0@lo:400:kworker.0 Request processed in 108us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759883.671157:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5618 00000100:00100000:0.0:1782759883.671169:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5619 00000100:00100000:0.0:1782759883.671175:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233175168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.671197:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233175168:12345-0@lo:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759883.671202:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5619 00000100:00080000:0.0:1782759883.671219:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759883.671223:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759883.671241:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233175168:0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.671250:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233175040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.674874:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233175296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.674963:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759883.675035:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175296 00000100:00100000:3.0:1782759883.675043:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175296 00000100:00100000:3.0:1782759883.675113:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3318 00000100:00100000:3.0:1782759883.675123:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233175296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.675177:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233175296:12345-0@lo:400:kworker.0 Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759883.675188:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3318 00000100:00080000:3.0:1782759883.675206:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759883.675237:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233175296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.675294:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759883.675302:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233175424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.675326:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759883.675351:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175424 00000100:00100000:3.0:1782759883.675354:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175424 00000100:00100000:3.0:1782759883.675383:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3319 00000100:00100000:3.0:1782759883.675389:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233175424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.675421:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233175424:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759883.675437:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3319 00000100:00080000:3.0:1782759883.675451:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759883.675593:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233174400:12345-0@lo:400:kworker.0 Request processed in 5632us (16708us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759883.675616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3575 00000100:00100000:3.0:1782759883.676621:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233175424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.676701:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233175808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.676959:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759883.677006:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175808 00000100:00100000:3.0:1782759883.677013:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175808 00000100:00100000:0.0:1782759883.677371:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233175552:0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.677407:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759883.677438:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759883.677445:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233175680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.677873:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3320 00000100:00100000:3.0:1782759883.677887:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233175808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.677945:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233175808:12345-0@lo:400:kworker.0 Request processed in 63us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759883.677952:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3320 00000100:00080000:3.0:1782759883.677976:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759883.678005:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233175808:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.678045:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759883.678051:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233175936:0@lo:400:kworker.0 00000100:00100000:2.0:1782759883.678209:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233174400:0@lo:400:kworker.0 00000100:00100000:3.0:1782759883.678693:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759883.678883:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759883.678928:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175552 00000100:00100000:0.0:1782759883.678934:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175552 00000100:00100000:0.0:1782759883.678973:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175680 00000100:00100000:0.0:1782759883.678976:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175680 00000100:00100000:0.0:1782759883.678993:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5620 00000100:00100000:0.0:1782759883.678999:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233175552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.679037:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233175552:12345-0@lo:400:kworker.0 Request processed in 38us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759883.679044:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5620 00000100:00100000:0.0:1782759883.679653:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5621 00000100:00100000:0.0:1782759883.679667:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233175680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.679703:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233175680:12345-0@lo:400:kworker.0 Request processed in 42us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759883.679760:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233175936 00000100:00100000:2.0:1782759883.679765:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233175936 00000100:00100000:2.0:1782759883.679804:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3321 00000100:00100000:2.0:1782759883.679812:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233175936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759883.679850:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233175936:12345-0@lo:400:kworker.0 Request processed in 40us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759883.679856:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3321 00000100:00080000:2.0:1782759883.681592:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759883.681602:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759883.681605:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759883.681854:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233175936:0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.685034:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5621 00000100:00100000:0.0:1782759883.685132:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233175680:0@lo:400:kworker.0 00000100:00100000:0.0:1782759883.685146:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233175552:0@lo:400:kworker.0 00010000:00010000:1.0:1782759883.722827:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759884.172922:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233176064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759884.173011:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759884.173695:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176064 00000100:00100000:1.0:1782759884.173705:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176064 00000100:00100000:1.0:1782759884.173758:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1782759884.173768:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233176064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759884.173950:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759884.174013:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233176064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 246us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759884.174021:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000100:00100000:1.0:1782759884.174073:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233176064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759884.188715:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233176192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759884.189307:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759884.189440:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176192 00000100:00100000:1.0:1782759884.189451:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176192 00000100:00100000:1.0:1782759884.189506:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:1.0:1782759884.189516:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233176192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759884.189549:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759884.189619:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233176192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759884.189626:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000100:00100000:0.0:1782759884.190120:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233176192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759884.746792:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759885.029295:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759885.029330:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759885.029362:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759885.029396:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759885.029431:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218654976 00000100:00100000:1.0:1782759885.029441:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218654976 00000100:00100000:1.0:1782759885.029493:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3576 00000100:00100000:1.0:1782759885.029514:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218654976:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759885.029611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218654976:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759885.029619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3576 00000100:00100000:0.0:1782759885.029797:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655104 00000100:00100000:0.0:1782759885.029802:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655104 00000100:00100000:0.0:1782759885.029850:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655232 00000100:00100000:0.0:1782759885.029853:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655232 00000100:00100000:0.0:1782759885.029875:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5622 00000100:00100000:0.0:1782759885.029882:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655104:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759885.029923:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc52c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655104:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 41us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759885.029931:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5622 00000100:00100000:0.0:1782759885.029945:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5623 00000100:00100000:0.0:1782759885.029952:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655232:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759885.029976:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655232:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759885.029983:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5623 00000100:00080000:1.0:1782759885.030299:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759885.030304:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759885.042877:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655360 00000100:00100000:3.0:1782759885.042892:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655360 00000100:00100000:3.0:1782759885.043105:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3322 00000100:00100000:3.0:1782759885.043116:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218655360:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759885.043194:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218655360:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (13863us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759885.043202:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3322 00000100:00080000:2.0:1782759885.049377:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759885.195324:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233176320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759885.195408:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759885.195512:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176320 00000100:00100000:1.0:1782759885.195519:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176320 00000100:00100000:1.0:1782759885.195609:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:1.0:1782759885.195619:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233176320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759885.195656:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759885.195703:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233176320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759885.195710:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00000100:00100000:1.0:1782759885.195819:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233176320:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782759885.195883:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759885.196126:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759885.196136:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233176448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759885.196172:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759885.196256:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176448 00000100:00100000:3.0:1782759885.196262:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176448 00000100:00100000:3.0:1782759885.196316:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588 00000100:00100000:3.0:1782759885.196323:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233176448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759885.196358:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:3.0:1782759885.196410:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233176448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759885.196425:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588 00000100:00100000:0.0:1782759885.196708:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233176448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759885.199151:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759885.199170:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233176576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759885.199240:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759885.199326:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176576 00000100:00100000:1.0:1782759885.199346:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176576 00000100:00100000:1.0:1782759885.199412:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1782759885.199431:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233176576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759885.199455:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759885.199498:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233176576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759885.199505:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00000100:00080000:0.0:1782759885.199633:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759885.199669:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233176576:0@lo:13:osp-pre-0-1.0 00000020:00000080:1.0:1782759885.510525:0:164004:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd14407920 20000000:00000080:1.0:1782759885.510547:0:164004:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcb9ca000 uarg=0000000000000000 10000000:01000000:1.0:1782759885.510758:0:164004:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759885.510781:0:164004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.510799:0:164004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.510809:0:164004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.510853:0:164004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.510868:0:164004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 23 pid: 6525 timeout: 4075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759885.510883:0:164004:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164004:1869355233176704:0@lo:104: 00000100:00100000:1.0:1782759885.510955:0:164004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759885.511004:0:164004:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4e363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759885.512447:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176704 00000100:00100000:0.0:1782759885.512461:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176704 00000100:00100000:0.0:1782759885.512519:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1782759885.512529:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:164004:x1869355233176704:12345-0@lo:104: 00010000:00010000:0.0:1782759885.512545:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.512658:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759885.512664:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:164004:x1869355233176704:12345-0@lo:104: Request processed in 138us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759885.512672:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00010000:00010000:0.0:1782759885.512695:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759885.512700:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.512708:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759885.512712:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.512721:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759885.512728:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759885.512733:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759885.512767:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.512777:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759885.512804:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.512812:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a6400/0xd5b45c7f5c60e474 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e47b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.512830:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759885.512832:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759885.512834:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759885.512857:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233176832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759885.512893:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759885.512934:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176832 00000100:00100000:0.0:1782759885.512938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176832 00010000:00010000:0.0:1782759885.512956:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 24 pid: 6525 timeout: 4075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759885.512977:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1782759885.512984:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233176832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759885.512994:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759885.512999:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 24 pid: 6525 timeout: 4075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513008:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 24 pid: 6525 timeout: 4075 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513025:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513037:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513051:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513058:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513066:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513072:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513077:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759885.513081:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513088:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513097:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759885.513106:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759885.513135:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233176832:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759885.513141:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1782759885.513180:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233176832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759885.513298:0:164004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e47b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e474 expref: 23 pid: 6525 timeout: 4075 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759885.513322:0:164004:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164004:1869355233176704:0@lo:104: 00010000:00010000:3.0:1782759885.513337:0:164004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.513351:0:164004:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.513358:0:164004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759885.513364:0:164004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e482 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759885.770706:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759886.590866:0:164052:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1e978b10 20000000:00000080:1.0:1782759886.590884:0:164052:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3e82400 uarg=0000000000000000 10000000:01000000:1.0:1782759886.591097:0:164052:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759886.592531:0:164052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.592558:0:164052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.592571:0:164052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593623:0:164052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593632:0:164052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593640:0:164052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593650:0:164052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759886.593654:0:164052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593663:0:164052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593677:0:164052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593684:0:164052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759886.593690:0:164052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412a00/0xd5b45c7f5c60e489 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782759886.738512:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967452 is committed 00010000:00010000:1.0:1782759886.798653:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759887.444129:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759887.444137:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759887.444142:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759887.444202:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.444213:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.444223:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759887.444245:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233176960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759887.444311:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759887.444365:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdedf79b480 going to sleep for 11 seconds 00000100:00100000:0.0:1782759887.444428:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233176960 00000100:00100000:0.0:1782759887.444435:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233176960 00000100:00100000:0.0:1782759887.444493:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3577 00000100:00100000:0.0:1782759887.444511:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233176960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759887.444526:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759887.444540:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e490 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759887.444564:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759887.444600:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759887.444610:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803600, rc 0) 00000100:00100000:0.0:1782759887.444654:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233176960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759887.444661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3577 00000100:00100000:0.0:1782759887.444708:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233176960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759887.444721:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759887.444730:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759887.444752:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759887.444757:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759887.444765:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1782759887.654202:0:164100:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7bc5f1b0 20000000:00000080:2.0:1782759887.654222:0:164100:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc48a4000 uarg=0000000000000000 00010000:00010000:2.0:1782759887.654451:0:164100:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759887.654470:0:164100:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759887.654494:0:164100:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759887.654508:0:164100:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759887.654528:0:164100:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759887.654907:0:164100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.654925:0:164100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.654934:0:164100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.656917:0:164100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.656944:0:164100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 23 pid: 6526 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759887.656960:0:164100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164100:1869355233177088:0@lo:104: 00000100:00100000:2.0:1782759887.657849:0:164100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759887.657913:0:164100:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc44be780 going to sleep for 11 seconds 00000100:00100000:1.0:1782759887.663254:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177088 00000100:00100000:1.0:1782759887.663269:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177088 00000100:00100000:1.0:1782759887.663406:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:1.0:1782759887.663419:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:164100:x1869355233177088:12345-0@lo:104: 00010000:00010000:1.0:1782759887.663442:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759887.663571:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759887.663596:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:164100:x1869355233177088:12345-0@lo:104: Request processed in 162us (5729us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759887.663604:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00010000:00010000:3.0:1782759887.663700:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759887.663709:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.663728:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759887.663732:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.663743:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759887.663751:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759887.663758:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759887.663797:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.663803:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759887.663824:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.663832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7400/0xd5b45c7f5c60e490 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e497 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.663849:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759887.663851:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759887.663853:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759887.663866:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233177216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759887.663912:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759887.663979:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177216 00000100:00100000:3.0:1782759887.663983:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177216 00010000:00010000:3.0:1782759887.664004:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 24 pid: 6526 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759887.664028:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1782759887.664035:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233177216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759887.664046:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759887.664051:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 24 pid: 6526 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664062:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 24 pid: 6526 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664083:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664093:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664109:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664118:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664125:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664131:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664137:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759887.664141:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664149:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664157:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759887.664167:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759887.664195:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233177216:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759887.664203:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1782759887.664251:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233177216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759887.664537:0:164100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803600/0xd5b45c7f5c60e497 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e490 expref: 23 pid: 6526 timeout: 4077 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759887.664548:0:164100:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164100:1869355233177088:0@lo:104: 00010000:00010000:2.0:1782759887.664572:0:164100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.664613:0:164100:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.664619:0:164100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759887.664625:0:164100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e49e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759887.755725:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233177344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1782759887.755805:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759887.755906:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177344 00000100:00100000:1.0:1782759887.755914:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177344 00000100:00100000:1.0:1782759887.756002:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3589 00000100:00100000:1.0:1782759887.756012:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233177344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759887.756052:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1782759887.758082:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233177344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1315us (1522us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759887.758100:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3589 00000100:00100000:0.0:1782759887.758407:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233177344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759887.818707:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759888.784226:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233177472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784301:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784361:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233177984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784414:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784432:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233178496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784459:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784474:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233179008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784637:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784658:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759888.784664:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233177600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784691:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784709:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233178112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784731:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784748:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233178624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784767:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784797:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233177856:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784820:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784836:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233178368:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784856:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784871:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233178880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784891:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784909:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1782759888.784915:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233177728:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784935:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784952:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233178240:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.784971:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.784987:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb8de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233178752:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785007:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759888.785034:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177472 00000100:00100000:3.0:1782759888.785041:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177472 00000100:00100000:3.0:1782759888.785090:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3578 00000100:00100000:3.0:1782759888.785099:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233177472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785150:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233177472:12345-0@lo:400:kworker.0 Request processed in 52us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785157:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3578 00000100:00100000:3.0:1782759888.785189:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177984 00000100:00100000:3.0:1782759888.785193:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177984 00000100:00100000:3.0:1782759888.785233:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177728 00000100:00100000:3.0:1782759888.785236:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177728 00000100:00100000:3.0:1782759888.785251:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590 00000100:00100000:3.0:1782759888.785256:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233177984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785290:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233177984:12345-0@lo:400:kworker.0 Request processed in 33us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785296:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590 00000100:00100000:3.0:1782759888.785307:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3591 00000100:00100000:3.0:1782759888.785396:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233177728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785430:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233177728:12345-0@lo:400:kworker.0 Request processed in 45us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785436:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3591 00000100:00100000:3.0:1782759888.785455:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178496 00000100:00100000:3.0:1782759888.785458:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178496 00000100:00100000:3.0:1782759888.785659:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179008 00000100:00100000:3.0:1782759888.785664:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179008 00000100:00100000:3.0:1782759888.785676:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178368 00000100:00100000:3.0:1782759888.785679:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178368 00000100:00100000:3.0:1782759888.785690:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178880 00000100:00100000:3.0:1782759888.785693:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178880 00000100:00100000:3.0:1782759888.785705:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3323 00000100:00100000:3.0:1782759888.785710:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233178496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785744:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233178496:12345-0@lo:400:kworker.0 Request processed in 34us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785750:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3323 00000100:00100000:3.0:1782759888.785762:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3324 00000100:00100000:3.0:1782759888.785767:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233179008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785795:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233179008:12345-0@lo:400:kworker.0 Request processed in 28us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785801:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3324 00000100:00100000:3.0:1782759888.785811:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3325 00000100:00100000:3.0:1782759888.785816:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233178368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785845:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233178368:12345-0@lo:400:kworker.0 Request processed in 29us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785851:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3325 00000100:00100000:3.0:1782759888.785861:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3326 00000100:00100000:3.0:1782759888.785866:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233178880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.785892:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233178880:12345-0@lo:400:kworker.0 Request processed in 26us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.785898:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3326 00000100:00100000:3.0:1782759888.785916:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177600 00000100:00100000:3.0:1782759888.785920:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177600 00000100:00100000:3.0:1782759888.785938:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178112 00000100:00100000:3.0:1782759888.785941:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178112 00000100:00100000:3.0:1782759888.785952:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178624 00000100:00100000:3.0:1782759888.785954:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178624 00000100:00100000:3.0:1782759888.785963:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233177856 00000100:00100000:3.0:1782759888.785966:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233177856 00000100:00100000:3.0:1782759888.785973:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178240 00000100:00100000:3.0:1782759888.785975:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178240 00000100:00100000:3.0:1782759888.785987:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233178752 00000100:00100000:3.0:1782759888.785990:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233178752 00000100:00100000:3.0:1782759888.786002:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5624 00000100:00100000:3.0:1782759888.786007:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec7796850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233177600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.786038:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec7796850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233177600:12345-0@lo:400:kworker.0 Request processed in 31us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.786044:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5624 00000100:00100000:2.0:1782759888.788690:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5625 00000100:00100000:2.0:1782759888.788723:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233178112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.788816:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233178112:12345-0@lo:400:kworker.0 Request processed in 112us (4083us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759888.788824:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5625 00000100:00100000:2.0:1782759888.788852:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5626 00000100:00100000:2.0:1782759888.788862:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233178624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.788894:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233178624:12345-0@lo:400:kworker.0 Request processed in 36us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759888.788900:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5626 00000100:00100000:2.0:1782759888.788911:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5627 00000100:00100000:2.0:1782759888.788918:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233177856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.788946:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233177856:12345-0@lo:400:kworker.0 Request processed in 30us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759888.788952:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5627 00000100:00100000:2.0:1782759888.788963:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5628 00000100:00100000:2.0:1782759888.788971:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233178240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.788999:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233178240:12345-0@lo:400:kworker.0 Request processed in 30us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759888.789005:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5628 00000100:00100000:2.0:1782759888.789017:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5629 00000100:00100000:2.0:1782759888.789024:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233178752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.789052:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233178752:12345-0@lo:400:kworker.0 Request processed in 30us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759888.789058:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5629 00000100:00080000:2.0:1782759888.795719:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759888.795730:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759888.795733:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759888.795736:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759888.795789:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233177728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.795808:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233178240:0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.795822:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233178752:0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.795834:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233177856:0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.795846:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233178368:0@lo:400:kworker.0 00000100:00100000:2.0:1782759888.795858:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb8dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233178880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801611:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233177600:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801637:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233178112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801654:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233178624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801665:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233177472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801677:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233177984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801689:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967452 gen 2 00000004:00080000:3.0:1782759888.801695:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddcc3dca80, transno 4294967452 00000100:00100000:3.0:1782759888.801715:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233178496:0@lo:400:kworker.0 00000100:00100000:3.0:1782759888.801728:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233179008:0@lo:400:kworker.0 00010000:00010000:1.0:1782759888.842781:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759888.908905:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759888.908912:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759888.908918:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759888.908986:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.909000:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.909011:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759888.909038:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233179136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759888.909125:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759888.909206:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759888.909979:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179136 00000100:00100000:3.0:1782759888.909990:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179136 00000100:00100000:3.0:1782759888.910055:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3579 00000100:00100000:3.0:1782759888.910066:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233179136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759888.910082:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759888.910099:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e4a5 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759888.910139:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759888.910160:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759888.910170:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7400, rc 0) 00000100:00100000:3.0:1782759888.910235:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233179136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759888.910243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3579 00000100:00100000:0.0:1782759888.918190:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233179136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759888.918220:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.918234:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759888.918260:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759888.918266:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759888.918273:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759889.295825:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233179264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759889.295911:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759889.295996:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179264 00000100:00100000:3.0:1782759889.296005:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179264 00000100:00100000:3.0:1782759889.296055:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1782759889.296065:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233179264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759889.296099:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759889.296157:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233179264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759889.296165:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00000100:00100000:0.0:1782759889.296295:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233179264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759889.301216:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759889.301240:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233179392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759889.301312:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759889.301532:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179392 00000100:00100000:3.0:1782759889.301540:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179392 00000100:00100000:3.0:1782759889.301618:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:3.0:1782759889.301642:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233179392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759889.301667:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759889.301717:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233179392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759889.301724:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00000100:00100000:1.0:1782759889.302028:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233179392:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759889.867318:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759890.140440:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759890.140488:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759890.140516:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759890.140546:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759890.140602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655488 00000100:00100000:1.0:1782759890.140611:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655488 00000100:00100000:1.0:1782759890.140656:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3580 00000100:00100000:1.0:1782759890.140666:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218655488:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759890.140752:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218655488:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 86us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759890.140760:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3580 00000100:00100000:3.0:1782759890.140947:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655616 00000100:00100000:3.0:1782759890.140952:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655616 00000100:00100000:3.0:1782759890.140996:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655744 00000100:00100000:3.0:1782759890.140999:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655744 00000100:00100000:3.0:1782759890.141022:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5630 00000100:00100000:3.0:1782759890.141030:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655616:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759890.141072:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655616:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759890.141082:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5630 00000100:00100000:3.0:1782759890.141096:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5631 00000100:00100000:3.0:1782759890.141102:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655744:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759890.141128:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218655744:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759890.141134:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5631 00000100:00100000:3.0:1782759890.141151:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218655872 00000100:00100000:3.0:1782759890.141154:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218655872 00000100:00100000:3.0:1782759890.141184:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3327 00000100:00100000:3.0:1782759890.141191:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218655872:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759890.141218:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218655872:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759890.141224:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3327 00000100:00080000:1.0:1782759890.144367:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759890.144385:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759890.144388:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759890.314915:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233179520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759890.314998:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759890.315718:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782759890.315730:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233179648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759890.315764:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759890.316811:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233179776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759890.316857:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759890.318131:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179520 00000100:00100000:3.0:1782759890.318141:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179520 00000100:00100000:3.0:1782759890.318197:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179648 00000100:00100000:3.0:1782759890.318201:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179648 00000100:00100000:3.0:1782759890.318225:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:3.0:1782759890.318234:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233179520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759890.318263:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759890.318317:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233179520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (3319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759890.318325:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000100:00100000:3.0:1782759890.318339:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:3.0:1782759890.318344:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233179648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759890.318354:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759890.318419:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179776 00000100:00100000:2.0:1782759890.318424:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179776 00000100:00100000:2.0:1782759890.318470:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:2.0:1782759890.318476:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233179776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759890.318500:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:3.0:1782759890.320881:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233179648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2527us (5107us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759890.320897:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00080000:3.0:1782759890.321066:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759890.321121:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233179520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759890.324690:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233179776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6203us (7821us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759890.324707:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:0.0:1782759890.325041:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233179776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759890.326088:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233179648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782759890.890717:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759891.014960:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759891.015038:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218656128 00000100:00100000:0.0:1782759891.015049:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218656128 00000100:00100000:0.0:1782759891.015110:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3167 00000100:00100000:0.0:1782759891.015120:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:116971:x1869355218656128:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759891.015141:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759891.015180:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e4b3 lrc: 2/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27903 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759891.015294:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e4ba lrc: 3/0,1 mode: --/CW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759891.015310:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e4ba lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759891.015322:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e4ba lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759891.015336:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782759891.015458:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e4b3 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27903 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759891.015813:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e4ba lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27903 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759891.015823:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc24d2100) 00010000:00010000:0.0:1782759891.015826:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:0.0:1782759891.015829:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803600, rc 0) 00000100:00100000:0.0:1782759891.015891:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:116971:x1869355218656128:12345-192.168.202.31@tcp:101:touch.0 Request processed in 773us (939us total) trans 4294968051 rc 0/0 00000100:00100000:0.0:1782759891.015899:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3167 00000100:00100000:3.0:1782759891.018505:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759891.018684:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218656384 00000100:00100000:1.0:1782759891.018693:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218656384 00000100:00100000:1.0:1782759891.018747:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3168 00000100:00100000:1.0:1782759891.018756:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:116971:x1869355218656384:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:1.0:1782759891.018816:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1782759891.018845:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e4ba lrc: 0/0,0 mode: --/CW res: [0x200000422:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27903 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759891.018861:0:8593:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e443) 00010000:00010000:1.0:1782759891.018865:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc24d2100) 00010000:00010000:1.0:1782759891.018879:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759891.018938:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759891.018950:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759891.018960:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759891.019084:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006a48c7bb reply state 00000000237aad3f transno 4294968052 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759891.019095:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759891.019105:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6100) 00010000:00010000:1.0:1782759891.019107:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759891.019109:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759891.019216:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+8:116971:x1869355218656384:12345-192.168.202.31@tcp:36:touch.0 Request processed in 460us (719us total) trans 4294968052 rc 0/0 00000100:00100000:1.0:1782759891.019224:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3168 00000100:00100000:1.0:1782759891.022082:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759891.022300:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218656512 00000100:00100000:3.0:1782759891.022310:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218656512 00000100:00100000:3.0:1782759891.022380:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1127 00000100:00100000:3.0:1782759891.022389:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218656512:12345-192.168.202.31@tcp:2:touch.0 00002000:00010000:3.0:1782759891.022904:0:8600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759891.022908:0:8600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1782759867 -> 1782759891 00002000:00010000:3.0:1782759891.022911:0:8600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1782759867 -> 1782759891 00002000:00010000:3.0:1782759891.022913:0:8600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1782759867 -> 1782759891 00002000:00010000:3.0:1782759891.022915:0:8600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782759891.022978:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+7:2403:x1869355218656512:12345-192.168.202.31@tcp:2:touch.0 Request processed in 589us (904us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1782759891.022987:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1127 00000100:00100000:3.0:1782759891.024881:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759891.028424:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218656768 00000100:00100000:0.0:1782759891.028443:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218656768 00000100:00100000:0.0:1782759891.028657:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 470 00000100:00100000:1.0:1782759891.031433:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+8:116971:x1869355218656768:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:1.0:1782759891.031877:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+9:116971:x1869355218656768:12345-192.168.202.31@tcp:35:touch.0 Request processed in 3208us (7003us total) trans 4294968053 rc 0/0 00000100:00100000:1.0:1782759891.031888:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 470 00010000:00010000:1.0:1782759891.914788:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759892.116844:0:164295:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe842520d0 20000000:00000080:3.0:1782759892.116867:0:164295:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf8a1400 uarg=0000000000000000 00010000:00010000:3.0:1782759892.117108:0:164295:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759892.117126:0:164295:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759892.117152:0:164295:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759892.117164:0:164295:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759892.117187:0:164295:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759892.117209:0:164295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.117226:0:164295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.117235:0:164295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.117292:0:164295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.117307:0:164295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 23 pid: 6524 timeout: 4082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759892.117323:0:164295:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7267b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164295:1869355233179904:0@lo:104: 00000100:00100000:3.0:1782759892.117399:0:164295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759892.117449:0:164295:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759892.117692:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233179904 00000100:00100000:0.0:1782759892.117699:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233179904 00000100:00100000:0.0:1782759892.117753:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1782759892.117765:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:164295:x1869355233179904:12345-0@lo:104: 00010000:00010000:0.0:1782759892.117779:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759892.117849:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759892.117855:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:164295:x1869355233179904:12345-0@lo:104: Request processed in 94us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759892.117862:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00010000:00010000:2.0:1782759892.118002:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759892.118010:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118018:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759892.118021:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118029:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759892.118036:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759892.118046:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759892.118082:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118089:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759892.118111:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118119:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803a00/0xd5b45c7f5c60e4a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e4ac expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118141:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759892.118143:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759892.118144:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759892.118152:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759892.118162:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233180032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759892.118201:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759892.118239:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180032 00000100:00100000:2.0:1782759892.118244:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180032 00010000:00010000:2.0:1782759892.118274:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 24 pid: 6524 timeout: 4082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759892.118314:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1782759892.118322:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233180032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759892.118333:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759892.118337:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 24 pid: 6524 timeout: 4082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118350:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 24 pid: 6524 timeout: 4082 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118376:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118385:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118398:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118404:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118411:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118416:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118422:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759892.118426:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118433:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118442:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759892.118456:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759892.118485:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233180032:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759892.118492:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1782759892.118530:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233180032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759892.119163:0:164295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7400/0xd5b45c7f5c60e4ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4a5 expref: 23 pid: 6524 timeout: 4082 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759892.119175:0:164295:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7267b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164295:1869355233179904:0@lo:104: 00010000:00010000:3.0:1782759892.119201:0:164295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.119211:0:164295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.119217:0:164295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759892.119229:0:164295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4cf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759892.878942:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759892.878966:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233180160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759892.879039:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759892.879170:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180160 00000100:00100000:2.0:1782759892.879178:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180160 00000100:00100000:2.0:1782759892.879254:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:2.0:1782759892.879265:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233180160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759892.879302:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759892.879374:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233180160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759892.879381:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:3.0:1782759892.879458:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233180160:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759892.938814:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759893.514712:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759893.514721:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759893.514726:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759893.514781:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759893.514793:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759893.514804:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759893.514831:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233180288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759893.514911:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759893.514990:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec5483840 going to sleep for 11 seconds 00000100:00100000:3.0:1782759893.515064:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180288 00000100:00100000:3.0:1782759893.515072:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180288 00000100:00100000:3.0:1782759893.515135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3581 00000100:00100000:3.0:1782759893.515145:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233180288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759893.515162:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759893.515176:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e4d6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759893.515203:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759893.515216:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759893.515227:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6800, rc 0) 00000100:00100000:3.0:1782759893.515317:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233180288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759893.515323:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3581 00000100:00100000:2.0:1782759893.515482:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233180288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759893.515498:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.515506:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759893.515529:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759893.515534:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.515542:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759893.899237:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759893.899262:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233180672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.899351:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759893.899412:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180672 00000100:00100000:0.0:1782759893.899420:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180672 00000100:00100000:2.0:1782759893.899456:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233180800:0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.899483:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3594 00000100:00100000:0.0:1782759893.899492:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233180672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759893.899568:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233180544:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.899604:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233180416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.909019:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233180672:12345-0@lo:400:kworker.0 Request processed in 9516us (9664us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759893.909037:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3594 00000001:00080000:0.0:1782759893.921756:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968053 is committed 00010000:00010000:2.0:1782759893.922029:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.922044:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759893.922048:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233181184:0@lo:400:kworker.0 00010000:00010000:2.0:1782759893.922054:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.922063:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759893.922068:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.922076:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.922095:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34f6100) 00010000:00010000:2.0:1782759893.922099:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759893.922104:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759893.922110:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e4c8 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759893.922118:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759893.922184:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759893.922218:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759893.922222:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181184 00000100:00100000:0.0:1782759893.922227:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233181312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.922253:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759893.922317:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233181696:0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.922338:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759893.922387:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759893.922395:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233181824:0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.922417:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759893.922466:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181184 00000100:00100000:2.0:1782759893.922536:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180800 00000100:00100000:2.0:1782759893.922540:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180800 00000100:00100000:2.0:1782759893.922569:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181696 00000100:00100000:2.0:1782759893.922572:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181696 00000100:00100000:2.0:1782759893.922627:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5632 00000100:00100000:2.0:1782759893.922635:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233181184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.922689:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233181184:12345-0@lo:400:kworker.0 Request processed in 54us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.922697:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5632 00000100:00100000:2.0:1782759893.922712:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5633 00000100:00100000:2.0:1782759893.922731:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233180800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.922760:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233180800:12345-0@lo:400:kworker.0 Request processed in 43us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.922766:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5633 00000100:00100000:2.0:1782759893.922779:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5634 00000100:00100000:2.0:1782759893.922786:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233181696:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1782759893.922804:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759893.922816:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233181696:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.922824:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5634 00000100:00100000:2.0:1782759893.922885:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233181696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.922897:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233181184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.923048:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233180800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.923059:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233180672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.923135:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181312 00000100:00100000:2.0:1782759893.923138:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181312 00000100:00100000:2.0:1782759893.923172:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181824 00000100:00100000:2.0:1782759893.923175:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181824 00000100:00100000:2.0:1782759893.923190:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3328 00000100:00100000:2.0:1782759893.923196:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233181312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.923228:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233181312:12345-0@lo:400:kworker.0 Request processed in 33us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.923233:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3328 00000100:00100000:2.0:1782759893.923302:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1782759893.923310:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233181824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.923339:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233181824:12345-0@lo:400:kworker.0 Request processed in 31us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.923354:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3329 00000100:00100000:2.0:1782759893.923386:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233181824:0@lo:400:kworker.0 00000100:00080000:0.0:1782759893.923514:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759893.923518:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759893.923661:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233181312:0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.924640:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759893.926738:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180544 00000100:00100000:2.0:1782759893.926749:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180544 00000100:00100000:2.0:1782759893.926817:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5635 00000100:00100000:2.0:1782759893.926829:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233180544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.926911:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233180544:12345-0@lo:400:kworker.0 Request processed in 85us (2273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.926918:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5635 00000100:00100000:1.0:1782759893.927141:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233180544:0@lo:400:kworker.0 00000100:00100000:1.0:1782759893.927170:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233181056:0@lo:400:kworker.0 00000100:00100000:1.0:1782759893.927206:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759893.927298:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233181568:0@lo:400:kworker.0 00000100:00100000:1.0:1782759893.927321:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759893.927973:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759893.927993:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180416 00000100:00100000:3.0:1782759893.927997:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180416 00000100:00100000:3.0:1782759893.928022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3582 00000100:00100000:3.0:1782759893.928027:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233180416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928052:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233180416:12345-0@lo:400:kworker.0 Request processed in 25us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759893.928056:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3582 00000100:00100000:3.0:1782759893.928093:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233180416:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928107:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233180928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928126:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759893.928144:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233181440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928159:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759893.928173:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181440 00000100:00100000:3.0:1782759893.928175:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181440 00000100:00100000:3.0:1782759893.928203:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3330 00000100:00100000:3.0:1782759893.928207:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233181440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928226:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233181440:12345-0@lo:400:kworker.0 Request processed in 20us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759893.928230:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3330 00000100:00080000:3.0:1782759893.928252:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759893.928264:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233181440:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928269:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233181952:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.928283:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759893.929634:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233180928 00000100:00100000:1.0:1782759893.929643:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233180928 00000100:00100000:1.0:1782759893.929703:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:1.0:1782759893.929712:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233180928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759893.929772:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233180928:12345-0@lo:400:kworker.0 Request processed in 61us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759893.929779:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1782759893.932690:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181952 00000100:00100000:0.0:1782759893.932701:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181952 00000100:00100000:0.0:1782759893.932784:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3331 00000100:00100000:0.0:1782759893.932795:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233181952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.932879:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233181952:12345-0@lo:400:kworker.0 Request processed in 86us (4593us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759893.932886:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3331 00000100:00080000:1.0:1782759893.932936:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782759893.934547:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181056 00000100:00100000:2.0:1782759893.934560:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181056 00000100:00100000:2.0:1782759893.934699:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233181568 00000100:00100000:2.0:1782759893.934703:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233181568 00000100:00100000:0.0:1782759893.934756:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5636 00000100:00100000:0.0:1782759893.934768:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233181056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759893.934868:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233181056:12345-0@lo:400:kworker.0 Request processed in 102us (7661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759893.934876:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5636 00000100:00100000:3.0:1782759893.935123:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233180928:0@lo:400:kworker.0 00000100:00100000:3.0:1782759893.935139:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233181952:0@lo:400:kworker.0 00000100:00080000:1.0:1782759893.941432:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759893.941513:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233181056:0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.945246:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5637 00000100:00100000:2.0:1782759893.945262:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233181568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759893.945385:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233181568:12345-0@lo:400:kworker.0 Request processed in 127us (18061us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759893.945393:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5637 00000100:00100000:0.0:1782759893.949811:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233181568:0@lo:400:kworker.0 00010000:00010000:1.0:1782759893.962732:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759894.414361:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759894.414388:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233182080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759894.414460:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759894.418051:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182080 00000100:00100000:2.0:1782759894.418066:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182080 00000100:00100000:2.0:1782759894.418149:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:2.0:1782759894.418162:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233182080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759894.418196:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759894.418274:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233182080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (3814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759894.418281:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00000100:00100000:3.0:1782759894.424262:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233182080:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759894.429743:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759894.429766:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233182208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759894.429847:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759894.429916:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182208 00000100:00100000:1.0:1782759894.429923:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182208 00000100:00100000:1.0:1782759894.429971:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:1.0:1782759894.429979:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233182208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759894.430004:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759894.430049:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233182208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759894.430055:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00000100:00100000:1.0:1782759894.430098:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233182208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759894.986977:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759895.266808:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.266855:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.266886:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.266918:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759895.266978:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218656896 00000100:00100000:1.0:1782759895.266987:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218656896 00000100:00100000:1.0:1782759895.267045:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3583 00000100:00100000:1.0:1782759895.267056:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218656896:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759895.267184:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218656896:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759895.267193:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3583 00000100:00100000:0.0:1782759895.267689:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218657152 00000100:00100000:0.0:1782759895.267695:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218657152 00000100:00100000:0.0:1782759895.267741:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218657024 00000100:00100000:0.0:1782759895.267743:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218657024 00000100:00100000:0.0:1782759895.267765:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5638 00000100:00100000:0.0:1782759895.267773:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218657152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759895.267816:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218657152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.267822:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5638 00000100:00100000:0.0:1782759895.267836:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5639 00000100:00100000:0.0:1782759895.267842:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218657024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759895.267871:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218657024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 30us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.267877:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5639 00000100:00080000:1.0:1782759895.267944:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759895.267949:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759895.269803:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218657280 00000100:00100000:2.0:1782759895.269817:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218657280 00000100:00100000:2.0:1782759895.269925:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3332 00000100:00100000:2.0:1782759895.269944:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2404:x1869355218657280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759895.270015:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2404:x1869355218657280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759895.270022:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3332 00000100:00080000:1.0:1782759895.272289:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759895.436106:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233182336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759895.436182:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759895.436856:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233182464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759895.436896:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759895.436935:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182464 00000100:00100000:3.0:1782759895.436943:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182464 00000100:00100000:3.0:1782759895.437006:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:3.0:1782759895.437015:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233182464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759895.437050:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:3.0:1782759895.437099:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233182464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759895.437107:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:3.0:1782759895.437158:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233182464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759895.438797:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182336 00000100:00100000:0.0:1782759895.438811:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182336 00000100:00100000:0.0:1782759895.438873:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:0.0:1782759895.438882:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233182336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759895.438910:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759895.438981:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233182336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (2798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.438988:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000100:00100000:0.0:1782759895.439039:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233182336:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782759895.440482:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759895.440509:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233182592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759895.440606:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759895.441093:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182592 00000100:00100000:2.0:1782759895.441101:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182592 00000100:00100000:2.0:1782759895.441175:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1782759895.441187:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233182592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759895.441209:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759895.441258:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233182592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759895.441265:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000100:00080000:3.0:1782759895.441849:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759895.441893:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233182592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759895.823511:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759895.824600:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218657408 00000100:00100000:2.0:1782759895.824612:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218657408 00000100:00100000:2.0:1782759895.824700:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3169 00000100:00100000:2.0:1782759895.824712:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:117048:x1869355218657408:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759895.824732:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759895.824754:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e4e4 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2790a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824819:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824833:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824846:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824860:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824867:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824873:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824956:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824967:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.824973:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759895.825014:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782759895.825018:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759895.825037:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825047:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825056:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825062:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825068:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825074:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825080:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759895.825084:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825092:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825109:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc34ff500) 00010000:00010000:2.0:1782759895.825112:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759895.825118:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825125:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e4eb lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825140:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825147:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825153:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825498:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759895.825504:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825512:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825522:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cddc34ff300) 00010000:00010000:2.0:1782759895.825525:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759895.825528:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825535:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e4f2 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825603:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e4e4 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2790a expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825621:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2790a expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.825628:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:2.0:1782759895.825630:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759895.825632:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648000, rc 0) 00000100:00100000:2.0:1782759895.828606:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:117048:x1869355218657408:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1728us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759895.828620:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3169 00000100:00100000:2.0:1782759895.840121:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.840199:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218657664 00000100:00100000:0.0:1782759895.840210:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218657664 00000100:00100000:0.0:1782759895.840279:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3170 00000100:00100000:0.0:1782759895.840289:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+6:117048:x1869355218657664:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759895.840351:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759895.840382:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e4f9 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2790a expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.840398:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:0.0:1782759895.840407:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759895.840447:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.840462:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.840472:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759895.840785:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 88 off10880 00000004:00080000:0.0:1782759895.840798:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3936117219358ns, next at 3937117216658ns, rc = 0 00000004:00010000:0.0:1782759895.840850:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b3b2c83 reply state 000000006fefaa11 transno 4294968054 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.840862:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.840869:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759895.840872:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782759895.840874:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759895.840982:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:117048:x1869355218657664:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 693us (872us total) trans 4294968054 rc 0/0 00000100:00100000:0.0:1782759895.840990:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3170 00000100:00100000:2.0:1782759895.876676:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.876761:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218657920 00000100:00100000:0.0:1782759895.876772:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218657920 00000100:00100000:0.0:1782759895.876824:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3171 00000100:00100000:0.0:1782759895.876834:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:117049:x1869355218657920:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759895.876890:0:42628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759895.876894:0:42628:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e427) 00010000:00010000:0.0:1782759895.876897:0:42628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759895.876929:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,1 mode: --/PW res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.876944:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.876958:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759895.877193:0:42628:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006770c8d8 reply state 00000000c09caf33 transno 4294967799 ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.877207:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.877214:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:0.0:1782759895.877218:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782759895.877221:0:42628:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782759895.877229:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1782759895.877334:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+7:117049:x1869355218657920:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 491us (657us total) trans 4294967799 rc 0/0 00000100:00100000:0.0:1782759895.877341:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3171 00000100:00100000:2.0:1782759895.880564:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.880675:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218658176 00000100:00100000:0.0:1782759895.880684:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218658176 00000100:00100000:0.0:1782759895.880743:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3172 00000100:00100000:0.0:1782759895.880753:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:117049:x1869355218658176:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759895.880776:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759895.880799:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e50e lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27911 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880870:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880884:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880895:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880906:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880913:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880920:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880974:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e523 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880981:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e523 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.880988:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e523 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881000:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881006:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881012:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881018:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881024:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759895.881028:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881034:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881045:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0ae00) 00010000:00010000:0.0:1782759895.881048:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759895.881052:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881059:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e515 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881071:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881077:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881083:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881088:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759895.881090:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881096:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881102:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cdecda0ab00) 00010000:00010000:0.0:1782759895.881104:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759895.881106:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881111:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e51c lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881138:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e50e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27911 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881150:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e523 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27911 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.881158:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a000) 00010000:00010000:0.0:1782759895.881160:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759895.881162:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803800, rc 0) 00000100:00100000:0.0:1782759895.881213:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+8:117049:x1869355218658176:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 461us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.881220:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3172 00000100:00100000:2.0:1782759895.884105:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.884186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218658304 00000100:00100000:0.0:1782759895.884196:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218658304 00000100:00100000:0.0:1782759895.884270:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 425 00000100:00100000:0.0:1782759895.884283:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95b27dde-c150-4adf-930b-37620c52929b+8:2405:x1869355218658304:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759895.884299:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759895.884335:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e523 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27911 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.884355:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a000) 00010000:00010000:0.0:1782759895.884366:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759895.884440:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218658304:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 154us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.884449:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 425 00000100:00100000:3.0:1782759895.885712:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759895.885829:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218658560 00000100:00100000:2.0:1782759895.885837:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218658560 00000100:00100000:2.0:1782759895.885896:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3173 00000100:00100000:2.0:1782759895.885907:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:117049:x1869355218658560:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759895.885931:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759895.885948:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e52a lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27918 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759895.886054:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782759895.886143:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e52a lrc: 1/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27918 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.886168:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:2.0:1782759895.886171:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759895.886176:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e52a lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27918 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759895.886187:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649e00, rc 0) 00000100:00100000:2.0:1782759895.886232:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:117049:x1869355218658560:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 328us (525us total) trans 4294967800 rc 301/301 00000100:00100000:2.0:1782759895.886240:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3173 00000100:00100000:3.0:1782759895.894714:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759895.894758:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218658816 00000100:00100000:3.0:1782759895.894767:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218658816 00000100:00100000:3.0:1782759895.894821:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 471 00000100:00100000:3.0:1782759895.894832:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+8:117049:x1869355218658816:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759895.895067:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+9:117049:x1869355218658816:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 235us (360us total) trans 4294967801 rc 0/0 00000100:00100000:3.0:1782759895.895076:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 471 00000100:00100000:3.0:1782759895.897739:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759895.897780:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218658944 00000100:00100000:3.0:1782759895.897789:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218658944 00000100:00100000:3.0:1782759895.897841:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3174 00000100:00100000:3.0:1782759895.897852:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+9:117049:x1869355218658944:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759895.897873:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759895.897895:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e538 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2791f expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.897958:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e53f lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.897972:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e53f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.897984:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e53f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759895.898025:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759895.898029:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759895.898047:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e53f lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.898073:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e538 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2791f expref: 11 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.898100:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e53f lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2791f expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759895.898108:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:3.0:1782759895.898111:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759895.898115:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7400, rc 0) 00000100:00100000:3.0:1782759895.900361:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+10:117049:x1869355218658944:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2503us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759895.900374:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3174 00000100:00100000:3.0:1782759895.916854:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759895.926155:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659072 00000100:00100000:1.0:1782759895.926171:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659072 00000100:00100000:3.0:1782759895.926794:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 472 00000100:00100000:3.0:1782759895.926805:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+10:117049:x1869355218659072:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759895.930733:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+10:117049:x1869355218659072:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 3918us (13879us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759895.930749:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 472 00000100:00100000:3.0:1782759895.965905:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759895.965987:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659200 00000100:00100000:0.0:1782759895.965998:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659200 00000100:00100000:0.0:1782759895.966056:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3175 00000100:00100000:0.0:1782759895.966067:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:117051:x1869355218659200:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759895.966088:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759895.966111:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e546 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27926 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966180:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966193:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966204:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966216:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966224:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966231:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966316:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966336:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966343:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759895.966386:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782759895.966391:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759895.966410:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966426:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966445:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966452:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966458:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966465:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966471:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759895.966475:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966482:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966493:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a000) 00010000:00010000:0.0:1782759895.966496:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759895.966501:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966507:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e54d lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966521:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966527:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966533:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966538:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759895.966541:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966546:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966553:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cdecda0ae00) 00010000:00010000:0.0:1782759895.966556:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759895.966558:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966564:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e554 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966625:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803800/0xd5b45c7f5c60e546 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27926 expref: 9 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966642:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27926 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759895.966649:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759895.966651:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759895.966654:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803400, rc 0) 00000100:00100000:0.0:1782759895.966714:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+8:117051:x1869355218659200:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 649us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759895.966721:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3175 00010000:00010000:1.0:1782759896.010760:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759896.476835:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967453 is committed 00000020:00000080:0.0:1782759896.895054:0:164491:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1c37bc40 20000000:00000080:0.0:1782759896.895073:0:164491:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf95c000 uarg=0000000000000000 00010000:00010000:0.0:1782759896.895923:0:164491:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759896.895961:0:164491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:0.0:1782759896.895966:0:164491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759896.895977:0:164491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e53f lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2791f expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.895994:0:164491:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759896.896020:0:164491:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759896.896040:0:164491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759896.896042:0:164491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759896.896048:0:164491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e55b lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27926 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.896059:0:164491:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782759896.896082:0:164491:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759896.896344:0:164491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.896358:0:164491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.896367:0:164491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.896408:0:164491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759896.896423:0:164491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 23 pid: 6525 timeout: 4087 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759896.896503:0:164491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164491:1869355233182720:0@lo:104: 00000100:00100000:0.0:1782759896.896660:0:164491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759896.896840:0:164491:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec2c69e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759896.896992:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1782759896.897007:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182720 00000100:00100000:1.0:1782759896.897014:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182720 00000100:00100000:1.0:1782759896.897102:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1782759896.897113:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7308c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:164491:x1869355233182720:12345-0@lo:104: 00010000:00010000:1.0:1782759896.897126:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759896.897209:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759896.897215:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7308c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:164491:x1869355233182720:12345-0@lo:104: Request processed in 105us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759896.897222:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00010000:00010000:3.0:1782759896.897313:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759896.897330:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897337:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759896.897341:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897351:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759896.897358:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759896.897364:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759896.897394:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897400:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759896.897422:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897439:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf802800/0xd5b45c7f5c60e4d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e4dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897464:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759896.897465:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759896.897467:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759896.897480:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233182848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759896.897512:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759896.897549:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182848 00000100:00100000:3.0:1782759896.897553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182848 00010000:00010000:3.0:1782759896.897574:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 24 pid: 6525 timeout: 4087 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759896.897616:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1782759896.897624:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233182848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759896.897634:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759896.897639:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 24 pid: 6525 timeout: 4087 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897649:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 24 pid: 6525 timeout: 4087 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897684:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897693:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897708:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897715:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897722:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897728:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897734:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759896.897738:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897745:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897754:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759896.897763:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759896.897916:0:164491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6800/0xd5b45c7f5c60e4dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e4d6 expref: 24 pid: 6525 timeout: 4087 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759896.897927:0:164491:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164491:1869355233182720:0@lo:104: 00010000:00010000:2.0:1782759896.897945:0:164491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.897954:0:164491:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.897960:0:164491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759896.897966:0:164491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e562 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759896.899084:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233182848:12345-0@lo:103:ldlm_bl.0 Request processed in 1455us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759896.899096:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1782759896.899148:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233182848:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759897.036859:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759897.996834:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759897.996859:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233182976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759897.996936:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759897.997069:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233182976 00000100:00100000:3.0:1782759897.997077:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233182976 00000100:00100000:3.0:1782759897.997141:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597 00000100:00100000:3.0:1782759897.997151:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233182976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759897.997181:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1782759897.997238:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233182976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759897.997245:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597 00000100:00100000:1.0:1782759897.997369:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233182976:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1782759898.059735:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759898.382672:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759898.382680:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759898.382685:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759898.382733:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759898.382746:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759898.382758:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759898.382782:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233183104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759898.382852:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759898.382895:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec795d600 going to sleep for 11 seconds 00000100:00100000:3.0:1782759898.382971:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183104 00000100:00100000:3.0:1782759898.382978:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183104 00000100:00100000:3.0:1782759898.383036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3584 00000100:00100000:3.0:1782759898.383045:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233183104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759898.383060:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759898.383074:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e569 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.383097:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.383107:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.383116:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759898.383160:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233183104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759898.383167:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3584 00000100:00100000:3.0:1782759898.383212:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233183104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759898.383225:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.383235:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759898.383253:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759898.383259:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759898.383266:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759899.021941:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233183232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022016:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022064:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233183744:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022091:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022110:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233184256:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022133:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022150:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233184768:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022170:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022192:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1782759899.022198:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233183360:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022234:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022252:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233183872:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022272:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022307:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233184384:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022329:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022354:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233183488:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022379:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022396:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233184000:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022417:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022435:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233184512:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022467:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.022497:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183232 00000100:00100000:1.0:1782759899.022504:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183232 00000100:00100000:1.0:1782759899.022550:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3585 00000100:00100000:1.0:1782759899.022559:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233183232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.022766:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233183232:12345-0@lo:400:kworker.0 Request processed in 208us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.022774:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3585 00000100:00100000:1.0:1782759899.022808:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183744 00000100:00100000:1.0:1782759899.022812:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183744 00000100:00100000:1.0:1782759899.022850:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183488 00000100:00100000:1.0:1782759899.022853:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183488 00000100:00100000:1.0:1782759899.023049:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3598 00000100:00100000:1.0:1782759899.023057:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233183744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.023096:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233183744:12345-0@lo:400:kworker.0 Request processed in 40us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.023102:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3598 00000100:00100000:1.0:1782759899.023113:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:1.0:1782759899.023119:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233183488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.023153:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233183488:12345-0@lo:400:kworker.0 Request processed in 33us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.023159:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:1.0:1782759899.023178:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184256 00000100:00100000:1.0:1782759899.023181:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184256 00000100:00100000:1.0:1782759899.023216:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184768 00000100:00100000:0.0:1782759899.023370:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233183616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.023403:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759899.023425:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233184128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.023965:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184768 00000100:00100000:1.0:1782759899.023997:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3333 00000100:00100000:1.0:1782759899.024006:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233184256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.024047:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233184256:12345-0@lo:400:kworker.0 Request processed in 42us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.024056:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3333 00000100:00100000:1.0:1782759899.024069:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3334 00000100:00100000:1.0:1782759899.024075:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233184768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.024102:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233184768:12345-0@lo:400:kworker.0 Request processed in 28us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.024108:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3334 00000100:00100000:1.0:1782759899.024128:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183360 00000100:00100000:1.0:1782759899.024132:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183360 00000100:00100000:1.0:1782759899.024149:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183872 00000100:00100000:1.0:1782759899.024152:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183872 00000100:00100000:1.0:1782759899.024164:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184384 00000100:00100000:1.0:1782759899.024167:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184384 00000100:00100000:1.0:1782759899.024192:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184000 00000100:00100000:1.0:1782759899.024195:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184000 00000100:00100000:1.0:1782759899.024208:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184512 00000100:00100000:1.0:1782759899.024211:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184512 00000100:00100000:1.0:1782759899.024234:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233183616 00000100:00100000:1.0:1782759899.024237:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233183616 00000100:00100000:1.0:1782759899.024252:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5640 00000100:00100000:1.0:1782759899.024258:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233183360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.024651:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759899.024710:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184128 00000100:00100000:2.0:1782759899.024715:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184128 00000100:00100000:2.0:1782759899.024749:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3335 00000100:00100000:2.0:1782759899.024758:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233184128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028433:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233184640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028505:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759899.028554:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184640 00000100:00100000:0.0:1782759899.028562:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184640 00000100:00100000:0.0:1782759899.028635:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3336 00000100:00100000:0.0:1782759899.028644:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233184640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028708:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233184640:12345-0@lo:400:kworker.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759899.028715:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3336 00000100:00100000:0.0:1782759899.028743:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5641 00000100:00100000:0.0:1782759899.028751:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233183872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028786:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233183872:12345-0@lo:400:kworker.0 Request processed in 36us (6513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759899.028793:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5641 00000100:00100000:0.0:1782759899.028808:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5642 00000100:00100000:0.0:1782759899.028815:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233184384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028843:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233184384:12345-0@lo:400:kworker.0 Request processed in 29us (6514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759899.028848:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5642 00000100:00100000:0.0:1782759899.028860:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5643 00000100:00100000:0.0:1782759899.028865:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233184000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028892:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233184000:12345-0@lo:400:kworker.0 Request processed in 27us (6474us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759899.028898:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5643 00000100:00100000:0.0:1782759899.028914:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5644 00000100:00100000:0.0:1782759899.028920:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233184512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.028948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233184512:12345-0@lo:400:kworker.0 Request processed in 29us (6481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759899.028954:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5644 00000100:00100000:0.0:1782759899.028966:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5645 00000100:00100000:0.0:1782759899.028973:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233183616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029001:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233183616:12345-0@lo:400:kworker.0 Request processed in 29us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759899.029007:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5645 00000100:00100000:0.0:1782759899.029059:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233183616:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029072:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233184640:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029155:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233183872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029166:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233184384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029176:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233183232:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029187:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233183744:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029199:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233184256:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029211:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233184768:0@lo:400:kworker.0 00000100:00080000:0.0:1782759899.029250:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759899.029255:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759899.029258:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759899.029261:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759899.029283:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233183488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029295:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233184000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759899.029319:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233184512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759899.031649:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233184128:12345-0@lo:400:kworker.0 Request processed in 6885us (8192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759899.031664:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3335 00000100:00100000:0.0:1782759899.033538:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233184128:0@lo:400:kworker.0 00000100:00100000:1.0:1782759899.036153:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233183360:12345-0@lo:400:kworker.0 Request processed in 11885us (13921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.036167:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5640 00000100:00100000:0.0:1782759899.036267:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233183360:0@lo:400:kworker.0 00010000:00010000:3.0:1782759899.084326:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759899.530796:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233184896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759899.530867:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.530999:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233184896 00000100:00100000:1.0:1782759899.531007:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233184896 00000100:00100000:1.0:1782759899.531058:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:1.0:1782759899.531067:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233184896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759899.531098:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759899.532778:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233184896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1694us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.532791:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000100:00100000:3.0:1782759899.532891:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759899.534096:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233185024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759899.534161:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759899.534288:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185024 00000100:00100000:1.0:1782759899.534306:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185024 00000100:00100000:1.0:1782759899.534350:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:1.0:1782759899.534359:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233185024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759899.534381:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759899.534439:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233185024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759899.534445:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00000100:00100000:3.0:1782759899.534570:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233185024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759899.534714:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233184896:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782759900.107881:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759900.382426:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759900.382458:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759900.382480:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759900.382504:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759900.382533:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659584 00000100:00100000:3.0:1782759900.382542:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659584 00000100:00100000:3.0:1782759900.382617:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659456 00000100:00100000:3.0:1782759900.382621:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659456 00000100:00100000:3.0:1782759900.382646:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5646 00000100:00100000:3.0:1782759900.382656:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+9:2405:x1869355218659584:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759900.382730:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+9:2405:x1869355218659584:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.382737:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5646 00000100:00100000:3.0:1782759900.382754:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5647 00000100:00100000:3.0:1782759900.382761:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218659456:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759900.382788:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2405:x1869355218659456:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.382794:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5647 00000100:00100000:3.0:1782759900.382814:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659712 00000100:00100000:3.0:1782759900.382817:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659712 00000100:00100000:3.0:1782759900.382858:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3337 00000100:00100000:3.0:1782759900.382865:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218659712:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759900.382890:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218659712:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.382897:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3337 00000100:00080000:3.0:1782759900.382911:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759900.382916:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759900.382917:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759900.384344:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659328 00000100:00100000:2.0:1782759900.384354:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659328 00000100:00100000:2.0:1782759900.384881:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3586 00000100:00100000:2.0:1782759900.384894:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218659328:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759900.385052:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218659328:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 162us (2634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759900.385060:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3586 00000100:00100000:3.0:1782759900.448569:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759900.448877:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218659968 00000100:00100000:0.0:1782759900.448887:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218659968 00000100:00100000:0.0:1782759900.448952:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3176 00000100:00100000:0.0:1782759900.448963:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+7:117128:x1869355218659968:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759900.449018:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759900.449023:0:12673:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e55b) 00010000:00010000:0.0:1782759900.449024:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759900.449102:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+7:117128:x1869355218659968:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 141us (542us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759900.449109:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3176 00000100:00100000:2.0:1782759900.472675:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759900.472929:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218660224 00000100:00100000:0.0:1782759900.472940:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218660224 00000100:00100000:0.0:1782759900.473046:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3177 00000100:00100000:0.0:1782759900.473056:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+9:117129:x1869355218660224:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759900.473110:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759900.473114:0:6533:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e53f) 00010000:00010000:0.0:1782759900.473116:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759900.473207:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+9:117129:x1869355218660224:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 152us (542us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759900.473220:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3177 00000100:00100000:3.0:1782759900.501695:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759900.501812:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218660352 00000100:00100000:0.0:1782759900.501822:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218660352 00000100:00100000:0.0:1782759900.501892:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3178 00000100:00100000:0.0:1782759900.501903:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:117131:x1869355218660352:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759900.501925:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759900.501947:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e577 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2792d expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502007:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502021:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502031:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502044:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502052:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502058:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502130:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502139:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502146:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759900.502184:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782759900.502189:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759900.502208:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502232:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502246:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502252:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502258:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502264:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502270:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759900.502273:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502281:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502304:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:0.0:1782759900.502307:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759900.502312:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502319:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e57e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502333:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502340:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502345:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502350:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759900.502352:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502357:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502364:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759900.502366:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759900.502368:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502374:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e585 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502414:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e577 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2792d expref: 9 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502431:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2792d expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.502439:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759900.502441:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759900.502443:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803400, rc 0) 00000100:00100000:0.0:1782759900.502506:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+8:117131:x1869355218660352:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 605us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759900.502518:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3178 00000100:00100000:3.0:1782759900.554897:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759900.554922:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233185152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759900.554997:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759900.555064:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185152 00000100:00100000:3.0:1782759900.555072:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185152 00000100:00100000:3.0:1782759900.555132:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3600 00000100:00100000:3.0:1782759900.555141:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233185152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759900.555176:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:3.0:1782759900.555236:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233185152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.555243:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3600 00000100:00100000:3.0:1782759900.555319:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233185152:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1782759900.555644:0:8598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3940832065114ns, next at 3941832062449ns, rc = 0 00000100:00100000:0.0:1782759900.555707:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233185280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759900.555745:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759900.555838:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185280 00000100:00100000:2.0:1782759900.555842:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185280 00000100:00100000:2.0:1782759900.555899:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:2.0:1782759900.555908:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233185280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759900.555928:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759900.555967:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233185280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759900.555973:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00000100:00100000:2.0:1782759900.556006:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233185280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759900.556367:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759900.556406:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759900.556555:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185408 00000100:00100000:3.0:1782759900.556560:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185408 00000100:00100000:3.0:1782759900.556614:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:3.0:1782759900.556623:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233185408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759900.556635:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759900.556677:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233185408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.556683:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1782759900.556794:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759900.559500:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759900.559690:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218660480 00000100:00100000:0.0:1782759900.559701:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218660480 00000100:00100000:0.0:1782759900.559757:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3179 00000100:00100000:0.0:1782759900.559768:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+8:117134:x1869355218660480:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759900.559787:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759900.559809:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e593 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27934 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559884:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559898:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559910:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559924:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559930:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559936:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559988:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e5a8 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.559996:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e5a8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560003:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e5a8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759900.560025:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e5a8 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560041:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560048:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560054:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560060:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560066:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759900.560071:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560079:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560091:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a400) 00010000:00010000:0.0:1782759900.560094:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759900.560099:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560105:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e59a lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560119:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560125:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560129:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560134:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759900.560136:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560141:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560148:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cdecda0a100) 00010000:00010000:0.0:1782759900.560150:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759900.560153:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560158:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5a1 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560188:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60e593 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27934 expref: 10 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560206:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e5a8 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27934 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.560337:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:0.0:1782759900.560340:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782759900.560342:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802200, rc 0) 00000100:00100000:0.0:1782759900.560536:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+9:117134:x1869355218660480:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 769us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759900.560544:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3179 00000100:00100000:2.0:1782759900.569322:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759900.569460:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218660608 00000100:00100000:3.0:1782759900.569470:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218660608 00000100:00100000:3.0:1782759900.569533:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3180 00000100:00100000:3.0:1782759900.569544:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+9:117134:x1869355218660608:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759900.569563:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759900.569624:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e5af lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2793b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759900.569682:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e5b6 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759900.569701:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e5b6 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759900.569714:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e5b6 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759900.569767:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759900.569771:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1782759900.569813:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e5af lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2793b expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759900.569834:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e5b6 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2793b expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759900.569843:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:3.0:1782759900.569845:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782759900.569850:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7800, rc 0) 00000100:00100000:3.0:1782759900.569933:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+10:117134:x1869355218660608:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 390us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759900.569941:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3180 00000100:00100000:3.0:1782759900.576353:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759900.576568:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218660736 00000100:00100000:2.0:1782759900.576618:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218660736 00000100:00100000:2.0:1782759900.576689:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 426 00000100:00100000:2.0:1782759900.576701:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95b27dde-c150-4adf-930b-37620c52929b+9:2405:x1869355218660736:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782759900.576716:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759900.576738:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802200/0xd5b45c7f5c60e5a8 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27934 expref: 9 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759900.576755:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a200) 00010000:00010000:2.0:1782759900.576764:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759900.576811:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95b27dde-c150-4adf-930b-37620c52929b+8:2405:x1869355218660736:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 115us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759900.576818:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 426 00000100:00100000:2.0:1782759900.606910:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759900.608000:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218660992 00000100:00100000:0.0:1782759900.608014:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218660992 00000100:00100000:0.0:1782759900.608085:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3181 00000100:00100000:0.0:1782759900.608096:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+8:117136:x1869355218660992:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759900.608152:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759900.608181:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e58c lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2792d expref: 8 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759900.608201:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:0.0:1782759900.608206:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759900.608313:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:117136:x1869355218660992:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 218us (1412us total) trans 0 rc -13/-13 00000100:00100000:0.0:1782759900.608321:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3181 00000100:00100000:0.0:1782759900.636241:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759900.636439:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218661248 00000100:00100000:1.0:1782759900.636449:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218661248 00000100:00100000:1.0:1782759900.636507:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3182 00000100:00100000:1.0:1782759900.636517:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+10:117137:x1869355218661248:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759900.636570:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759900.636627:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e5b6 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2793b expref: 10 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759900.636648:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:1.0:1782759900.636652:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759900.636726:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+9:117137:x1869355218661248:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 210us (494us total) trans 0 rc -13/-13 00000100:00100000:1.0:1782759900.636732:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3182 00010000:00010000:2.0:1782759901.137396:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759901.509094:0:164687:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe668f0d80 20000000:00000080:0.0:1782759901.509113:0:164687:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc457ac00 uarg=0000000000000000 00010000:00010000:0.0:1782759901.520727:0:164687:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759901.520753:0:164687:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759901.520775:0:164687:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759901.520787:0:164687:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759901.520808:0:164687:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759901.520829:0:164687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759901.520846:0:164687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759901.520854:0:164687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759901.520892:0:164687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759901.520907:0:164687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 23 pid: 6525 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759901.520922:0:164687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164687:1869355233185536:0@lo:104: 00000100:00100000:0.0:1782759901.520987:0:164687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759901.521042:0:164687:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc1fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759901.521370:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185536 00000100:00100000:2.0:1782759901.521378:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185536 00000100:00100000:2.0:1782759901.521470:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:2.0:1782759901.521495:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:164687:x1869355233185536:12345-0@lo:104: 00010000:00010000:2.0:1782759901.521542:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.521668:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759901.521674:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:164687:x1869355233185536:12345-0@lo:104: Request processed in 184us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759901.521681:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1782759901.521965:0:164687:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:164687:1869355233185536:0@lo:104: 00010000:00010000:0.0:1782759901.521996:0:164687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522544:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759901.522552:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522560:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759901.522564:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522605:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759901.522614:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759901.522620:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759901.522658:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522664:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759901.522693:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522701:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649200/0xd5b45c7f5c60e569 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e570 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522716:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759901.522718:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759901.522719:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759901.522727:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759901.522740:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233185664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759901.522789:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759901.522828:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185664 00000100:00100000:3.0:1782759901.522833:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185664 00010000:00010000:3.0:1782759901.522906:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 24 pid: 6525 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759901.522934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:3.0:1782759901.522943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec76bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233185664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759901.522955:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759901.522960:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 24 pid: 6525 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522971:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 24 pid: 6525 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522984:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e570 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e569 expref: 24 pid: 6525 timeout: 4091 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.522996:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523004:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523017:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523025:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523031:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523037:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523042:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759901.523046:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523053:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523064:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.523073:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759901.523107:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec76bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233185664:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759901.523113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:1.0:1782759901.523556:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233185664:0@lo:103:ldlm_bl.0 00000004:00080000:1.0:1782759901.524495:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 111 committed 00000001:00080000:1.0:1782759901.524535:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968054 is committed 00000004:00080000:1.0:1782759901.524541:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 110 committed 00010000:00010000:2.0:1782759901.524603:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.524615:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.524623:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.524629:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759901.524634:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.524641:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.524656:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0ad00) 00010000:00010000:2.0:1782759901.524660:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759901.524664:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759901.524673:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e500 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759901.524851:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233185792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782759901.524911:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782759901.525052:0:164687:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759901.525066:0:164687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759901.525072:0:164687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e5bd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 164687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759901.525677:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185792 00000100:00100000:2.0:1782759901.525686:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185792 00000100:00100000:2.0:1782759901.525752:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1782759901.525770:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233185792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782759901.526000:0:82628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782759901.526004:0:82628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1782759891 -> 1782759891 00002000:00010000:2.0:1782759901.526006:0:82628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1782759891 -> 1782759891 00002000:00010000:2.0:1782759901.526009:0:82628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1782759891 -> 1782759891 00002000:00010000:2.0:1782759901.526011:0:82628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1782759901.526068:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3663:x1869355233185792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (1157us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1782759901.526076:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:3.0:1782759901.526263:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1782759901.526317:0:3663:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc4d04e00/2, rc 0, transno 4294967454 00000100:00100000:1.0:1782759901.526325:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233185792:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1782759901.599010:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967801 is committed 00010000:00010000:3.0:1782759901.599055:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.599068:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 2/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.599077:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.599082:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759901.599087:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.599094:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 4/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.599110:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdecda0a700) 00010000:00010000:3.0:1782759901.599113:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1782759901.599118:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 2/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759901.603365:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e507 lrc: 0/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759902.165445:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782759902.603837:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1782759902.603845:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:3.0:1782759902.603851:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1782759902.603896:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759902.603920:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759902.603931:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759902.603957:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233185920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782759902.604021:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759902.604082:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37480 going to sleep for 11 seconds 00000100:00100000:2.0:1782759902.604232:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233185920 00000100:00100000:2.0:1782759902.604240:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233185920 00000100:00100000:2.0:1782759902.604311:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3587 00000100:00100000:2.0:1782759902.604322:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233185920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759902.604336:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759902.604351:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e5c4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759902.604373:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759902.604383:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759902.604393:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759902.604435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233185920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759902.604441:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3587 00000100:00100000:3.0:1782759902.604796:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233185920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759902.604810:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759902.604819:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759902.604838:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759902.604844:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759902.604852:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759903.116203:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759903.116226:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233186048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759903.116310:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759903.116513:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186048 00000100:00100000:3.0:1782759903.116521:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186048 00000100:00100000:3.0:1782759903.116620:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:3.0:1782759903.116630:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233186048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759903.116674:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1782759903.116728:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233186048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759903.116735:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1782759903.116882:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233186048:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759903.178917:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759904.138953:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233186560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139034:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139086:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233187072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139109:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139123:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233187584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139140:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139174:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1782759904.139180:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233186176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139204:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139222:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233186688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139265:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139281:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233187200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139311:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139324:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233187712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139342:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139362:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233186304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139381:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139394:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233186816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139409:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139420:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233187328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139439:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139463:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759904.139468:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233186432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139488:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139502:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233186944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139517:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139529:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233187456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139545:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759904.139569:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186560 00000100:00100000:0.0:1782759904.139600:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186560 00000100:00100000:0.0:1782759904.139631:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186304 00000100:00100000:0.0:1782759904.139633:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186304 00000100:00100000:0.0:1782759904.139642:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186816 00000100:00100000:0.0:1782759904.139644:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186816 00000100:00100000:0.0:1782759904.139662:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187328 00000100:00100000:0.0:1782759904.139664:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187328 00000100:00100000:0.0:1782759904.139676:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186944 00000100:00100000:0.0:1782759904.139678:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186944 00000100:00100000:0.0:1782759904.139689:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187456 00000100:00100000:0.0:1782759904.139691:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187456 00000100:00100000:0.0:1782759904.139706:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5648 00000100:00100000:0.0:1782759904.139713:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139758:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233186560:12345-0@lo:400:kworker.0 Request processed in 45us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.139764:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5648 00000100:00100000:0.0:1782759904.139779:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5649 00000100:00100000:0.0:1782759904.139784:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233186304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139807:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233186304:12345-0@lo:400:kworker.0 Request processed in 22us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.139812:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5649 00000100:00100000:0.0:1782759904.139821:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5650 00000100:00100000:0.0:1782759904.139826:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233186816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139844:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233186816:12345-0@lo:400:kworker.0 Request processed in 19us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.139850:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5650 00000100:00100000:0.0:1782759904.139857:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5651 00000100:00100000:0.0:1782759904.139862:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233187328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139881:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233187328:12345-0@lo:400:kworker.0 Request processed in 20us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.139887:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5651 00000100:00100000:0.0:1782759904.139896:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5652 00000100:00100000:0.0:1782759904.139900:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233186944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139935:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233186944:12345-0@lo:400:kworker.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.139941:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5652 00000100:00100000:0.0:1782759904.139951:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5653 00000100:00100000:0.0:1782759904.139956:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233187456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.139975:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233187456:12345-0@lo:400:kworker.0 Request processed in 19us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.139980:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5653 00000100:00100000:0.0:1782759904.139995:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187072 00000100:00100000:0.0:1782759904.139998:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187072 00000100:00100000:0.0:1782759904.140020:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187584 00000100:00100000:0.0:1782759904.140022:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187584 00000100:00100000:0.0:1782759904.140030:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187200 00000100:00100000:0.0:1782759904.140032:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187200 00000100:00100000:0.0:1782759904.140048:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187712 00000100:00100000:0.0:1782759904.140050:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187712 00000100:00100000:0.0:1782759904.140059:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1782759904.140064:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233187072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140102:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233187072:12345-0@lo:400:kworker.0 Request processed in 37us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140107:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3338 00000100:00100000:0.0:1782759904.140117:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1782759904.140121:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233187584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140140:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233187584:12345-0@lo:400:kworker.0 Request processed in 19us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140146:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3339 00000100:00100000:0.0:1782759904.140153:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3340 00000100:00100000:0.0:1782759904.140158:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233187200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140176:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233187200:12345-0@lo:400:kworker.0 Request processed in 18us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140181:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3340 00000100:00100000:0.0:1782759904.140189:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3341 00000100:00100000:0.0:1782759904.140193:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233187712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140211:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233187712:12345-0@lo:400:kworker.0 Request processed in 18us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140219:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3341 00000100:00100000:0.0:1782759904.140236:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186176 00000100:00100000:0.0:1782759904.140239:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186176 00000100:00100000:0.0:1782759904.140271:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3588 00000100:00100000:0.0:1782759904.140278:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233186176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140302:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233186176:12345-0@lo:400:kworker.0 Request processed in 25us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3588 00000100:00100000:0.0:1782759904.140332:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186688 00000100:00100000:0.0:1782759904.140335:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186688 00000100:00100000:0.0:1782759904.140366:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233186432 00000100:00100000:0.0:1782759904.140368:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233186432 00000100:00100000:0.0:1782759904.140377:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3602 00000100:00100000:0.0:1782759904.140381:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233186688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140406:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233186688:12345-0@lo:400:kworker.0 Request processed in 24us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140411:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3602 00000100:00100000:0.0:1782759904.140420:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603 00000100:00100000:0.0:1782759904.140424:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec929f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233186432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140444:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec929f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233186432:12345-0@lo:400:kworker.0 Request processed in 20us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.140450:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603 00000100:00080000:0.0:1782759904.140743:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759904.140747:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759904.140750:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759904.140752:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759904.140786:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233186432:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140798:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233186944:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140806:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233187456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140817:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233186304:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140825:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233186816:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140833:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233187328:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140865:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233186176:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140874:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233186688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140884:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233187200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140893:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233187712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140902:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233186560:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140911:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bbb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233187072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759904.140920:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233187584:0@lo:400:kworker.0 00010000:00010000:1.0:1782759904.206926:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759904.651233:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233187840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782759904.651305:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759904.651404:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187840 00000100:00100000:1.0:1782759904.651412:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187840 00000100:00100000:1.0:1782759904.651459:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1782759904.651467:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233187840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759904.651498:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759904.651553:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233187840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759904.651560:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2920 00000100:00100000:1.0:1782759904.651629:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233187840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759904.659285:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759904.659305:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233187968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759904.659364:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759904.659415:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233187968 00000100:00100000:3.0:1782759904.659423:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233187968 00000100:00100000:3.0:1782759904.659466:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1782759904.659474:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233187968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759904.659499:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759904.659545:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233187968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759904.659552:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2921 00000100:00100000:3.0:1782759904.661982:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233187968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759904.982170:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759904.982418:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218661376 00000100:00100000:0.0:1782759904.982428:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218661376 00000100:00100000:0.0:1782759904.982491:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3183 00000100:00100000:0.0:1782759904.982500:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:117211:x1869355218661376:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759904.982519:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759904.982590:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e5d2 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27942 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982647:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982658:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982667:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982684:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982689:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982693:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982763:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982771:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982777:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759904.982817:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:0.0:1782759904.982821:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759904.982841:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982855:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982864:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982870:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982875:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982880:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982886:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759904.982890:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982896:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982908:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdecda0a100) 00010000:00010000:0.0:1782759904.982911:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759904.982914:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982919:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e5d9 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982933:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982939:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982944:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982948:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759904.982951:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982956:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982962:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cdecda0a300) 00010000:00010000:0.0:1782759904.982964:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759904.982966:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982970:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e5e0 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.982998:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e5d2 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27942 expref: 7 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1782759904.983111:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782759904.983404:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27942 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.983414:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0af00) 00010000:00010000:0.0:1782759904.983416:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759904.983419:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802400, rc 0) 00000100:00100000:0.0:1782759904.984106:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+6:117211:x1869355218661376:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1604us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759904.984115:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3183 00000100:00100000:3.0:1782759904.992485:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759904.992548:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218661632 00000100:00100000:0.0:1782759904.992556:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218661632 00000100:00100000:0.0:1782759904.992622:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3184 00000100:00100000:0.0:1782759904.992629:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:117211:x1869355218661632:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:0.0:1782759904.992677:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759904.992703:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e5e7 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27942 expref: 6 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.992716:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0af00) 00010000:00010000:0.0:1782759904.992724:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759904.992743:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,1 mode: --/PW res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.992752:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.992758:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782759904.993002:0:8593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].40, 88 off10968 00000004:00080000:0.0:1782759904.993016:0:8593:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3945269437952ns, next at 3946269430673ns, rc = 0 00000004:00010000:0.0:1782759904.993061:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071b43972 reply state 00000000c87c0d36 transno 4294968055 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.993072:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759904.993081:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:0.0:1782759904.993083:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1782759904.993086:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759904.993190:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:117211:x1869355218661632:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 559us (712us total) trans 4294968055 rc 0/0 00000100:00100000:0.0:1782759904.993198:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3184 00000100:00100000:2.0:1782759905.018745:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759905.019423:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218661760 00000100:00100000:3.0:1782759905.019432:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218661760 00000100:00100000:3.0:1782759905.019488:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3185 00000100:00100000:3.0:1782759905.019495:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:117212:x1869355218661760:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759905.019516:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759905.019537:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e5f5 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27949 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019745:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019757:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019766:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019803:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019808:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019812:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019865:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e60a lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019870:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e60a lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019874:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e60a lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759905.019891:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e60a lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019902:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019906:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019910:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019914:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019917:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759905.019920:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019925:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019932:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdee7e02c00) 00010000:00010000:3.0:1782759905.019934:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759905.019937:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019940:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e5fc lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019947:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019951:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019954:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019957:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759905.019958:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019961:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019965:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cdee7e02d00) 00010000:00010000:3.0:1782759905.019966:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759905.019968:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019971:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e603 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.019991:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e5f5 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27949 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.020005:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e60a lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27949 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.020011:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdee7e02200) 00010000:00010000:3.0:1782759905.020013:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782759905.020016:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7600, rc 0) 00000100:00100000:3.0:1782759905.020081:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:117212:x1869355218661760:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 584us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759905.020088:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3185 00000100:00100000:0.0:1782759905.029887:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759905.029921:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759905.030007:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218661888 00000100:00100000:2.0:1782759905.030029:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218661888 00000100:00100000:2.0:1782759905.030109:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3186 00000100:00100000:2.0:1782759905.030129:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:117212:x1869355218661888:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759905.030150:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759905.030212:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e611 lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27950 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759905.030292:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e618 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759905.030306:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e618 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759905.030319:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e618 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759905.030377:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759905.030382:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1782759905.030420:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e611 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27950 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759905.030436:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e618 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27950 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759905.030445:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:2.0:1782759905.030448:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782759905.030451:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648200, rc 0) 00000100:00100000:2.0:1782759905.030514:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+6:117212:x1869355218661888:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 397us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759905.030521:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3186 00000100:00100000:1.0:1782759905.030732:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218662016 00000100:00100000:1.0:1782759905.030738:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218662016 00000100:00100000:1.0:1782759905.030784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 427 00000100:00100000:1.0:1782759905.030793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95b27dde-c150-4adf-930b-37620c52929b+8:2402:x1869355218662016:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782759905.030804:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759905.030824:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e60a lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27949 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.030836:0:6516:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cdee7e02200) 00010000:00010000:1.0:1782759905.030847:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759905.030875:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2402:x1869355218662016:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 83us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759905.030882:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 427 00000100:00080000:0.0:1782759905.033241:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1782759905.038322:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759905.038568:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218662272 00000100:00100000:1.0:1782759905.038599:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218662272 00000100:00100000:1.0:1782759905.038650:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3187 00000100:00100000:1.0:1782759905.038660:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:117212:x1869355218662272:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759905.038709:0:8593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759905.038734:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cdedf648200/0xd5b45c7f5c60e618 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27950 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.038750:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:1.0:1782759905.038759:0:8593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759905.038783:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,1 mode: --/PW res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.038795:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.038803:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759905.039002:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000261b7ff6 reply state 0000000055686d8a transno 4294967802 ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,1 mode: PW/PW res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.039033:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.039039:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:1.0:1782759905.039042:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1782759905.039044:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759905.039051:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782759905.039136:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+7:117212:x1869355218662272:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 477us (825us total) trans 4294967802 rc 0/0 00000100:00100000:1.0:1782759905.039143:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3187 00000100:00100000:1.0:1782759905.048815:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759905.048853:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218662528 00000100:00100000:1.0:1782759905.048863:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218662528 00000100:00100000:1.0:1782759905.048921:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3188 00000100:00100000:1.0:1782759905.048932:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:117212:x1869355218662528:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759905.048955:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759905.048978:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e626 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27957 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049074:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049087:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049100:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049114:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049121:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049127:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049180:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e63b lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049187:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e63b lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049194:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e63b lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049210:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049216:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049221:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049227:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049233:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759905.049238:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049245:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049269:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759905.049272:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759905.049279:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049286:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e62d lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049297:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049305:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049312:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049316:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759905.049319:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049324:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049331:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xf111c33b (ffff8cddc34f6500) 00010000:00010000:1.0:1782759905.049334:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759905.049337:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049342:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e634 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xf111c33b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049378:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e626 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27957 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049392:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e63b lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27957 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.049400:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6100) 00010000:00010000:1.0:1782759905.049403:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759905.049405:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759905.049461:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:117212:x1869355218662528:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 530us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759905.049468:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3188 00000100:00100000:0.0:1782759905.056464:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759905.056514:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759905.056548:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218662912 00000100:00100000:0.0:1782759905.056557:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218662912 00000100:00100000:0.0:1782759905.056635:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 428 00000100:00100000:0.0:1782759905.056645:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95b27dde-c150-4adf-930b-37620c52929b+8:2404:x1869355218662912:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759905.056660:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759905.056683:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e63b lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27957 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759905.056699:0:9534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6100) 00010000:00010000:0.0:1782759905.056709:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759905.056768:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95b27dde-c150-4adf-930b-37620c52929b+7:2404:x1869355218662912:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 124us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759905.056776:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 428 00000100:00100000:1.0:1782759905.057638:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218662784 00000100:00100000:1.0:1782759905.057647:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218662784 00000100:00100000:1.0:1782759905.057690:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3189 00000100:00100000:1.0:1782759905.057701:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:117212:x1869355218662784:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759905.057724:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759905.057743:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e642 lrc: 2/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2795e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759905.057843:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1782759905.057950:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e642 lrc: 1/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2795e expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.057963:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:1.0:1782759905.057965:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759905.057969:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e642 lrc: 0/0,0 mode: --/CR res: [0x240000406:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2795e expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.057980:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413000, rc 0) 00000100:00100000:1.0:1782759905.058031:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+8:117212:x1869355218662784:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 332us (1684us total) trans 4294967803 rc 301/301 00000100:00100000:1.0:1782759905.058039:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3189 00000100:00100000:3.0:1782759905.064853:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759905.064891:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663168 00000100:00100000:3.0:1782759905.064901:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663168 00000100:00100000:3.0:1782759905.064953:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 473 00000100:00100000:3.0:1782759905.064963:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+8:117212:x1869355218663168:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759905.067230:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+9:117212:x1869355218663168:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 2258us (2376us total) trans 4294967804 rc 0/0 00000100:00100000:3.0:1782759905.067244:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 473 00000100:00100000:3.0:1782759905.071451:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759905.072180:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663296 00000100:00100000:1.0:1782759905.072192:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663296 00000100:00100000:1.0:1782759905.072260:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3190 00000100:00100000:1.0:1782759905.072276:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+9:117212:x1869355218663296:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759905.072302:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759905.072379:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e650 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27965 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.072441:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e657 lrc: 3/1,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.072454:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e657 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.072464:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e657 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759905.072503:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240000406:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759905.072506:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759905.072524:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e657 lrc: 3/1,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.072548:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e650 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27965 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.072568:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e657 lrc: 3/0,0 mode: PR/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27965 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759905.072595:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:1.0:1782759905.072598:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782759905.072603:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759905.072658:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+10:117212:x1869355218663296:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 388us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759905.072665:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3190 00000100:00100000:3.0:1782759905.078440:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759905.079724:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663424 00000100:00100000:1.0:1782759905.079737:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663424 00000100:00100000:1.0:1782759905.079798:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 474 00000100:00100000:1.0:1782759905.079808:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+10:117212:x1869355218663424:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:0.0:1782759905.102604:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+10:117212:x1869355218663424:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 22759us (24134us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759905.102620:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 474 00000100:00100000:1.0:1782759905.141149:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759905.142435:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663552 00000100:00100000:3.0:1782759905.142449:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663552 00000100:00100000:3.0:1782759905.142566:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3191 00000100:00100000:3.0:1782759905.142601:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:117214:x1869355218663552:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:3.0:1782759905.142623:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759905.142647:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e65e lrc: 2/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2796c expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142711:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142726:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142740:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142754:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 3/1,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142761:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142766:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142849:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142859:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142866:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759905.142913:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x2:0x0]: returning size 0 00000004:00200000:3.0:1782759905.142918:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759905.142939:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142949:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142959:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142969:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142976:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142983:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.142989:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759905.142993:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143001:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143022:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0x0 (ffff8cdee7e02c00) 00010000:00010000:3.0:1782759905.143025:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759905.143030:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143037:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e665 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143051:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143057:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143064:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143069:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759905.143071:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143077:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143084:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x1:0x0].0xd62b37d5 (ffff8cdee7e02d00) 00010000:00010000:3.0:1782759905.143087:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759905.143089:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 2/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143095:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e66c lrc: 0/0,0 mode: --/PR res: [0x200000422:0x1:0x0].0xd62b37d5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143126:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e65e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2796c expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143141:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2796c expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759905.143148:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:3.0:1782759905.143150:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782759905.143153:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7600, rc 0) 00000100:00100000:3.0:1782759905.143446:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:117214:x1869355218663552:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 868us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759905.143455:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3191 00010000:00010000:0.0:1782759905.226841:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759905.502429:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759905.502479:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759905.502608:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663808 00000100:00100000:0.0:1782759905.502618:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663808 00000100:00100000:0.0:1782759905.502703:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3342 00000100:00100000:0.0:1782759905.502714:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218663808:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759905.502790:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218663808:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759905.502799:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3342 00000100:00100000:3.0:1782759905.502943:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663680 00000100:00100000:3.0:1782759905.502949:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663680 00000100:00100000:3.0:1782759905.502991:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3589 00000100:00100000:3.0:1782759905.503000:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218663680:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759905.503031:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218663680:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 32us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759905.503038:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3589 00000100:00080000:1.0:1782759905.503760:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759905.678959:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759905.679036:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233188096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759905.679234:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759905.681130:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233188352:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759905.681214:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759905.681471:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188352 00000100:00100000:3.0:1782759905.681482:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188352 00000100:00100000:3.0:1782759905.681545:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2922 00000100:00100000:3.0:1782759905.681555:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233188352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759905.681617:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759905.681667:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233188352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759905.681674:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2922 00000100:00100000:1.0:1782759905.681769:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233188352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759905.681858:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759905.681870:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233188224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759905.681902:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759905.681949:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188096 00000100:00100000:0.0:1782759905.681954:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188096 00000100:00100000:0.0:1782759905.682043:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604 00000100:00100000:0.0:1782759905.682051:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233188096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759905.682081:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759905.682133:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233188096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759905.682140:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604 00000100:00100000:3.0:1782759905.682830:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188224 00000100:00100000:3.0:1782759905.682838:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188224 00000100:00100000:3.0:1782759905.682880:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2923 00000100:00100000:3.0:1782759905.682888:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233188224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759905.682903:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759905.682966:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233188224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759905.682973:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2923 00000100:00100000:2.0:1782759905.683075:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233188096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759905.683185:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233188224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759906.261133:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759907.276394:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759907.735450:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967454 is committed 00000100:00100000:1.0:1782759908.235698:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759908.235724:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233188480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759908.235797:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759908.235909:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188480 00000100:00100000:2.0:1782759908.235917:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188480 00000100:00100000:2.0:1782759908.236001:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:2.0:1782759908.236012:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233188480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759908.236047:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759908.236110:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233188480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759908.236118:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:2.0:1782759908.236162:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233188480:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759908.300714:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759909.258941:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233188864:0@lo:400:kworker.0 00000100:00100000:3.0:1782759909.259024:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.259145:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233188736:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.259180:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.259229:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759909.259237:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233188608:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.259266:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.259336:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188864 00000100:00100000:2.0:1782759909.259344:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188864 00000100:00100000:2.0:1782759909.259426:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3606 00000100:00100000:2.0:1782759909.259438:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233188864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.259536:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188608 00000100:00100000:0.0:1782759909.259541:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188608 00000100:00100000:0.0:1782759909.259571:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3590 00000100:00100000:0.0:1782759909.259609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233188608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.259648:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233188608:12345-0@lo:400:kworker.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.259655:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3590 00000100:00100000:0.0:1782759909.259703:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233188608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.259736:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188736 00000100:00100000:0.0:1782759909.259740:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188736 00000100:00100000:0.0:1782759909.259765:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5654 00000100:00100000:0.0:1782759909.259770:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233188736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.259798:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233188736:12345-0@lo:400:kworker.0 Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.259804:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5654 00000100:00100000:0.0:1782759909.259828:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233188736:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.262159:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233188992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.262249:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759909.262338:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233188992 00000100:00100000:0.0:1782759909.262346:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233188992 00000100:00100000:0.0:1782759909.262403:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5655 00000100:00100000:0.0:1782759909.262412:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233188992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.262465:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233188992:12345-0@lo:400:kworker.0 Request processed in 54us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.262472:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5655 00000100:00100000:0.0:1782759909.262515:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233188992:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.267722:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233188864:12345-0@lo:400:kworker.0 Request processed in 8275us (8686us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759909.267739:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3606 00000100:00100000:2.0:1782759909.268056:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233189120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.268140:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.268174:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233189632:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.268199:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.268232:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233190144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.268254:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.268273:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782759909.268278:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233189248:0@lo:400:kworker.0 00000100:00100000:1.0:1782759909.268635:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189120 00000100:00100000:1.0:1782759909.268644:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189120 00000100:00100000:1.0:1782759909.268700:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:1.0:1782759909.268709:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233189120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759909.268764:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233189120:12345-0@lo:400:kworker.0 Request processed in 57us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759909.268770:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1782759909.268879:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.268897:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233189760:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.268918:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759909.268952:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233189120:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.268991:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189248 00000100:00100000:2.0:1782759909.268995:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189248 00000100:00100000:2.0:1782759909.269027:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189760 00000100:00100000:2.0:1782759909.269030:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189760 00000100:00100000:2.0:1782759909.269053:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5656 00000100:00100000:2.0:1782759909.269073:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233189248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.269106:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233189248:12345-0@lo:400:kworker.0 Request processed in 36us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759909.269112:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5656 00000100:00100000:2.0:1782759909.269122:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5657 00000100:00100000:2.0:1782759909.269128:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233189760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.269152:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233189760:12345-0@lo:400:kworker.0 Request processed in 25us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759909.269157:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5657 00000100:00080000:2.0:1782759909.269173:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759909.269192:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233189248:0@lo:400:kworker.0 00000100:00100000:2.0:1782759909.269202:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233189760:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.269882:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189632 00000100:00100000:0.0:1782759909.269889:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189632 00000100:00100000:0.0:1782759909.269940:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190144 00000100:00100000:0.0:1782759909.269943:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190144 00000100:00100000:0.0:1782759909.269960:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3343 00000100:00100000:0.0:1782759909.269967:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233189632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270018:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233189632:12345-0@lo:400:kworker.0 Request processed in 52us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.270025:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3343 00000100:00100000:0.0:1782759909.270037:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3344 00000100:00100000:0.0:1782759909.270042:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233190144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270081:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233190144:12345-0@lo:400:kworker.0 Request processed in 39us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.270086:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3344 00000100:00100000:0.0:1782759909.270126:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233189504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270154:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759909.270176:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233190016:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270196:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759909.270230:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782759909.270238:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233189376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270262:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759909.270279:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233189888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270315:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759909.270342:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189504 00000100:00100000:0.0:1782759909.270345:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189504 00000100:00100000:0.0:1782759909.270562:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190016 00000100:00100000:0.0:1782759909.270565:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190016 00000100:00100000:0.0:1782759909.270611:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3345 00000100:00100000:0.0:1782759909.270618:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233189504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270653:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233189504:12345-0@lo:400:kworker.0 Request processed in 35us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.270661:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3345 00000100:00100000:0.0:1782759909.270673:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3346 00000100:00100000:0.0:1782759909.270678:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233190016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270702:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233190016:12345-0@lo:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.270707:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3346 00000100:00100000:0.0:1782759909.270727:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189376 00000100:00100000:0.0:1782759909.270729:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189376 00000100:00100000:0.0:1782759909.270753:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233189888 00000100:00100000:0.0:1782759909.270755:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233189888 00000100:00100000:0.0:1782759909.270770:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5658 00000100:00100000:0.0:1782759909.270776:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233189376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270806:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233189376:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.270811:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5658 00000100:00100000:0.0:1782759909.270822:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5659 00000100:00100000:0.0:1782759909.270827:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233189888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270850:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233189888:12345-0@lo:400:kworker.0 Request processed in 23us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.270856:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5659 00000100:00100000:0.0:1782759909.270904:0:3664:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967454 gen 2 00000004:00080000:0.0:1782759909.270910:0:3664:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc4d04e00, transno 4294967454 00000100:00100000:0.0:1782759909.270924:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233189632:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.270939:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233190144:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.271081:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233189376:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.271091:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233189888:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.271099:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233189504:0@lo:400:kworker.0 00000100:00100000:0.0:1782759909.271106:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233190016:0@lo:400:kworker.0 00000100:00080000:2.0:1782759909.271621:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759909.271628:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759909.271630:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759909.271730:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233188864:0@lo:400:kworker.0 00010000:00010000:3.0:1782759909.323610:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759909.772614:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233190272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759909.772687:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759909.772781:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190272 00000100:00100000:3.0:1782759909.772791:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190272 00000100:00100000:3.0:1782759909.772839:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2924 00000100:00100000:3.0:1782759909.772849:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233190272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759909.772882:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759909.773021:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759909.773034:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233190400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759909.773065:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759909.776034:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190400 00000100:00100000:0.0:1782759909.776055:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190400 00000100:00100000:0.0:1782759909.776134:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1782759909.776145:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233190400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759909.776173:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759909.776271:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233190400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (3204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759909.776279:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2925 00000100:00100000:0.0:1782759909.776606:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233190400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759909.776832:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233190272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3983us (4142us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759909.776902:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2924 00000100:00100000:1.0:1782759909.777365:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233190272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759910.348741:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759910.633792:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759910.633829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759910.633851:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759910.633874:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759910.633902:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664192 00000100:00100000:3.0:1782759910.633910:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664192 00000100:00100000:3.0:1782759910.633973:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664064 00000100:00100000:3.0:1782759910.633976:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664064 00000100:00100000:3.0:1782759910.633998:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5660 00000100:00100000:3.0:1782759910.634008:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+10:2402:x1869355218664192:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759910.634078:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+10:2402:x1869355218664192:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759910.634085:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5660 00000100:00100000:3.0:1782759910.634100:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5661 00000100:00100000:3.0:1782759910.634106:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+8:2402:x1869355218664064:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759910.634140:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+8:2402:x1869355218664064:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759910.634146:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5661 00000100:00100000:3.0:1782759910.634167:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664320 00000100:00100000:3.0:1782759910.634170:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664320 00000100:00100000:3.0:1782759910.634198:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3347 00000100:00100000:3.0:1782759910.634215:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218664320:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759910.634249:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218664320:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759910.634255:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3347 00000100:00100000:2.0:1782759910.634556:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218663936 00000100:00100000:2.0:1782759910.634561:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218663936 00000100:00100000:2.0:1782759910.634621:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3591 00000100:00100000:2.0:1782759910.634631:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218663936:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759910.634666:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218663936:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759910.634672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3591 00000100:00080000:2.0:1782759910.634700:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759910.634705:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759910.634707:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1782759910.795168:0:8598:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3951071587669ns, next at 3952071585138ns, rc = 0 00000100:00100000:2.0:1782759910.795211:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759910.795233:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233190528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759910.795308:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759910.795513:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190528 00000100:00100000:2.0:1782759910.795521:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190528 00000100:00100000:2.0:1782759910.795623:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1782759910.795635:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233190528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759910.795666:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759910.795718:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233190528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759910.795726:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2926 00000100:00100000:2.0:1782759910.795839:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233190528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759910.796907:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233190656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759910.797029:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759910.800172:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190656 00000100:00100000:0.0:1782759910.800186:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190656 00000100:00100000:0.0:1782759910.800269:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1782759910.800280:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233190656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759910.800321:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759910.801546:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233190656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1265us (4513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759910.801557:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1782759910.801670:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233190784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759910.801725:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759910.802885:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190784 00000100:00100000:2.0:1782759910.802896:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190784 00000100:00100000:2.0:1782759910.802962:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2927 00000100:00100000:2.0:1782759910.802974:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233190784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759910.802999:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759910.803065:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233190784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759910.803072:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2927 00000100:00100000:2.0:1782759910.803121:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233190784:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1782759910.804833:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 113 committed 00000001:00080000:2.0:1782759910.804869:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968055 is committed 00000004:00080000:2.0:1782759910.804876:0:6509:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 112 committed 00010000:00010000:2.0:1782759910.804897:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.804910:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.804919:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.804927:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759910.804931:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.804940:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.804960:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:2.0:1782759910.804963:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759910.804969:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.804975:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802800/0xd5b45c7f5c60e5ee lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759910.809758:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233190912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782759910.809838:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759910.809891:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233190912 00000100:00100000:3.0:1782759910.809898:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233190912 00000100:00100000:3.0:1782759910.809945:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1782759910.809954:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233190912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1782759910.810166:0:82628:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1782759910.810170:0:82628:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1782759891 -> 1782759891 00002000:00010000:3.0:1782759910.810172:0:82628:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1782759891 -> 1782759891 00002000:00010000:3.0:1782759910.810174:0:82628:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1782759891 -> 1782759891 00002000:00010000:3.0:1782759910.810175:0:82628:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1782759910.810233:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3662:x1869355233190912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 280us (396us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1782759910.810240:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000004:00080000:2.0:1782759910.810328:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cddc479fb80/2, rc 0, transno 4294967455 00000100:00100000:2.0:1782759910.810336:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233190912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782759910.810689:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233190656:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1782759910.813161:0:7461:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967804 is committed 00010000:00010000:2.0:1782759910.813233:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,1 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.813245:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 2/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.813258:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.813264:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759910.813268:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 3/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.813276:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 4/0,0 mode: TXN/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.813293:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:2.0:1782759910.813296:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1782759910.813300:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 2/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759910.813307:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e61f lrc: 0/0,0 mode: --/TXN res: [0x240000406:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759911.372102:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759911.864295:0:165029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdf7754050 20000000:00000080:0.0:1782759911.864318:0:165029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc3c5a400 uarg=0000000000000000 00010000:00010000:0.0:1782759911.864516:0:165029:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759911.864554:0:165029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000406:0x1:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:0.0:1782759911.864558:0:165029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782759911.864571:0:165029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e657 lrc: 0/0,0 mode: --/PR res: [0x240000406:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27965 expref: 5 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.864623:0:165029:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1782759911.864650:0:165029:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1782759911.864669:0:165029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x2:0x0].0x0 (ffff8cdecda0a800) 00010000:00010000:0.0:1782759911.864672:0:165029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782759911.864677:0:165029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7600/0xd5b45c7f5c60e673 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2796c expref: 5 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.864693:0:165029:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1782759911.864716:0:165029:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759911.864729:0:165029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.864741:0:165029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.864748:0:165029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.864786:0:165029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759911.864802:0:165029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 23 pid: 6525 timeout: 4102 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759911.864815:0:165029:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165029:1869355233191040:0@lo:104: 00000100:00100000:0.0:1782759911.864876:0:165029:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759911.864924:0:165029:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc01d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782759911.865357:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191040 00000100:00100000:1.0:1782759911.865364:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191040 00000100:00100000:1.0:1782759911.865419:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:1.0:1782759911.865430:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:165029:x1869355233191040:12345-0@lo:104: 00010000:00010000:1.0:1782759911.865444:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865513:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782759911.865519:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:165029:x1869355233191040:12345-0@lo:104: Request processed in 92us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759911.865530:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00010000:00010000:1.0:1782759911.865551:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759911.865555:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865563:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759911.865567:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865601:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759911.865609:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759911.865615:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759911.865641:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865647:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759911.865666:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865673:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdecd8a7000/0xd5b45c7f5c60e5c4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e5cb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865689:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759911.865691:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759911.865692:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759911.865717:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233191168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759911.865751:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759911.865787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191168 00000100:00100000:1.0:1782759911.865791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191168 00010000:00010000:1.0:1782759911.865808:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 24 pid: 6525 timeout: 4102 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759911.865828:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1782759911.865835:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233191168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759911.865846:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759911.865853:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 24 pid: 6525 timeout: 4102 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865865:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 24 pid: 6525 timeout: 4102 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865882:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865892:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865905:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865913:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865920:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865927:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865934:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803400 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759911.865939:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865946:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865954:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759911.865963:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759911.865997:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233191168:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759911.866004:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1782759911.866052:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233191168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759911.866931:0:165029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e5cb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e5c4 expref: 23 pid: 6525 timeout: 4102 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759911.866947:0:165029:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165029:1869355233191040:0@lo:104: 00010000:00010000:3.0:1782759911.866964:0:165029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.866975:0:165029:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.866982:0:165029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759911.866989:0:165029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803400/0xd5b45c7f5c60e67a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759912.402375:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759913.355954:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759913.356360:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233191296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759913.356446:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759913.356550:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191296 00000100:00100000:1.0:1782759913.356558:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191296 00000100:00100000:1.0:1782759913.356651:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3609 00000100:00100000:1.0:1782759913.356661:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233191296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759913.356699:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1782759913.356757:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233191296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759913.356764:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3609 00000100:00100000:1.0:1782759913.356808:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233191296:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759913.419311:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759913.611635:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759913.611644:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759913.611649:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759913.611696:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.611706:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.611715:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759913.611736:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233191424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759913.611789:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759913.611830:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191424 00000100:00100000:1.0:1782759913.611834:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc72bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759913.611837:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191424 00000100:00100000:3.0:1782759913.611930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3592 00000100:00100000:3.0:1782759913.611940:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233191424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759913.611953:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759913.611967:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e681 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.611992:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.612002:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759913.612010:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759913.612055:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233191424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759913.612065:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3592 00000100:00100000:1.0:1782759913.612259:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233191424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759913.612271:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.612277:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759913.612298:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759913.612303:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759913.612308:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759914.383846:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233191552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.383925:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.383970:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233192064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.383996:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384015:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233192576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384089:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384115:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233193088:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384136:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384159:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1782759914.384165:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233191936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384202:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384220:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233192448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384241:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384255:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233192960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384273:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384312:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233191680:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384333:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384348:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233192192:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384365:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384739:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233192704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384765:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384803:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1782759914.384810:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233191808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384838:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384854:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233192320:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384873:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384888:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233192832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.384908:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759914.384940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191552 00000100:00100000:1.0:1782759914.384948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191552 00000100:00100000:1.0:1782759914.384995:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3593 00000100:00100000:1.0:1782759914.385004:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233191552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.385056:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233191552:12345-0@lo:400:kworker.0 Request processed in 52us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.385076:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3593 00000100:00100000:1.0:1782759914.385228:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192064 00000100:00100000:1.0:1782759914.385233:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192064 00000100:00100000:1.0:1782759914.385272:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191808 00000100:00100000:1.0:1782759914.385275:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191808 00000100:00100000:1.0:1782759914.385302:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:1.0:1782759914.385308:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233192064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.385344:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233192064:12345-0@lo:400:kworker.0 Request processed in 36us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.385350:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000100:00100000:1.0:1782759914.385361:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611 00000100:00100000:1.0:1782759914.385367:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233191808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.385791:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233191808:12345-0@lo:400:kworker.0 Request processed in 422us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.385797:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611 00000100:00100000:1.0:1782759914.385818:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192576 00000100:00100000:1.0:1782759914.385821:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192576 00000100:00100000:1.0:1782759914.385856:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193088 00000100:00100000:1.0:1782759914.385859:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193088 00000100:00100000:1.0:1782759914.385871:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192448 00000100:00100000:1.0:1782759914.385874:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192448 00000100:00100000:1.0:1782759914.385887:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192960 00000100:00100000:1.0:1782759914.385889:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192960 00000100:00100000:1.0:1782759914.385900:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3348 00000100:00100000:1.0:1782759914.385906:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355233192576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.385960:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3665:x1869355233192576:12345-0@lo:400:kworker.0 Request processed in 55us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.385967:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3348 00000100:00100000:3.0:1782759914.386273:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233191808:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.386755:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3349 00000100:00100000:1.0:1782759914.386767:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233193088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.386811:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233193088:12345-0@lo:400:kworker.0 Request processed in 48us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.386817:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3349 00000100:00100000:1.0:1782759914.386831:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3350 00000100:00100000:1.0:1782759914.386837:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233192448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.386867:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233192448:12345-0@lo:400:kworker.0 Request processed in 31us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.386874:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3350 00000100:00100000:1.0:1782759914.386884:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3351 00000100:00100000:1.0:1782759914.386890:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233192960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.386916:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233192960:12345-0@lo:400:kworker.0 Request processed in 26us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.386922:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3351 00000100:00100000:1.0:1782759914.386948:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191936 00000100:00100000:1.0:1782759914.386953:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191936 00000100:00100000:1.0:1782759914.386977:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233191680 00000100:00100000:1.0:1782759914.386980:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233191680 00000100:00100000:1.0:1782759914.386992:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192192 00000100:00100000:1.0:1782759914.386995:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192192 00000100:00100000:1.0:1782759914.387007:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192704 00000100:00100000:1.0:1782759914.387009:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192704 00000100:00100000:1.0:1782759914.387028:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192320 00000100:00100000:1.0:1782759914.387031:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192320 00000100:00100000:1.0:1782759914.387042:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233192832 00000100:00100000:1.0:1782759914.387044:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233192832 00000100:00100000:1.0:1782759914.387057:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5662 00000100:00100000:1.0:1782759914.387200:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233191936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387234:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233191936:12345-0@lo:400:kworker.0 Request processed in 38us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.387240:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5662 00000100:00100000:1.0:1782759914.387251:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5663 00000100:00100000:1.0:1782759914.387256:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233191680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387404:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233191680:12345-0@lo:400:kworker.0 Request processed in 147us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.387410:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5663 00000100:00100000:1.0:1782759914.387422:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5664 00000100:00100000:1.0:1782759914.387428:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233192192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387457:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233192192:12345-0@lo:400:kworker.0 Request processed in 29us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.387462:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5664 00000100:00100000:1.0:1782759914.387483:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5665 00000100:00100000:1.0:1782759914.387489:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233192704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387515:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233192704:12345-0@lo:400:kworker.0 Request processed in 27us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.387524:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5665 00000100:00100000:1.0:1782759914.387533:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5666 00000100:00100000:1.0:1782759914.387538:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233192320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387561:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233192320:12345-0@lo:400:kworker.0 Request processed in 23us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.387567:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5666 00000100:00100000:1.0:1782759914.387598:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5667 00000100:00100000:1.0:1782759914.387604:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233192832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387632:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233192832:12345-0@lo:400:kworker.0 Request processed in 28us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759914.387649:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5667 00000100:00100000:1.0:1782759914.387719:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233191936:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387734:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233192448:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387744:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233192960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387754:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233191552:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387765:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233192064:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387777:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233192576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759914.387786:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233193088:0@lo:400:kworker.0 00000100:00080000:1.0:1782759914.387827:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759914.387831:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759914.387834:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782759914.387836:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759914.389005:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233191680:0@lo:400:kworker.0 00000100:00100000:3.0:1782759914.389020:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233192192:0@lo:400:kworker.0 00000100:00100000:3.0:1782759914.389031:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233192704:0@lo:400:kworker.0 00000100:00100000:3.0:1782759914.389055:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233192320:0@lo:400:kworker.0 00000100:00100000:3.0:1782759914.389215:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233192832:0@lo:400:kworker.0 00010000:00010000:1.0:1782759914.442789:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759914.891000:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233193216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759914.891072:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759914.891313:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193216 00000100:00100000:3.0:1782759914.891322:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193216 00000100:00100000:3.0:1782759914.891375:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1782759914.891385:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233193216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759914.891413:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759914.891461:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233193216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759914.891468:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2928 00000100:00100000:3.0:1782759914.891523:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233193216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759914.892438:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233193344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759914.892503:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759914.892549:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193344 00000100:00100000:0.0:1782759914.892568:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193344 00000100:00100000:0.0:1782759914.892613:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2929 00000100:00100000:0.0:1782759914.892744:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233193344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759914.892764:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759914.892800:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233193344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 180us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759914.892807:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2929 00000100:00100000:0.0:1782759914.892843:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233193344:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759915.466914:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759915.749393:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759915.749438:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759915.749470:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759915.749497:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759915.749524:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664448 00000100:00100000:2.0:1782759915.749535:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664448 00000100:00100000:2.0:1782759915.749614:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3594 00000100:00100000:2.0:1782759915.749624:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218664448:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759915.749691:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218664448:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759915.749699:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3594 00000100:00100000:1.0:1782759915.751235:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664832 00000100:00100000:1.0:1782759915.751246:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664832 00000100:00100000:1.0:1782759915.751342:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3352 00000100:00100000:1.0:1782759915.751350:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218664832:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759915.751401:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218664832:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 53us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759915.751408:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3352 00000100:00100000:1.0:1782759915.751429:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664576 00000100:00100000:1.0:1782759915.751432:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664576 00000100:00100000:1.0:1782759915.751454:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664704 00000100:00100000:1.0:1782759915.751456:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664704 00000100:00100000:1.0:1782759915.751472:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5668 00000100:00100000:1.0:1782759915.751477:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218664576:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759915.751500:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218664576:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 23us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759915.751506:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5668 00000100:00100000:1.0:1782759915.751515:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5669 00000100:00100000:1.0:1782759915.751520:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218664704:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759915.751537:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218664704:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 17us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759915.751542:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5669 00000100:00080000:1.0:1782759915.751566:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759915.751569:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759915.751572:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759915.914979:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233193472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759915.915067:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759915.915329:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759915.915336:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233193600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782759915.915360:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759915.916617:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782759915.916632:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233193728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759915.916677:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759915.930786:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193728 00000100:00100000:1.0:1782759915.930800:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193728 00000100:00100000:1.0:1782759915.930870:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3612 00000100:00100000:1.0:1782759915.930879:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233193728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759915.930928:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:1.0:1782759915.931029:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233193728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (14352us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759915.931036:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3612 00000100:00100000:1.0:1782759915.931277:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233193728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759915.939556:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193472 00000100:00100000:3.0:1782759915.939572:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193472 00000100:00100000:3.0:1782759915.939686:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193600 00000100:00100000:3.0:1782759915.939691:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193600 00000100:00100000:3.0:1782759915.939731:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1782759915.939742:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233193472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759915.939778:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759915.939853:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233193472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (24786us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759915.939860:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2930 00000100:00100000:3.0:1782759915.939875:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2931 00000100:00100000:3.0:1782759915.939881:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233193600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759915.939890:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759915.940049:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233193472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759915.940549:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3664:x1869355233193600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 667us (25186us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759915.940557:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2931 00000100:00100000:1.0:1782759915.940679:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233193600:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1782759916.394870:0:165273:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc313d7110 20000000:00000080:1.0:1782759916.394892:0:165273:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec1384c00 uarg=0000000000000000 00010000:00010000:1.0:1782759916.395463:0:165273:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759916.395483:0:165273:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759916.395506:0:165273:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759916.395977:0:165273:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759916.396006:0:165273:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759916.396048:0:165273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.396070:0:165273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.396079:0:165273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.396118:0:165273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.396133:0:165273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 23 pid: 6526 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759916.396148:0:165273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165273:1869355233193856:0@lo:104: 00000100:00100000:1.0:1782759916.396234:0:165273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759916.396297:0:165273:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c780c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759916.397420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193856 00000100:00100000:2.0:1782759916.397441:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193856 00000100:00100000:2.0:1782759916.397556:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1782759916.397568:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:165273:x1869355233193856:12345-0@lo:104: 00010000:00010000:2.0:1782759916.397612:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759916.397692:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759916.397699:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:165273:x1869355233193856:12345-0@lo:104: Request processed in 136us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759916.397706:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00010000:00010000:3.0:1782759916.397799:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759916.397807:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.397814:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759916.397818:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.397827:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759916.397835:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759916.397841:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759916.397884:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.397891:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759916.397925:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.397932:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5413c00/0xd5b45c7f5c60e681 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e688 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.397948:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759916.397950:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759916.397952:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759916.398204:0:165273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165273:1869355233193856:0@lo:104: 00010000:00010000:1.0:1782759916.398230:0:165273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759916.398475:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233193984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759916.398698:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759916.398797:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233193984 00000100:00100000:3.0:1782759916.398804:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233193984 00010000:00010000:3.0:1782759916.398832:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 24 pid: 6526 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759916.398866:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:3.0:1782759916.398874:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233193984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759916.398888:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759916.398894:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 24 pid: 6526 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398913:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 24 pid: 6526 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398929:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e688 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e681 expref: 24 pid: 6526 timeout: 4106 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398944:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398953:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398972:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398979:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398986:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398992:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.398999:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759916.399002:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.399009:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.399027:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759916.399037:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759916.399072:0:165273:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759916.399080:0:165273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759916.399084:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233193984:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (377us total) trans 0 rc 0/0 00010000:00010000:1.0:1782759916.399088:0:165273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413000/0xd5b45c7f5c60e68f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759916.399091:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:2.0:1782759916.399484:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233193984:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1782759916.452722:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967455 is committed 00010000:00010000:3.0:1782759916.504401:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759917.419918:0:165321:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd882e88a0 20000000:00000080:1.0:1782759917.419936:0:165321:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec1385800 uarg=0000000000000000 00010000:00010000:1.0:1782759917.420834:0:165321:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759917.420853:0:165321:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759917.420875:0:165321:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759917.420886:0:165321:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759917.420909:0:165321:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759917.420929:0:165321:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420947:0:165321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420958:0:165321:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420965:0:165321:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420972:0:165321:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420979:0:165321:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420986:0:165321:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759917.420990:0:165321:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.420998:0:165321:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.421016:0:165321:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.421024:0:165321:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.421030:0:165321:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e696 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759917.463979:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759917.463988:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759917.463993:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759917.464042:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759917.464054:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759917.464248:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759917.464836:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233194112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759917.464908:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759917.464956:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ccd900 going to sleep for 11 seconds 00000100:00100000:2.0:1782759917.465208:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194112 00000100:00100000:2.0:1782759917.465217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194112 00000100:00100000:2.0:1782759917.465287:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3595 00000100:00100000:2.0:1782759917.465298:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233194112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759917.465538:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759917.465555:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e69d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759917.465596:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759917.465609:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759917.465619:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759917.465664:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233194112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 368us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759917.465670:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3595 00000100:00100000:0.0:1782759917.465797:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233194112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759917.465812:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759917.465821:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759917.465843:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759917.465848:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759917.465856:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759917.522759:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759918.476001:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759918.476022:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233194240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759918.476160:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759918.476221:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194240 00000100:00100000:1.0:1782759918.476228:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194240 00000100:00100000:1.0:1782759918.476302:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613 00000100:00100000:1.0:1782759918.476312:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233194240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759918.476349:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:1.0:1782759918.476393:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233194240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759918.476401:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613 00000100:00100000:1.0:1782759918.476448:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233194240:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1782759918.492498:0:165369:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3db39dd0 20000000:00000080:1.0:1782759918.492722:0:165369:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec1386000 uarg=0000000000000000 00010000:00010000:1.0:1782759918.492926:0:165369:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759918.492941:0:165369:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759918.492959:0:165369:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759918.492969:0:165369:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759918.492988:0:165369:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759918.493005:0:165369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.493020:0:165369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.493029:0:165369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.493191:0:165369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.493203:0:165369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 23 pid: 6524 timeout: 4108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759918.493218:0:165369:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165369:1869355233194368:0@lo:104: 00000100:00100000:1.0:1782759918.493344:0:165369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759918.493443:0:165369:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759918.493490:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194368 00000100:00100000:3.0:1782759918.493498:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194368 00000100:00100000:3.0:1782759918.493878:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1782759918.493888:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:165369:x1869355233194368:12345-0@lo:104: 00010000:00010000:3.0:1782759918.493901:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759918.493967:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782759918.493973:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:165369:x1869355233194368:12345-0@lo:104: Request processed in 87us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759918.493980:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1782759918.494043:0:165369:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165369:1869355233194368:0@lo:104: 00010000:00010000:1.0:1782759918.494073:0:165369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494132:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759918.494148:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494156:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803400 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759918.494159:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494167:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759918.494174:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759918.494179:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759918.494219:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494225:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759918.494258:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494265:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803400/0xd5b45c7f5c60e69d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6a4 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494280:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759918.494281:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759918.494283:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759918.494294:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233194496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759918.494328:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759918.494368:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194496 00000100:00100000:2.0:1782759918.494371:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194496 00010000:00010000:2.0:1782759918.494398:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 24 pid: 6524 timeout: 4108 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759918.494419:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1782759918.494428:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233194496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759918.494439:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759918.494444:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 24 pid: 6524 timeout: 4108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494453:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 24 pid: 6524 timeout: 4108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494466:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649800/0xd5b45c7f5c60e6a4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e69d expref: 24 pid: 6524 timeout: 4108 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494477:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494485:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494498:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494505:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494524:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494530:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494535:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759918.494539:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494546:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494557:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759918.494568:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759918.494617:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233194496:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759918.494624:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1782759918.494655:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233194496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759918.494721:0:165369:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.494729:0:165369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.494735:0:165369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e6ab lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759918.538880:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759919.498911:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233194880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.498981:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759919.499034:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233195392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.499094:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759919.499143:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233195904:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.499165:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499302:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233194624:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499338:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499361:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233195136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499381:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499396:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233195648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499420:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499435:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233196160:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499453:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499469:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759919.499475:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233194752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499493:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499508:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233195264:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499526:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499539:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233195776:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499555:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759919.499710:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194624 00000100:00100000:0.0:1782759919.499717:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194624 00000100:00100000:0.0:1782759919.499763:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3596 00000100:00100000:0.0:1782759919.499772:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233194624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499824:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233194624:12345-0@lo:400:kworker.0 Request processed in 52us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.499830:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3596 00000100:00100000:0.0:1782759919.499861:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194880 00000100:00100000:0.0:1782759919.499864:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194880 00000100:00100000:0.0:1782759919.499901:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195136 00000100:00100000:0.0:1782759919.499904:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195136 00000100:00100000:0.0:1782759919.499919:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614 00000100:00100000:0.0:1782759919.499924:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233194880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.499957:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233194880:12345-0@lo:400:kworker.0 Request processed in 32us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.499963:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614 00000100:00100000:0.0:1782759919.499975:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3615 00000100:00100000:0.0:1782759919.499981:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233195136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500008:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233195136:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500013:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3615 00000100:00100000:0.0:1782759919.500030:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195648 00000100:00100000:0.0:1782759919.500033:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195648 00000100:00100000:0.0:1782759919.500064:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196160 00000100:00100000:0.0:1782759919.500067:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196160 00000100:00100000:0.0:1782759919.500085:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3353 00000100:00100000:0.0:1782759919.500091:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233195648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500120:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233195648:12345-0@lo:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500136:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3353 00000100:00100000:0.0:1782759919.500148:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3354 00000100:00100000:0.0:1782759919.500153:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233196160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500178:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233196160:12345-0@lo:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500183:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3354 00000100:00100000:3.0:1782759919.500274:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759919.500286:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233195008:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.500314:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759919.500334:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233195520:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.500355:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759919.500370:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233196032:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.500389:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759919.500413:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233194880:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.500480:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195392 00000100:00100000:3.0:1782759919.500484:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195392 00000100:00100000:3.0:1782759919.500506:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195904 00000100:00100000:3.0:1782759919.500509:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195904 00000100:00100000:3.0:1782759919.500521:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233194752 00000100:00100000:3.0:1782759919.500524:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233194752 00000100:00100000:3.0:1782759919.500534:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195264 00000100:00100000:3.0:1782759919.500536:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195264 00000100:00100000:3.0:1782759919.500545:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195776 00000100:00100000:3.0:1782759919.500547:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195776 00000100:00100000:3.0:1782759919.500557:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195008 00000100:00100000:3.0:1782759919.500559:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195008 00000100:00100000:3.0:1782759919.500570:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5670 00000100:00100000:0.0:1782759919.500714:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233195520 00000100:00100000:0.0:1782759919.500718:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233195520 00000100:00100000:0.0:1782759919.500736:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196032 00000100:00100000:0.0:1782759919.500738:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196032 00000100:00100000:0.0:1782759919.500750:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3355 00000100:00100000:0.0:1782759919.500756:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233195520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500790:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233195520:12345-0@lo:400:kworker.0 Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500799:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3355 00000100:00100000:0.0:1782759919.500811:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1782759919.500816:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233196032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500842:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233196032:12345-0@lo:400:kworker.0 Request processed in 26us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500847:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3356 00000100:00100000:0.0:1782759919.500869:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5671 00000100:00100000:0.0:1782759919.500876:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233195904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500904:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233195904:12345-0@lo:400:kworker.0 Request processed in 28us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500909:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5671 00000100:00100000:0.0:1782759919.500922:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5672 00000100:00100000:0.0:1782759919.500927:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233194752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500950:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233194752:12345-0@lo:400:kworker.0 Request processed in 24us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500955:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5672 00000100:00100000:0.0:1782759919.500965:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5673 00000100:00100000:0.0:1782759919.500970:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233195264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.500993:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233195264:12345-0@lo:400:kworker.0 Request processed in 23us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.500998:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5673 00000100:00100000:0.0:1782759919.501007:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5674 00000100:00100000:0.0:1782759919.501013:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233195776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501038:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233195776:12345-0@lo:400:kworker.0 Request processed in 25us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.501044:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5674 00000100:00100000:0.0:1782759919.501054:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5675 00000100:00100000:0.0:1782759919.501059:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233195008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501083:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233195008:12345-0@lo:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.501088:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5675 00000100:00080000:0.0:1782759919.501118:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759919.501122:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759919.501132:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759919.501135:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759919.501163:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233194752:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501175:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233195264:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501185:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233195776:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.501277:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233195392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501317:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233194624:0@lo:400:kworker.0 00000100:00100000:3.0:1782759919.501353:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233195392:12345-0@lo:400:kworker.0 Request processed in 776us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759919.501359:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5670 00000100:00100000:1.0:1782759919.501369:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233195008:0@lo:400:kworker.0 00000100:00100000:1.0:1782759919.501380:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233195520:0@lo:400:kworker.0 00000100:00100000:1.0:1782759919.501389:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233196032:0@lo:400:kworker.0 00000100:00100000:1.0:1782759919.501398:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233195392:0@lo:400:kworker.0 00000100:00100000:1.0:1782759919.501410:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233195904:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501411:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233195136:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501420:0:3662:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967455 gen 2 00000004:00080000:0.0:1782759919.501425:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cddc479fb80, transno 4294967455 00000100:00100000:0.0:1782759919.501442:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233195648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759919.501455:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233196160:0@lo:400:kworker.0 00010000:00010000:1.0:1782759919.562873:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759919.947679:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759919.947687:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759919.947692:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759919.947759:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759919.947771:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759919.947781:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759919.947808:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233196288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759919.947878:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759919.947931:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759919.948050:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196288 00000100:00100000:0.0:1782759919.948058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196288 00000100:00100000:0.0:1782759919.948115:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3597 00000100:00100000:0.0:1782759919.948134:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233196288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759919.948150:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759919.948163:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e6b2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759919.948197:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759919.948209:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759919.948218:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802200, rc 0) 00000100:00100000:0.0:1782759919.948265:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233196288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759919.948272:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3597 00000100:00100000:0.0:1782759919.948321:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233196288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759919.948337:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759919.948346:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759919.948376:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759919.948381:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759919.948389:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759920.011426:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759920.011448:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233196416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1782759920.011510:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759920.011907:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233196544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759920.011935:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759920.011994:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196416 00000100:00100000:2.0:1782759920.012001:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196416 00000100:00100000:2.0:1782759920.012048:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196544 00000100:00100000:2.0:1782759920.012051:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196544 00000100:00100000:2.0:1782759920.012073:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759920.012082:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233196416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759920.012111:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759920.012162:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233196416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759920.012169:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2932 00000100:00100000:2.0:1782759920.012185:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2933 00000100:00100000:2.0:1782759920.012193:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233196544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782759920.012203:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759920.012230:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233196544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759920.012235:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2933 00000100:00100000:2.0:1782759920.012274:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233196416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759920.012335:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233196544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782759920.599778:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759920.861324:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759920.861488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759920.861524:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759920.861549:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759920.861601:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665344 00000100:00100000:2.0:1782759920.861611:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665344 00000100:00100000:2.0:1782759920.861678:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3357 00000100:00100000:2.0:1782759920.861698:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218665344:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759920.861841:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218665344:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 93us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759920.861850:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3357 00000100:00100000:2.0:1782759920.861874:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218664960 00000100:00100000:2.0:1782759920.861877:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218664960 00000100:00100000:2.0:1782759920.861981:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3598 00000100:00100000:2.0:1782759920.861988:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218664960:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759920.862015:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218664960:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759920.862021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3598 00000100:00100000:3.0:1782759920.862142:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665088 00000100:00100000:3.0:1782759920.862147:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665088 00000100:00100000:3.0:1782759920.862183:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665216 00000100:00100000:3.0:1782759920.862187:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665216 00000100:00100000:3.0:1782759920.862211:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5676 00000100:00100000:3.0:1782759920.862219:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218665088:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759920.862263:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218665088:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759920.862270:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5676 00000100:00100000:3.0:1782759920.862284:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5677 00000100:00100000:3.0:1782759920.862290:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218665216:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759920.862315:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218665216:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759920.862322:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5677 00000100:00080000:2.0:1782759920.862503:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759920.862508:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759920.862510:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759921.035465:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233196800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759921.035547:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759921.035645:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196800 00000100:00100000:2.0:1782759921.035654:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196800 00000100:00100000:2.0:1782759921.035737:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:2.0:1782759921.035749:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233196800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759921.035802:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:2.0:1782759921.035857:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233196800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759921.035864:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:2.0:1782759921.035933:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233196800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759921.036672:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233196672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759921.036720:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759921.036855:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782759921.036864:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233196928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759921.037017:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759921.037048:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196672 00000100:00100000:3.0:1782759921.037053:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196672 00000100:00100000:3.0:1782759921.037095:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233196928 00000100:00100000:3.0:1782759921.037098:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233196928 00000100:00100000:3.0:1782759921.037135:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1782759921.037144:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233196672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759921.037172:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759921.037298:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233196672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759921.037305:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2934 00000100:00100000:3.0:1782759921.037321:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2935 00000100:00100000:3.0:1782759921.037328:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233196928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759921.037338:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759921.037371:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233196928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759921.037377:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2935 00000100:00080000:3.0:1782759921.037396:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759921.037427:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233196928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759921.037463:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233196672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782759921.610927:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759922.636556:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782759923.426991:0:165565:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 64k: Nodemap enforces foreign_ops RBAC roles ========================================================== 15:05:22 (1782759922) 00000100:00100000:2.0:1782759923.596620:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759923.596643:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233197056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759923.596712:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759923.598242:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197056 00000100:00100000:3.0:1782759923.598254:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197056 00000100:00100000:3.0:1782759923.598360:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3617 00000100:00100000:3.0:1782759923.598370:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233197056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759923.598410:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:3.0:1782759923.598498:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233197056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759923.598505:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3617 00000100:00100000:2.0:1782759923.598521:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233197056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759923.658884:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759924.620501:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233197568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620573:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620646:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233198080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620673:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620692:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233198592:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620713:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620738:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1782759924.620744:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233197184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620770:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620790:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233197696:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620812:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620824:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233198208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620842:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620854:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233198720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620871:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620897:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233197440:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620917:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620931:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233197952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620949:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620962:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233198464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.620981:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.620994:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782759924.620999:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233197312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621020:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.621034:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233197824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621052:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.621065:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233198336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621097:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759924.621124:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198080 00000100:00100000:2.0:1782759924.621131:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198080 00000100:00100000:2.0:1782759924.621182:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198592 00000100:00100000:2.0:1782759924.621185:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198592 00000100:00100000:2.0:1782759924.621199:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198208 00000100:00100000:2.0:1782759924.621201:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198208 00000100:00100000:2.0:1782759924.621223:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198720 00000100:00100000:2.0:1782759924.621225:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198720 00000100:00100000:2.0:1782759924.621240:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3358 00000100:00100000:2.0:1782759924.621249:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233198080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621302:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233198080:12345-0@lo:400:kworker.0 Request processed in 54us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621309:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3358 00000100:00100000:2.0:1782759924.621325:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3359 00000100:00100000:2.0:1782759924.621344:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233198592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621373:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233198592:12345-0@lo:400:kworker.0 Request processed in 42us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621379:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3359 00000100:00100000:2.0:1782759924.621391:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3360 00000100:00100000:2.0:1782759924.621399:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233198208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621422:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233198208:12345-0@lo:400:kworker.0 Request processed in 27us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621428:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3360 00000100:00100000:2.0:1782759924.621439:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3361 00000100:00100000:2.0:1782759924.621445:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233198720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621470:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233198720:12345-0@lo:400:kworker.0 Request processed in 26us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621476:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3361 00000100:00100000:2.0:1782759924.621497:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197184 00000100:00100000:2.0:1782759924.621500:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197184 00000100:00100000:2.0:1782759924.621525:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1782759924.621533:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233197184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621562:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233197184:12345-0@lo:400:kworker.0 Request processed in 32us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621568:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3599 00000100:00100000:2.0:1782759924.621623:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197568 00000100:00100000:2.0:1782759924.621627:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197568 00000100:00100000:2.0:1782759924.621648:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197952 00000100:00100000:2.0:1782759924.621651:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197952 00000100:00100000:2.0:1782759924.621663:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198464 00000100:00100000:2.0:1782759924.621665:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198464 00000100:00100000:2.0:1782759924.621678:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197312 00000100:00100000:2.0:1782759924.621680:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197312 00000100:00100000:2.0:1782759924.621689:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197824 00000100:00100000:2.0:1782759924.621691:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197824 00000100:00100000:2.0:1782759924.621701:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198336 00000100:00100000:2.0:1782759924.621703:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198336 00000100:00100000:2.0:1782759924.621716:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5678 00000100:00100000:2.0:1782759924.621722:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233197568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621752:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233197568:12345-0@lo:400:kworker.0 Request processed in 30us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621759:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5678 00000100:00100000:2.0:1782759924.621770:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5679 00000100:00100000:2.0:1782759924.621777:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233197952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621808:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233197952:12345-0@lo:400:kworker.0 Request processed in 33us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621813:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5679 00000100:00100000:2.0:1782759924.621823:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5680 00000100:00100000:2.0:1782759924.621830:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233198464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621854:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233198464:12345-0@lo:400:kworker.0 Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621860:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5680 00000100:00100000:2.0:1782759924.621869:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5681 00000100:00100000:2.0:1782759924.621875:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233197312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621900:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233197312:12345-0@lo:400:kworker.0 Request processed in 25us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621905:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5681 00000100:00100000:2.0:1782759924.621917:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5682 00000100:00100000:2.0:1782759924.621924:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233197824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621948:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233197824:12345-0@lo:400:kworker.0 Request processed in 26us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.621954:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5682 00000100:00100000:2.0:1782759924.621965:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5683 00000100:00100000:2.0:1782759924.621971:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233198336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.621995:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233198336:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.622000:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5683 00000100:00100000:2.0:1782759924.622042:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233197312:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622052:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233197824:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622060:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233198336:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622069:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233197952:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622079:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233198464:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622130:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233197184:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622141:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233198208:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622150:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233198720:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622158:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233197568:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622167:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233198080:0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.622175:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233198592:0@lo:400:kworker.0 00000100:00100000:3.0:1782759924.626456:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197696 00000100:00100000:3.0:1782759924.626481:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197696 00000100:00100000:3.0:1782759924.626555:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233197440 00000100:00100000:3.0:1782759924.626558:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233197440 00000100:00100000:3.0:1782759924.632312:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:1.0:1782759924.632497:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3619 00000100:00100000:0.0:1782759924.632787:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233197440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759924.632912:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233197440:12345-0@lo:400:kworker.0 Request processed in 405us (11992us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759924.632922:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3619 00000100:00100000:1.0:1782759924.633021:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233197440:0@lo:400:kworker.0 00000100:00080000:0.0:1782759924.634696:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759924.634704:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759924.634707:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759924.634710:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759924.638815:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233197696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759924.638923:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233197696:12345-0@lo:400:kworker.0 Request processed in 6594us (18109us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759924.638935:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:2.0:1782759924.638998:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233197696:0@lo:400:kworker.0 00010000:00010000:0.0:1782759924.692467:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759925.131721:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233198848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759925.131793:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759925.131858:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198848 00000100:00100000:3.0:1782759925.131864:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198848 00000100:00100000:3.0:1782759925.131909:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2936 00000100:00100000:3.0:1782759925.131918:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233198848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759925.131947:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759925.131990:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233198848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759925.131996:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2936 00000100:00100000:3.0:1782759925.132053:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233198848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759925.135870:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782759925.135892:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233198976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759925.135959:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759925.136025:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233198976 00000100:00100000:1.0:1782759925.136032:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233198976 00000100:00100000:1.0:1782759925.136088:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2937 00000100:00100000:1.0:1782759925.136098:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233198976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759925.136119:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759925.136159:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233198976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759925.136166:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2937 00000100:00100000:1.0:1782759925.136223:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233198976:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1782759925.706765:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759925.987913:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759925.987999:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759925.988045:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759925.988083:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759925.992444:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665856 00000100:00100000:0.0:1782759925.992460:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665856 00000100:00100000:0.0:1782759925.992561:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3362 00000100:00100000:0.0:1782759925.992572:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218665856:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759925.992678:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218665856:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 108us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759925.992686:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3362 00000100:00080000:3.0:1782759925.993346:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759925.995254:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665472 00000100:00100000:3.0:1782759925.995268:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665472 00000100:00100000:3.0:1782759925.995393:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3600 00000100:00100000:3.0:1782759925.995403:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218665472:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759925.995485:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218665472:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 83us (7437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759925.995492:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3600 00000100:00100000:1.0:1782759925.999638:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665600 00000100:00100000:1.0:1782759925.999654:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665600 00000100:00100000:1.0:1782759925.999933:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665728 00000100:00100000:1.0:1782759925.999938:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665728 00000100:00100000:3.0:1782759926.000609:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5684 00000100:00100000:3.0:1782759926.000623:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218665600:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759926.000707:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218665600:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 88us (12806us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759926.000714:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5684 00000100:00080000:0.0:1782759926.006316:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759926.006326:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759926.006556:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5685 00000100:00100000:1.0:1782759926.006571:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218665728:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759926.006674:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218665728:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 107us (18589us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759926.006682:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5685 00000100:00100000:3.0:1782759926.157312:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782759926.157336:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233199104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759926.157413:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759926.157477:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199104 00000100:00100000:3.0:1782759926.157484:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199104 00000100:00100000:3.0:1782759926.157539:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2938 00000100:00100000:3.0:1782759926.157548:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233199104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759926.157597:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759926.157639:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233199104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759926.157646:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2938 00000100:00080000:3.0:1782759926.157667:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759926.157703:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233199104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759926.159142:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782759926.159164:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233199360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759926.159222:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759926.159266:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199360 00000100:00100000:0.0:1782759926.159272:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199360 00000100:00100000:0.0:1782759926.159324:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:0.0:1782759926.159345:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233199360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759926.159375:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759926.159412:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233199360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759926.159419:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:0.0:1782759926.159457:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233199360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759926.159786:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233199232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759926.159819:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759926.161216:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199232 00000100:00100000:0.0:1782759926.161226:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199232 00000100:00100000:0.0:1782759926.161290:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2939 00000100:00100000:0.0:1782759926.161300:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233199232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759926.161322:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759926.161388:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233199232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759926.161395:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2939 00000100:00080000:0.0:1782759926.161431:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759926.161478:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233199232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759926.736600:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759927.754953:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759928.719398:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233199488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759928.719473:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759928.721371:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199488 00000100:00100000:0.0:1782759928.721383:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199488 00000100:00100000:0.0:1782759928.721466:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621 00000100:00100000:0.0:1782759928.721476:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233199488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759928.721518:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:0.0:1782759928.721733:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233199488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 258us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759928.721741:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621 00000100:00100000:1.0:1782759928.721920:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233199488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1782759928.781135:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759929.739845:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233199872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.739916:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759929.739962:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233200384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740051:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233199744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740084:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740111:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233200256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740145:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740172:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233200768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740195:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740219:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1782759929.740226:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233199616:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740254:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740274:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233200128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740293:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740308:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233200640:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740328:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740340:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233201152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740358:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.740383:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199744 00000100:00100000:3.0:1782759929.740389:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199744 00000100:00100000:3.0:1782759929.740440:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200256 00000100:00100000:3.0:1782759929.740443:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200256 00000100:00100000:3.0:1782759929.740467:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200768 00000100:00100000:3.0:1782759929.740469:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200768 00000100:00100000:3.0:1782759929.740497:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5686 00000100:00100000:3.0:1782759929.740504:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233199744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740571:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233199744:12345-0@lo:400:kworker.0 Request processed in 66us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759929.740605:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5686 00000100:00100000:3.0:1782759929.740621:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5687 00000100:00100000:3.0:1782759929.740627:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233200256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740653:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233200256:12345-0@lo:400:kworker.0 Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759929.740658:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5687 00000100:00100000:3.0:1782759929.740668:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5688 00000100:00100000:3.0:1782759929.740674:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233200768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740698:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233200768:12345-0@lo:400:kworker.0 Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759929.740703:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5688 00000100:00100000:3.0:1782759929.740718:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199872 00000100:00100000:3.0:1782759929.740721:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199872 00000100:00100000:3.0:1782759929.740756:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200128 00000100:00100000:3.0:1782759929.740759:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200128 00000100:00100000:3.0:1782759929.740771:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622 00000100:00100000:3.0:1782759929.740776:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233199872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740806:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233199872:12345-0@lo:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759929.740812:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622 00000100:00100000:3.0:1782759929.740821:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3623 00000100:00100000:3.0:1782759929.740826:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233200128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740850:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233200128:12345-0@lo:400:kworker.0 Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759929.740856:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3623 00000100:00100000:3.0:1782759929.740892:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233200128:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740904:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233199744:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740912:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233200256:0@lo:400:kworker.0 00000100:00100000:3.0:1782759929.740919:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233200768:0@lo:400:kworker.0 00000100:00100000:2.0:1782759929.741310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233199616 00000100:00100000:2.0:1782759929.741315:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233199616 00000100:00100000:2.0:1782759929.741357:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1782759929.741366:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233199616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759929.741421:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233199616:12345-0@lo:400:kworker.0 Request processed in 56us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759929.741427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3601 00000100:00100000:2.0:1782759929.741456:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200640 00000100:00100000:2.0:1782759929.741459:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200640 00000100:00100000:2.0:1782759929.741484:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201152 00000100:00100000:2.0:1782759929.741487:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201152 00000100:00100000:2.0:1782759929.741508:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3363 00000100:00100000:2.0:1782759929.741516:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233200640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759929.741545:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233200640:12345-0@lo:400:kworker.0 Request processed in 31us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759929.741554:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3363 00000100:00100000:2.0:1782759929.741564:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:2.0:1782759929.741570:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233201152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759929.741615:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233201152:12345-0@lo:400:kworker.0 Request processed in 45us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759929.741621:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:2.0:1782759929.741653:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233199616:0@lo:400:kworker.0 00000100:00100000:2.0:1782759929.741663:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233200640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759929.741672:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233201152:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.741851:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759929.741880:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233200896:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.741901:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759929.741940:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233199872:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.741949:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1782759929.741954:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233200000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742052:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759929.742072:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233200512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742094:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759929.742109:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233201024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742128:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759929.742224:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200384 00000100:00100000:0.0:1782759929.742229:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200384 00000100:00100000:0.0:1782759929.742256:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200896 00000100:00100000:0.0:1782759929.742259:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200896 00000100:00100000:0.0:1782759929.742273:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200000 00000100:00100000:0.0:1782759929.742275:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200000 00000100:00100000:0.0:1782759929.742289:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5689 00000100:00100000:0.0:1782759929.742294:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233200384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742332:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233200384:12345-0@lo:400:kworker.0 Request processed in 37us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759929.742338:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5689 00000100:00100000:0.0:1782759929.742350:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5690 00000100:00100000:0.0:1782759929.742357:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233200896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742381:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233200896:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759929.742387:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5690 00000100:00100000:0.0:1782759929.742397:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5691 00000100:00100000:0.0:1782759929.742664:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233200000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742693:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233200000:12345-0@lo:400:kworker.0 Request processed in 290us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759929.742699:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5691 00000100:00080000:0.0:1782759929.742720:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759929.742724:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759929.742726:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782759929.742728:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759929.742740:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233200512 00000100:00100000:0.0:1782759929.742743:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233200512 00000100:00100000:0.0:1782759929.742767:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201024 00000100:00100000:0.0:1782759929.742769:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201024 00000100:00100000:0.0:1782759929.742787:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3365 00000100:00100000:0.0:1782759929.742793:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233200512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742821:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233200512:12345-0@lo:400:kworker.0 Request processed in 29us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759929.742828:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3365 00000100:00100000:0.0:1782759929.742838:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:0.0:1782759929.742843:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233201024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742866:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233201024:12345-0@lo:400:kworker.0 Request processed in 23us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759929.742871:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00080000:0.0:1782759929.742882:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759929.742884:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759929.742904:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233200000:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742914:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233200512:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742924:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233201024:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742932:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233200384:0@lo:400:kworker.0 00000100:00100000:0.0:1782759929.742941:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233200896:0@lo:400:kworker.0 00010000:00010000:2.0:1782759929.804838:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759929.828641:0:165858:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd82e23f0 20000000:00000080:3.0:1782759929.828663:0:165858:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4ced000 uarg=0000000000000000 10000000:01000000:3.0:1782759929.828849:0:165858:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759929.828868:0:165858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.828887:0:165858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.828896:0:165858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.828936:0:165858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.828951:0:165858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 23 pid: 6526 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759929.830478:0:165858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165858:1869355233201280:0@lo:104: 00000100:00100000:3.0:1782759929.830544:0:165858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759929.830634:0:165858:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4c4a000 going to sleep for 11 seconds 00000100:00100000:0.0:1782759929.831076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201280 00000100:00100000:0.0:1782759929.831084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201280 00000100:00100000:0.0:1782759929.831146:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:0.0:1782759929.831155:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:165858:x1869355233201280:12345-0@lo:104: 00010000:00010000:0.0:1782759929.831173:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759929.831242:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759929.831249:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:165858:x1869355233201280:12345-0@lo:104: Request processed in 94us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759929.831256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00010000:00010000:1.0:1782759929.831265:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782759929.831273:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831286:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:1.0:1782759929.831291:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831299:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782759929.831306:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759929.831311:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1782759929.831349:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831356:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782759929.831388:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831395:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6b2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6b9 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831418:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759929.831420:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759929.831422:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759929.831425:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759929.831436:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233201408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759929.831467:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759929.831535:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201408 00000100:00100000:1.0:1782759929.831540:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201408 00010000:00010000:1.0:1782759929.831560:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 24 pid: 6526 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759929.831623:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1782759929.831631:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233201408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759929.831643:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759929.831647:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 24 pid: 6526 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831658:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 24 pid: 6526 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831674:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831681:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831695:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831702:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831708:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831714:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831719:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759929.831723:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831729:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831737:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759929.831747:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782759929.831783:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233201408:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759929.831790:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00010000:00010000:3.0:1782759929.832048:0:165858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802200/0xd5b45c7f5c60e6b9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6b2 expref: 23 pid: 6526 timeout: 4120 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759929.832055:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233201408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759929.832059:0:165858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:165858:1869355233201280:0@lo:104: 00010000:00010000:3.0:1782759929.832071:0:165858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.832080:0:165858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.832086:0:165858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759929.832092:0:165858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e6c0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759930.250908:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233201536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759930.250987:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759930.252749:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233201664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759930.252803:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759930.264120:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201536 00000100:00100000:2.0:1782759930.264135:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201536 00000100:00100000:3.0:1782759930.264333:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201664 00000100:00100000:3.0:1782759930.264339:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201664 00000100:00100000:3.0:1782759930.264374:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2940 00000100:00100000:3.0:1782759930.264384:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233201536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759930.264426:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759930.264505:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233201536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (13517us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759930.264513:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2940 00000100:00100000:3.0:1782759930.264529:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2941 00000100:00100000:3.0:1782759930.264536:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233201664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1782759930.264546:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:3.0:1782759930.264593:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233201664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (11774us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759930.264599:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2941 00000100:00100000:3.0:1782759930.264631:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233201664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759930.264632:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233201536:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1782759930.697215:0:165906:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde0680ef0 20000000:00000080:1.0:1782759930.697232:0:165906:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdec1384400 uarg=0000000000000000 10000000:01000000:1.0:1782759930.697373:0:165906:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759930.697391:0:165906:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697530:0:165906:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697539:0:165906:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697544:0:165906:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697549:0:165906:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697553:0:165906:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697560:0:165906:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759930.697564:0:165906:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697569:0:165906:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697596:0:165906:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697604:0:165906:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759930.697610:0:165906:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e6c7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 165906 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759930.827763:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759931.102127:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759931.102225:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759931.102269:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759931.102395:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666368 00000100:00100000:1.0:1782759931.102404:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666368 00000100:00100000:1.0:1782759931.102474:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3367 00000100:00100000:1.0:1782759931.102485:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218666368:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759931.102559:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218666368:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759931.102616:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3367 00000100:00080000:1.0:1782759931.102672:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759931.102853:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218665984 00000100:00100000:3.0:1782759931.102858:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218665984 00000100:00100000:3.0:1782759931.102905:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3602 00000100:00100000:3.0:1782759931.102913:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218665984:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759931.102944:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2404:x1869355218665984:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759931.102950:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3602 00000100:00100000:2.0:1782759931.103307:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759931.106354:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666112 00000100:00100000:0.0:1782759931.106366:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666112 00000100:00100000:0.0:1782759931.106485:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666240 00000100:00100000:0.0:1782759931.106488:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666240 00000100:00100000:0.0:1782759931.106536:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5692 00000100:00100000:0.0:1782759931.106547:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218666112:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759931.106670:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218666112:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 124us (4551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759931.106678:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5692 00000100:00100000:0.0:1782759931.106700:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5693 00000100:00100000:0.0:1782759931.106707:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218666240:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759931.106732:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218666240:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (3426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759931.106739:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5693 00000100:00080000:2.0:1782759931.108280:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759931.108287:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759931.276351:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233201792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759931.276442:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759931.276516:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201792 00000100:00100000:2.0:1782759931.276524:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201792 00000100:00100000:2.0:1782759931.276611:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2942 00000100:00100000:2.0:1782759931.276634:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233201792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759931.276665:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759931.276708:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233201792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759931.276716:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2942 00000100:00080000:2.0:1782759931.276736:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759931.276769:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233201792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759931.278120:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233201920:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759931.278161:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759931.278203:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233201920 00000100:00100000:3.0:1782759931.278209:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233201920 00000100:00100000:3.0:1782759931.278248:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2943 00000100:00100000:3.0:1782759931.278255:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233201920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759931.278270:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759931.278302:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233201920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759931.278309:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2943 00000100:00100000:3.0:1782759931.278341:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233201920:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782759931.278369:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759931.285260:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233202048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759931.285329:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759931.285730:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202048 00000100:00100000:1.0:1782759931.285739:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202048 00000100:00100000:1.0:1782759931.286040:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:1.0:1782759931.286051:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233202048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759931.286086:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:1.0:1782759931.286136:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233202048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759931.286144:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00000100:00100000:1.0:1782759931.286187:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233202048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782759931.854499:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759931.860152:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759931.860159:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759931.860163:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759931.860204:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.860216:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.860226:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759931.860250:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233202176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759931.860318:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759931.860372:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ba0840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759931.860465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202176 00000100:00100000:0.0:1782759931.860473:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202176 00000100:00100000:0.0:1782759931.860524:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3603 00000100:00100000:0.0:1782759931.860533:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233202176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759931.860546:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759931.860559:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e6ce expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759931.860601:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759931.860612:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759931.860620:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802400, rc 0) 00000100:00100000:0.0:1782759931.860659:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233202176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759931.860665:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3603 00000100:00100000:1.0:1782759931.862128:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233202176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759931.862347:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.862359:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759931.862386:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759931.862391:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759931.862398:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759932.876074:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759933.841872:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233202304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759933.841963:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759933.842194:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202304 00000100:00100000:2.0:1782759933.842202:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202304 00000100:00100000:2.0:1782759933.842278:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3625 00000100:00100000:2.0:1782759933.842290:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233202304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759933.842324:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759933.849285:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233202304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6986us (7309us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759933.849300:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3625 00000100:00100000:3.0:1782759933.850331:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233202304:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759933.899102:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759934.135531:0:166053:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd60f6abe0 20000000:00000080:1.0:1782759934.135549:0:166053:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c1b000 uarg=0000000000000000 10000000:01000000:1.0:1782759934.135843:0:166053:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759934.135861:0:166053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.135879:0:166053:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.135888:0:166053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.135922:0:166053:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759934.135935:0:166053:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 23 pid: 6526 timeout: 4124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759934.135948:0:166053:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166053:1869355233202432:0@lo:104: 00000100:00100000:1.0:1782759934.136011:0:166053:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759934.136058:0:166053:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4ba00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759934.136563:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202432 00000100:00100000:0.0:1782759934.136570:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202432 00000100:00100000:0.0:1782759934.136645:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:0.0:1782759934.136654:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:166053:x1869355233202432:12345-0@lo:104: 00010000:00010000:0.0:1782759934.136667:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.136728:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759934.136734:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:166053:x1869355233202432:12345-0@lo:104: Request processed in 81us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.136740:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1782759934.137150:0:166053:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166053:1869355233202432:0@lo:104: 00010000:00010000:2.0:1782759934.137169:0:166053:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137251:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759934.137258:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137265:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759934.137269:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137277:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759934.137284:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759934.137290:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759934.137323:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137330:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1782759934.137367:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233202560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759934.137400:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782759934.137507:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137514:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412c00/0xd5b45c7f5c60e6ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6d5 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137529:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759934.137530:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759934.137532:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759934.137542:0:140594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202560 00000100:00100000:3.0:1782759934.137545:0:140594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202560 00010000:00010000:3.0:1782759934.137564:0:140594:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 24 pid: 6526 timeout: 4124 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759934.137602:0:140594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1782759934.137609:0:140594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec56d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233202560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759934.137710:0:140594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759934.137715:0:140594:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 24 pid: 6526 timeout: 4124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137725:0:140594:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 24 pid: 6526 timeout: 4124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137738:0:140594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802400/0xd5b45c7f5c60e6d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ce expref: 24 pid: 6526 timeout: 4124 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137749:0:140594:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137757:0:140594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137769:0:140594:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137775:0:140594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137783:0:140594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137789:0:140594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137795:0:140594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759934.137799:0:140594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137805:0:140594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137817:0:140594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759934.137824:0:140594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759934.143676:0:166053:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.143695:0:166053:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759934.143702:0:166053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413c00/0xd5b45c7f5c60e6dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759934.147374:0:140594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec56d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233202560:12345-0@lo:103:ldlm_bl.0 Request processed in 9756us (9964us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759934.147388:0:140594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1782759934.162129:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233202560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759934.868538:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233202688:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.868635:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759934.872690:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233202944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.872769:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759934.872827:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233203456:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.872853:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759934.872885:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1782759934.872892:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233202816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.872916:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759934.872932:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233203328:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.872952:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759934.873007:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203456 00000100:00100000:3.0:1782759934.873016:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203456 00000100:00100000:3.0:1782759934.873080:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202816 00000100:00100000:3.0:1782759934.873083:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202816 00000100:00100000:3.0:1782759934.873101:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203328 00000100:00100000:3.0:1782759934.873103:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203328 00000100:00100000:3.0:1782759934.873650:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5694 00000100:00100000:3.0:1782759934.873660:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233203456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.873723:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233203456:12345-0@lo:400:kworker.0 Request processed in 65us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759934.873730:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5694 00000100:00100000:3.0:1782759934.873750:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5695 00000100:00100000:3.0:1782759934.873756:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233202816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.873783:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233202816:12345-0@lo:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759934.873788:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5695 00000100:00100000:3.0:1782759934.873799:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5696 00000100:00100000:3.0:1782759934.873806:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233203328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.873832:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233203328:12345-0@lo:400:kworker.0 Request processed in 27us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759934.873838:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5696 00000100:00080000:3.0:1782759934.873861:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759934.873865:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759934.873900:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233202816:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.873911:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233203328:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.873920:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233203456:0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.875008:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202944 00000100:00100000:2.0:1782759934.875017:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202944 00000100:00100000:2.0:1782759934.875092:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3626 00000100:00100000:2.0:1782759934.875103:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.875183:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233202944:12345-0@lo:400:kworker.0 Request processed in 83us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759934.875194:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3626 00000100:00100000:2.0:1782759934.876008:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233203840:0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.876053:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759934.876116:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759934.876122:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233203968:0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.876146:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759934.876867:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233202944:0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.876900:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203840 00000100:00100000:3.0:1782759934.876904:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203840 00000100:00100000:3.0:1782759934.876957:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203968 00000100:00100000:3.0:1782759934.876959:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203968 00000100:00100000:3.0:1782759934.876979:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5697 00000100:00100000:3.0:1782759934.876988:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233203840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.878959:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233203840:12345-0@lo:400:kworker.0 Request processed in 1964us (2898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759934.878973:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5697 00000100:00100000:3.0:1782759934.879019:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5698 00000100:00100000:3.0:1782759934.879033:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233203968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759934.879416:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233203968:12345-0@lo:400:kworker.0 Request processed in 389us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759934.879422:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5698 00000100:00080000:2.0:1782759934.880214:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759934.880220:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759934.880260:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233203968:0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.880273:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233203840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889260:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233203200:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889326:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759934.889352:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233203712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889378:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759934.889400:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233204224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889422:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759934.889443:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1782759934.889450:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233203072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889474:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759934.889492:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233203584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889510:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759934.889524:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233204096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889544:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759934.889599:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203712 00000100:00100000:0.0:1782759934.889606:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203712 00000100:00100000:0.0:1782759934.889653:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204224 00000100:00100000:0.0:1782759934.889656:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204224 00000100:00100000:0.0:1782759934.889668:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203584 00000100:00100000:0.0:1782759934.889670:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203584 00000100:00100000:0.0:1782759934.889681:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204096 00000100:00100000:0.0:1782759934.889683:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204096 00000100:00100000:0.0:1782759934.889706:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1782759934.889714:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233203712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889767:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233203712:12345-0@lo:400:kworker.0 Request processed in 53us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.889773:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1782759934.889789:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3369 00000100:00100000:0.0:1782759934.889795:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233204224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889820:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233204224:12345-0@lo:400:kworker.0 Request processed in 26us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.889825:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3369 00000100:00100000:0.0:1782759934.889835:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:0.0:1782759934.889840:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233203584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889867:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233203584:12345-0@lo:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.889872:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:0.0:1782759934.889882:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3371 00000100:00100000:0.0:1782759934.889888:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233204096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.889911:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233204096:12345-0@lo:400:kworker.0 Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.889916:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3371 00000100:00100000:0.0:1782759934.889937:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203072 00000100:00100000:0.0:1782759934.889940:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203072 00000100:00100000:0.0:1782759934.889964:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5699 00000100:00100000:0.0:1782759934.889971:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233203072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890012:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233203072:12345-0@lo:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.890018:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5699 00000100:00080000:0.0:1782759934.890037:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759934.890050:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759934.890080:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233203072:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890091:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233203584:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890100:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233204096:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890109:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233203712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890117:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233204224:0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890186:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233202688 00000100:00100000:0.0:1782759934.890190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233202688 00000100:00100000:0.0:1782759934.890220:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3604 00000100:00100000:0.0:1782759934.890227:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233202688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759934.890262:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233202688:12345-0@lo:400:kworker.0 Request processed in 37us (21628us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759934.890269:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3604 00000100:00100000:0.0:1782759934.890306:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233202688:0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.890851:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233203200 00000100:00100000:2.0:1782759934.890857:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233203200 00000100:00100000:2.0:1782759934.890913:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3627 00000100:00100000:2.0:1782759934.890922:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233203200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759934.890970:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233203200:12345-0@lo:400:kworker.0 Request processed in 50us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759934.890977:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3627 00000100:00100000:2.0:1782759934.891018:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233203200:0@lo:400:kworker.0 00010000:00010000:0.0:1782759934.925240:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759935.370767:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233204352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759935.370842:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1782759935.374831:0:166101:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8bfd9ef0 20000000:00000080:0.0:1782759935.374850:0:166101:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c1b000 uarg=0000000000000000 10000000:01000000:0.0:1782759935.375525:0:166101:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759935.375548:0:166101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375564:0:166101:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375574:0:166101:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375604:0:166101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375611:0:166101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375619:0:166101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375626:0:166101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759935.375630:0:166101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375639:0:166101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375652:0:166101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375659:0:166101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759935.375665:0:166101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759935.380327:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204352 00000100:00100000:0.0:1782759935.380342:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204352 00000100:00100000:0.0:1782759935.380397:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2944 00000100:00100000:0.0:1782759935.380407:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233204352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759935.380438:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759935.380510:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233204352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (9667us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759935.380517:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2944 00000100:00100000:0.0:1782759935.380546:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233204480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759935.380597:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759935.381448:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204480 00000100:00100000:1.0:1782759935.381455:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204480 00000100:00100000:1.0:1782759935.381488:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2945 00000100:00100000:1.0:1782759935.381496:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233204480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759935.381512:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759935.381555:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233204480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759935.381561:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2945 00000100:00100000:3.0:1782759935.384172:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233204352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759935.395522:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233204480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759935.947689:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759936.026752:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759936.026760:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759936.026765:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759936.026813:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759936.026827:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759936.026852:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759936.026878:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233204608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759936.026967:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759936.027030:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48d0840 going to sleep for 11 seconds 00000100:00100000:0.0:1782759936.027164:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204608 00000100:00100000:0.0:1782759936.027172:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204608 00000100:00100000:0.0:1782759936.027225:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3605 00000100:00100000:0.0:1782759936.027235:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233204608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759936.027248:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759936.027261:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e6ea expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.027297:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.027308:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.027318:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803800, rc 0) 00000100:00100000:0.0:1782759936.027369:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233204608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759936.027377:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3605 00000100:00100000:3.0:1782759936.027939:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233204608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759936.027955:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.027965:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759936.027982:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782759936.028000:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.028007:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759936.236689:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759936.236735:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759936.236846:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666496 00000100:00100000:0.0:1782759936.236857:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666496 00000100:00100000:0.0:1782759936.236921:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3606 00000100:00100000:0.0:1782759936.236932:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218666496:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759936.237024:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218666496:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759936.237033:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3606 00000100:00100000:0.0:1782759936.237970:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759936.238043:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666880 00000100:00100000:2.0:1782759936.238051:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666880 00000100:00100000:2.0:1782759936.238131:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3372 00000100:00100000:2.0:1782759936.238160:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218666880:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759936.238223:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218666880:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759936.238234:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3372 00000100:00080000:0.0:1782759936.238670:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759936.238848:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666624 00000100:00100000:1.0:1782759936.238855:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666624 00000100:00100000:1.0:1782759936.238924:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5700 00000100:00100000:1.0:1782759936.238933:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218666624:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759936.238998:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218666624:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 54us (2248us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759936.239005:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5700 00000100:00080000:2.0:1782759936.239394:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759936.249145:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759936.249424:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218666752 00000100:00100000:3.0:1782759936.249435:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218666752 00000100:00100000:3.0:1782759936.249514:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5701 00000100:00100000:3.0:1782759936.249525:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218666752:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759936.249634:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218666752:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 111us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759936.249642:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5701 00000100:00080000:2.0:1782759936.249732:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759936.399730:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233204736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759936.399834:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759936.399951:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204736 00000100:00100000:2.0:1782759936.399962:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204736 00000100:00100000:2.0:1782759936.400060:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2946 00000100:00100000:2.0:1782759936.400072:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233204736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759936.400112:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759936.400168:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233204736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759936.400177:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2946 00000100:00080000:2.0:1782759936.400205:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759936.400258:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233204736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759936.404514:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233204864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759936.404633:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759936.404712:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204864 00000100:00100000:2.0:1782759936.404721:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204864 00000100:00100000:2.0:1782759936.404803:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3628 00000100:00100000:2.0:1782759936.404826:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233204864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1782759936.404868:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:2.0:1782759936.405542:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233204864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 717us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759936.405553:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3628 00000100:00100000:2.0:1782759936.405753:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233204864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759936.410729:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233204992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759936.410804:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759936.410883:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233204992 00000100:00100000:2.0:1782759936.410890:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233204992 00000100:00100000:2.0:1782759936.411085:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2947 00000100:00100000:2.0:1782759936.411110:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233204992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759936.411137:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759936.411214:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233204992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759936.411223:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2947 00000100:00080000:2.0:1782759936.411256:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759936.411292:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233204992:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1782759936.684810:0:166150:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5763bba0 20000000:00000080:0.0:1782759936.684830:0:166150:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddcbc10000 uarg=0000000000000000 10000000:01000000:0.0:1782759936.692498:0:166150:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759936.692528:0:166150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.692548:0:166150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.692557:0:166150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.692621:0:166150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.692636:0:166150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 23 pid: 6526 timeout: 4126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759936.692649:0:166150:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166150:1869355233205120:0@lo:104: 00000100:00100000:0.0:1782759936.692711:0:166150:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759936.692773:0:166150:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcbc700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782759936.694037:0:140593:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1782759936.694056:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205120 00000100:00100000:2.0:1782759936.694064:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205120 00000100:00100000:2.0:1782759936.694125:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1782759936.694136:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf629850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:166150:x1869355233205120:12345-0@lo:104: 00010000:00010000:2.0:1782759936.694152:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759936.694231:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759936.694237:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf629850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:166150:x1869355233205120:12345-0@lo:104: Request processed in 105us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759936.694244:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00010000:00010000:3.0:1782759936.694395:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759936.694402:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.694411:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759936.694414:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.694423:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759936.694430:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759936.694441:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759936.694488:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.694494:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759936.694511:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.694519:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cddc5412a00/0xd5b45c7f5c60e6ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e6f1 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.694535:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759936.694537:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759936.694538:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759936.694572:0:166150:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166150:1869355233205120:0@lo:104: 00010000:00010000:3.0:1782759936.694612:0:166150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759936.694817:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759936.694830:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233205248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759936.694865:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759936.695200:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205248 00000100:00100000:3.0:1782759936.695205:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205248 00010000:00010000:3.0:1782759936.695227:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 24 pid: 6526 timeout: 4126 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759936.695257:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:3.0:1782759936.695272:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233205248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759936.695281:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759936.695286:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 24 pid: 6526 timeout: 4126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695301:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 24 pid: 6526 timeout: 4126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695314:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803800/0xd5b45c7f5c60e6f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e6ea expref: 24 pid: 6526 timeout: 4126 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695326:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695333:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695345:0:7472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695351:0:7472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695496:0:7472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695502:0:7472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695508:0:7472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759936.695512:0:7472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695519:0:7472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695543:0:7472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759936.695552:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759936.695617:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233205248:12345-0@lo:103:ldlm_bl.0 Request processed in 345us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759936.695624:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:2.0:1782759936.695694:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233205248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759936.695822:0:166150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.695831:0:166150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.695837:0:166150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803c00/0xd5b45c7f5c60e6f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759936.970748:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759937.753290:0:166198:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe872a2800 20000000:00000080:2.0:1782759937.753306:0:166198:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4cef400 uarg=0000000000000000 10000000:01000000:2.0:1782759937.753457:0:166198:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759937.753478:0:166198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753494:0:166198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753505:0:166198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753512:0:166198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753519:0:166198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753526:0:166198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753532:0:166198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759937.753537:0:166198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753544:0:166198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753556:0:166198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753564:0:166198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.753570:0:166198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf649e00/0xd5b45c7f5c60e6ff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759937.872864:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759937.872872:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759937.872877:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759937.872936:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.872949:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.872960:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759937.872995:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233205376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759937.873062:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759937.873324:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc45c6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782759937.873359:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205376 00000100:00100000:2.0:1782759937.873366:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205376 00000100:00100000:2.0:1782759937.873428:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1782759937.873438:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233205376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759937.873452:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759937.873466:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e706 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.873492:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.873502:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.873510:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648200, rc 0) 00000100:00100000:2.0:1782759937.873547:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233205376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759937.873553:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3607 00000100:00100000:2.0:1782759937.873619:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233205376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759937.873632:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.873642:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759937.873659:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759937.873665:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759937.873673:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759937.998002:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759938.635011:0:166246:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0b2c9ea0 20000000:00000080:1.0:1782759938.635030:0:166246:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedf947000 uarg=0000000000000000 00010000:00010000:1.0:1782759938.635310:0:166246:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759938.635327:0:166246:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759938.635352:0:166246:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759938.635365:0:166246:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759938.635379:0:166246:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759938.635398:0:166246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.635413:0:166246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.635423:0:166246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.635460:0:166246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759938.635474:0:166246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 23 pid: 6524 timeout: 4128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759938.635489:0:166246:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166246:1869355233205504:0@lo:104: 00000100:00100000:1.0:1782759938.635548:0:166246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759938.635790:0:166246:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759938.635876:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205504 00000100:00100000:0.0:1782759938.635885:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205504 00000100:00100000:0.0:1782759938.635973:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1782759938.635984:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:166246:x1869355233205504:12345-0@lo:104: 00010000:00010000:0.0:1782759938.635999:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759938.636064:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759938.636070:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4827800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:166246:x1869355233205504:12345-0@lo:104: Request processed in 90us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759938.636077:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1782759938.636137:0:166246:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166246:1869355233205504:0@lo:104: 00010000:00010000:2.0:1782759938.636174:0:166246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636275:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782759938.636282:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636290:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:3.0:1782759938.636294:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636303:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782759938.636309:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782759938.636315:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1782759938.636351:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636359:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782759938.636380:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636391:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e706 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e70d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636405:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759938.636406:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759938.636408:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759938.636419:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233205632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782759938.636449:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759938.636481:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205632 00000100:00100000:3.0:1782759938.636485:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205632 00010000:00010000:3.0:1782759938.636502:0:6516:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 24 pid: 6524 timeout: 4128 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759938.636522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1782759938.636530:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233205632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759938.636540:0:6516:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759938.636545:0:6516:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 24 pid: 6524 timeout: 4128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636554:0:6516:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 24 pid: 6524 timeout: 4128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636565:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e70d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e706 expref: 24 pid: 6524 timeout: 4128 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636598:0:6516:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636610:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636624:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636631:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636638:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636644:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636648:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412c00 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759938.636652:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636659:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636670:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759938.636677:0:6516:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759938.636705:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8c55c43-51ff-4f74-a800-62b522e56789+23:3664:x1869355233205632:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759938.636711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1782759938.636738:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233205632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759938.636812:0:166246:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.636819:0:166246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759938.636826:0:166246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412c00/0xd5b45c7f5c60e714 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759938.954914:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233205760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759938.955015:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759938.955354:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205760 00000100:00100000:2.0:1782759938.955362:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205760 00000100:00100000:2.0:1782759938.955444:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3629 00000100:00100000:2.0:1782759938.955455:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233205760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759938.955488:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445658624 avail 1299419136 00000100:00100000:2.0:1782759938.955548:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233205760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759938.955555:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3629 00000100:00100000:0.0:1782759938.955722:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233205760:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759939.020467:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759939.787005:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759939.787013:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759939.787018:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759939.787069:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759939.787083:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759939.787095:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759939.787119:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233205888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759939.787200:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759939.787263:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc01d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782759939.787463:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233205888 00000100:00100000:3.0:1782759939.787471:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233205888 00000100:00100000:3.0:1782759939.787524:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3608 00000100:00100000:3.0:1782759939.787534:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233205888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759939.787549:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759939.787564:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e71b expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759939.787612:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759939.787623:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759939.787632:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759939.787680:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233205888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759939.787687:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3608 00000100:00100000:0.0:1782759939.787805:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233205888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759939.787820:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759939.787834:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759939.787852:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759939.787857:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759939.787864:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759939.978837:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233206272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.978925:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979084:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233206016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979114:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979145:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206272 00000100:00100000:2.0:1782759939.979152:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206272 00000100:00100000:2.0:1782759939.979203:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206016 00000100:00100000:2.0:1782759939.979206:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206016 00000100:00100000:2.0:1782759939.979229:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5702 00000100:00100000:2.0:1782759939.979239:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233206272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979296:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233206272:12345-0@lo:400:kworker.0 Request processed in 59us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759939.979307:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5702 00000100:00100000:2.0:1782759939.979324:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5703 00000100:00100000:2.0:1782759939.979331:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233206016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979363:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233206016:12345-0@lo:400:kworker.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759939.979369:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5703 00000100:00100000:2.0:1782759939.979701:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233206016:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979709:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233206528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979734:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979760:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233207040:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979781:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979810:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1782759939.979816:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233206144:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979840:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979856:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233206656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979887:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979903:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233207168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.979923:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759939.979947:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206528 00000100:00100000:2.0:1782759939.979951:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206528 00000100:00100000:2.0:1782759939.980143:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207040 00000100:00100000:2.0:1782759939.980146:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207040 00000100:00100000:2.0:1782759939.980164:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206656 00000100:00100000:2.0:1782759939.980166:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206656 00000100:00100000:2.0:1782759939.980179:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207168 00000100:00100000:2.0:1782759939.980181:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207168 00000100:00100000:2.0:1782759939.980196:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5704 00000100:00100000:2.0:1782759939.980202:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233206528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983230:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233206272:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983248:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233206784:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983309:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759939.983344:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233207296:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983365:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759939.983399:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759939.983405:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233206400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983429:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759939.983456:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233206912:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983479:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759939.983494:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233207424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.983511:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759939.983561:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5705 00000100:00100000:0.0:1782759939.983592:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233207040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759939.983861:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206144 00000100:00100000:3.0:1782759939.983868:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206144 00000100:00100000:3.0:1782759939.983920:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206400 00000100:00100000:3.0:1782759939.983923:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206400 00000100:00100000:3.0:1782759939.983937:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3630 00000100:00100000:3.0:1782759939.983944:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233206144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.990314:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233206528:12345-0@lo:400:kworker.0 Request processed in 10099us (10566us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759939.990330:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5704 00000100:00100000:2.0:1782759939.990380:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3631 00000100:00100000:2.0:1782759939.990401:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233206400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.990481:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233206400:12345-0@lo:400:kworker.0 Request processed in 93us (7051us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759939.990488:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3631 00000100:00080000:2.0:1782759939.990511:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759939.990517:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759939.990544:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5706 00000100:00100000:2.0:1782759939.990555:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233206656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.992781:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233207040:12345-0@lo:400:kworker.0 Request processed in 9201us (12989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759939.992795:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5705 00000100:00100000:0.0:1782759939.992830:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5707 00000100:00100000:0.0:1782759939.992844:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233207168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.992920:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233207168:12345-0@lo:400:kworker.0 Request processed in 82us (12995us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759939.992926:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5707 00000100:00100000:0.0:1782759939.992965:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206784 00000100:00100000:0.0:1782759939.992973:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206784 00000100:00100000:0.0:1782759939.993039:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207296 00000100:00100000:0.0:1782759939.993043:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207296 00000100:00100000:0.0:1782759939.993057:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233206912 00000100:00100000:0.0:1782759939.993060:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233206912 00000100:00100000:0.0:1782759939.993072:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207424 00000100:00100000:0.0:1782759939.993074:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207424 00000100:00100000:0.0:1782759939.993086:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3373 00000100:00100000:0.0:1782759939.993093:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233206784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.993127:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233206784:12345-0@lo:400:kworker.0 Request processed in 35us (9819us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759939.993134:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3373 00000100:00100000:0.0:1782759939.993148:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1782759939.993153:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233207296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.993194:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233207296:12345-0@lo:400:kworker.0 Request processed in 41us (9828us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759939.993204:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1782759939.993215:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3375 00000100:00100000:0.0:1782759939.993220:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233206912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.993247:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233206912:12345-0@lo:400:kworker.0 Request processed in 27us (9767us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759939.993253:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3375 00000100:00100000:0.0:1782759939.993272:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3376 00000100:00100000:0.0:1782759939.993279:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233207424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.993304:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233207424:12345-0@lo:400:kworker.0 Request processed in 27us (9793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759939.993310:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3376 00000100:00100000:3.0:1782759939.994021:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233206144:12345-0@lo:400:kworker.0 Request processed in 10073us (14175us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759939.994033:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3630 00000100:00100000:3.0:1782759939.994133:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233206144:0@lo:400:kworker.0 00000100:00080000:0.0:1782759939.996607:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759939.996615:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759939.996676:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233206400:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.996693:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233206912:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.996706:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233207424:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.996719:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233206784:0@lo:400:kworker.0 00000100:00100000:0.0:1782759939.996730:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233207296:0@lo:400:kworker.0 00000100:00100000:2.0:1782759939.999746:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233206656:12345-0@lo:400:kworker.0 Request processed in 9186us (19861us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759939.999759:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5706 00000100:00100000:3.0:1782759940.001074:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233206656:0@lo:400:kworker.0 00000100:00100000:2.0:1782759940.001163:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233207168:0@lo:400:kworker.0 00000100:00100000:2.0:1782759940.001176:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4436680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233206528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759940.001188:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233207040:0@lo:400:kworker.0 00010000:00010000:1.0:1782759940.043973:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759940.491329:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759940.491356:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233207552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759940.491427:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759940.491546:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207552 00000100:00100000:0.0:1782759940.491554:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207552 00000100:00100000:0.0:1782759940.491623:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1782759940.491632:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233207552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782759940.491663:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759940.491712:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233207552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759940.491719:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2948 00000100:00100000:0.0:1782759940.491760:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233207552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759940.491903:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233207680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759940.491930:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759940.491970:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207680 00000100:00100000:1.0:1782759940.491974:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207680 00000100:00100000:1.0:1782759940.491996:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2949 00000100:00100000:1.0:1782759940.492001:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233207680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759940.492022:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759940.492049:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233207680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759940.492055:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2949 00000100:00100000:1.0:1782759940.492083:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233207680:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1782759941.066823:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759941.355439:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759941.355482:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759941.355504:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759941.355531:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759941.355561:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667264 00000100:00100000:1.0:1782759941.355570:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667264 00000100:00100000:1.0:1782759941.355639:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667136 00000100:00100000:1.0:1782759941.355643:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667136 00000100:00100000:1.0:1782759941.355666:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5708 00000100:00100000:1.0:1782759941.355676:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218667264:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759941.355745:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218667264:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759941.355753:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5708 00000100:00100000:1.0:1782759941.355771:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5709 00000100:00100000:1.0:1782759941.355777:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218667136:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759941.355802:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218667136:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759941.355808:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5709 00000100:00100000:1.0:1782759941.355828:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667392 00000100:00100000:1.0:1782759941.355832:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667392 00000100:00100000:1.0:1782759941.355870:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3377 00000100:00100000:1.0:1782759941.355878:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218667392:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759941.355901:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218667392:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759941.355907:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3377 00000100:00080000:1.0:1782759941.355921:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759941.355925:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782759941.355927:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1782759941.356621:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667008 00000100:00100000:3.0:1782759941.356627:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667008 00000100:00100000:3.0:1782759941.356684:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3609 00000100:00100000:3.0:1782759941.356692:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218667008:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759941.356729:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218667008:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759941.356736:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3609 00000100:00100000:0.0:1782759941.516203:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233207808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759941.516272:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759941.516326:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759941.516334:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233207936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759941.516362:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759941.516422:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207936 00000100:00100000:0.0:1782759941.516431:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207936 00000100:00100000:0.0:1782759941.516488:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3632 00000100:00100000:0.0:1782759941.516497:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233207936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759941.516532:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759941.516601:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233207936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759941.516609:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3632 00000100:00100000:0.0:1782759941.516651:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233207936:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1782759941.517000:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759941.517011:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233208064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759941.517041:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759941.517081:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233207808 00000100:00100000:3.0:1782759941.517085:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233207808 00000100:00100000:3.0:1782759941.517119:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208064 00000100:00100000:3.0:1782759941.517122:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208064 00000100:00100000:3.0:1782759941.517142:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2950 00000100:00100000:3.0:1782759941.517149:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233207808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782759941.517180:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759941.517217:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233207808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759941.517227:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2950 00000100:00100000:3.0:1782759941.517240:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2951 00000100:00100000:3.0:1782759941.517246:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233208064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1782759941.517256:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759941.517283:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233208064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759941.517289:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2951 00000100:00080000:3.0:1782759941.517302:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759941.517333:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4f6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233207808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759941.517356:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc49a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233208064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759941.618230:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759941.618658:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667520 00000100:00100000:0.0:1782759941.618670:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667520 00000100:00100000:0.0:1782759941.618727:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3192 00000100:00100000:0.0:1782759941.618737:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:118230:x1869355218667520:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:0.0:1782759941.618757:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759941.618813:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27973 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.618895:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.618907:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.618916:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.618947:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.618954:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.618961:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619385:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619394:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619400:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619408:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619413:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759941.619419:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619426:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619441:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759941.619444:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759941.619449:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619455:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e730 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619464:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619470:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619476:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619480:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759941.619483:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619488:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619494:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff8cdecda0a700) 00010000:00010000:0.0:1782759941.619496:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759941.619499:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619503:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e737 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619533:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e729 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27973 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619543:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759941.619546:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759941.619549:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27973 expref: 6 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759941.619558:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803c00, rc 0) 00000100:00100000:0.0:1782759941.619734:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+5:118230:x1869355218667520:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 997us (1515us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759941.619742:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3192 00000100:00100000:1.0:1782759941.626745:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759941.626779:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667776 00000100:00100000:1.0:1782759941.626789:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667776 00000100:00100000:1.0:1782759941.626839:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3193 00000100:00100000:1.0:1782759941.626849:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:118230:x1869355218667776:12345-192.168.202.31@tcp:36:lfs.0 00010000:00010000:1.0:1782759941.627137:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759941.627142:0:6533:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e1b1) 00010000:00010000:1.0:1782759941.627144:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759941.627629:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.627648:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.627659:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.627674:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.627681:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.627688:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629592:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,1 mode: --/PW res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629612:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629623:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759941.629640:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b354c7ae reply state 00000000d4db49bd transno 4294968056 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629651:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629658:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:1.0:1782759941.629661:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759941.629665:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1782759941.629672:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782759941.629681:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629688:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629695:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629701:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629707:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759941.629711:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629719:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629727:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759941.629730:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759941.629733:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629739:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e73e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759941.629749:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b354c7ae reply state 00000000d4db49bd transno 4294968056 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629757:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759941.629763:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff8cddc34f6300) 00010000:00010000:1.0:1782759941.629765:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759941.629767:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1782759941.629861:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc479dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:118230:x1869355218667776:12345-192.168.202.31@tcp:36:lfs.0 Request processed in 3009us (3121us total) trans 4294968056 rc 0/0 00000100:00100000:1.0:1782759941.629936:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3193 00010000:00010000:3.0:1782759942.094698:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782759942.542917:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968056 is committed 00010000:00010000:0.0:1782759942.543105:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543118:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543127:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543134:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759942.543138:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543151:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543167:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff8cddc34f6300) 00010000:00010000:0.0:1782759942.543170:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759942.543174:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543180:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e745 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543197:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543203:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543209:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543222:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759942.543225:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543230:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543236:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6b00) 00010000:00010000:0.0:1782759942.543239:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759942.543241:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759942.543250:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e74c lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759943.114781:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782759943.606706:0:166490:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd26868d0 20000000:00000080:0.0:1782759943.606724:0:166490:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6e000 uarg=0000000000000000 00010000:00010000:0.0:1782759943.606936:0:166490:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759943.606955:0:166490:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759943.606981:0:166490:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1782759943.606994:0:166490:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1782759943.607008:0:166490:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1782759943.607027:0:166490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759943.607222:0:166490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759943.607232:0:166490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759943.607271:0:166490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759943.607286:0:166490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 23 pid: 6526 timeout: 4133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759943.607302:0:166490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166490:1869355233208192:0@lo:104: 00000100:00100000:0.0:1782759943.607376:0:166490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759943.607498:0:140593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208192 00000100:00100000:2.0:1782759943.607505:0:140593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208192 00000100:00100000:2.0:1782759943.607561:0:140593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1782759943.607571:0:140593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:166490:x1869355233208192:12345-0@lo:104: 00010000:00010000:2.0:1782759943.607603:0:140593:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759943.607656:0:140593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782759943.607662:0:140593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:b8c55c43-51ff-4f74-a800-62b522e56789+3:166490:x1869355233208192:12345-0@lo:104: Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759943.607670:0:140593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00010000:00010000:2.0:1782759943.607691:0:6519:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759943.607697:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759943.607703:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803800 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759943.607707:0:6519:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759943.607715:0:6519:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759943.607722:0:6519:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759943.607727:0:6519:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759943.607757:0:6519:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759943.607764:0:6519:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759943.607781:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759943.607792:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803800/0xd5b45c7f5c60e71b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e722 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759943.607808:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759943.607810:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759943.607812:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759943.607830:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759943.607841:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233208320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759943.607881:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759943.607951:0:166490:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddcc01dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782759943.607977:0:166490:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166490:1869355233208192:0@lo:104: 00010000:00010000:0.0:1782759943.607996:0:166490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759943.612019:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208320 00000100:00100000:3.0:1782759943.612045:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208320 00010000:00010000:3.0:1782759943.612092:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 24 pid: 6526 timeout: 4133 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759943.612133:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1782759943.612142:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233208320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759943.612169:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759943.612175:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 24 pid: 6526 timeout: 4133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612187:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 24 pid: 6526 timeout: 4133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612204:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a6400/0xd5b45c7f5c60e722 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e71b expref: 24 pid: 6526 timeout: 4133 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612219:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612227:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612245:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612251:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612257:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612263:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612268:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:3.0:1782759943.612272:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612280:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612294:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759943.612304:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759943.612743:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3662:x1869355233208320:12345-0@lo:103:ldlm_bl.0 Request processed in 601us (4860us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759943.612752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1782759943.612915:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233208320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759943.613280:0:166490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759943.613291:0:166490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759943.613298:0:166490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e753 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759944.076517:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233208448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759944.076622:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759944.076815:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208448 00000100:00100000:0.0:1782759944.076823:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208448 00000100:00100000:0.0:1782759944.076890:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3633 00000100:00100000:0.0:1782759944.076900:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233208448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759944.076941:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445654528 avail 1299415040 00000100:00100000:0.0:1782759944.076999:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc49a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233208448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759944.077006:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3633 00000100:00100000:3.0:1782759944.077652:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233208448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759944.148400:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759945.099532:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233208576:0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.099622:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233208704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.099622:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233208832:0@lo:400:kworker.0 00000100:00100000:3.0:1782759945.099680:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233208960:0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.103674:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.103674:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759945.103747:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233209216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.103793:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759945.103812:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233209728:0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.103832:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759945.103890:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208704 00000100:00100000:2.0:1782759945.103897:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208704 00000100:00100000:2.0:1782759945.103955:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209216 00000100:00100000:2.0:1782759945.103958:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209216 00000100:00100000:1.0:1782759945.104603:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233209344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.104635:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.104657:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233209856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.104674:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.104707:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208832 00000100:00100000:1.0:1782759945.104712:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208832 00000100:00100000:1.0:1782759945.104759:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3634 00000100:00100000:1.0:1782759945.104768:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233208832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.104829:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233208832:12345-0@lo:400:kworker.0 Request processed in 62us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.104835:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3634 00000100:00100000:1.0:1782759945.104867:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209728 00000100:00100000:1.0:1782759945.104870:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209728 00000100:00100000:1.0:1782759945.104904:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209344 00000100:00100000:1.0:1782759945.104907:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209344 00000100:00100000:1.0:1782759945.104929:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209856 00000100:00100000:1.0:1782759945.104931:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209856 00000100:00100000:1.0:1782759945.104944:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5710 00000100:00100000:1.0:1782759945.104949:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233208704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.104984:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3662:x1869355233208704:12345-0@lo:400:kworker.0 Request processed in 34us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.104989:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5710 00000100:00100000:1.0:1782759945.105002:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5711 00000100:00100000:1.0:1782759945.105008:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233209728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105048:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3662:x1869355233209728:12345-0@lo:400:kworker.0 Request processed in 40us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.105054:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5711 00000100:00100000:1.0:1782759945.105064:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5712 00000100:00100000:2.0:1782759945.105451:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5713 00000100:00100000:1.0:1782759945.105451:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233209344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.105458:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233209856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.105482:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233209856:12345-0@lo:400:kworker.0 Request processed in 26us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.105482:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233209344:12345-0@lo:400:kworker.0 Request processed in 413us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.105489:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5712 00000100:00100000:2.0:1782759945.105495:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5713 00000100:00100000:1.0:1782759945.105500:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5714 00000100:00100000:1.0:1782759945.105506:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233209216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105532:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3662:x1869355233209216:12345-0@lo:400:kworker.0 Request processed in 27us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.105537:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5714 00000100:00100000:2.0:1782759945.105553:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3662:1869355233208704:0@lo:400:kworker.0 00000100:00080000:1.0:1782759945.105555:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759945.105559:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759945.105564:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3662:1869355233209216:0@lo:400:kworker.0 00000100:00100000:2.0:1782759945.105573:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3662:1869355233209728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105574:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233208832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105602:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233209344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105609:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233209856:0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.105739:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.105768:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208576 00000100:00100000:1.0:1782759945.105772:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208576 00000100:00100000:0.0:1782759945.105774:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233209088:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105798:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3610 00000100:00100000:0.0:1782759945.105799:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.105804:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233208576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.105815:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233209600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.105834:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233208576:12345-0@lo:400:kworker.0 Request processed in 31us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759945.105841:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.105851:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3610 00000100:00100000:0.0:1782759945.105857:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233210112:0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.105876:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.105879:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209088 00000100:00100000:1.0:1782759945.105892:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209088 00000100:00100000:0.0:1782759945.105897:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233208576:0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.105929:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209600 00000100:00100000:1.0:1782759945.105930:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3635 00000100:00100000:0.0:1782759945.105932:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209600 00000100:00100000:1.0:1782759945.105937:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233209088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.105960:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210112 00000100:00100000:0.0:1782759945.105963:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210112 00000100:00100000:1.0:1782759945.105968:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233209088:12345-0@lo:400:kworker.0 Request processed in 33us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.105974:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3635 00000100:00080000:1.0:1782759945.105995:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759945.106005:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3378 00000100:00100000:1.0:1782759945.106023:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233209600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.106055:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233209600:12345-0@lo:400:kworker.0 Request processed in 44us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.106061:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3378 00000100:00100000:0.0:1782759945.106197:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3379 00000100:00100000:0.0:1782759945.106205:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233210112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.106235:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233210112:12345-0@lo:400:kworker.0 Request processed in 32us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759945.106241:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3379 00000100:00080000:0.0:1782759945.106259:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782759945.106274:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233209088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.106285:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233209600:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.106366:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233210112:0@lo:400:kworker.0 00000100:00100000:3.0:1782759945.108679:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759945.108765:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233209472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759945.108807:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759945.108828:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233209984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759945.108847:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759945.108943:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209472 00000100:00100000:0.0:1782759945.108950:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209472 00000100:00100000:0.0:1782759945.109011:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233209984 00000100:00100000:0.0:1782759945.109014:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233209984 00000100:00100000:0.0:1782759945.109035:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3380 00000100:00100000:0.0:1782759945.109044:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233209472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.109109:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233209472:12345-0@lo:400:kworker.0 Request processed in 66us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759945.109116:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3380 00000100:00100000:0.0:1782759945.109131:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3381 00000100:00100000:0.0:1782759945.109137:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233209984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759945.109161:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233209984:12345-0@lo:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759945.109167:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3381 00000100:00080000:3.0:1782759945.109411:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759945.109416:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759945.109442:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233209472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759945.109452:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233209984:0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.109539:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233208960 00000100:00100000:1.0:1782759945.109544:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233208960 00000100:00100000:1.0:1782759945.109604:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5715 00000100:00100000:1.0:1782759945.109612:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233208960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759945.109654:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233208960:12345-0@lo:400:kworker.0 Request processed in 44us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.109661:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5715 00000100:00100000:0.0:1782759945.109838:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233208960:0@lo:400:kworker.0 00010000:00010000:1.0:1782759945.162729:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759945.226678:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759945.226689:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759945.226694:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759945.226752:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759945.226765:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759945.226777:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759945.226804:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc358e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233210240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759945.226882:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759945.227019:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c32780 going to sleep for 11 seconds 00000100:00100000:3.0:1782759945.229054:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210240 00000100:00100000:3.0:1782759945.229122:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210240 00000100:00100000:0.0:1782759945.229380:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3611 00000100:00100000:0.0:1782759945.229392:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233210240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759945.229409:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759945.229430:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e75a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759945.229459:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759945.229470:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759945.229479:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803000, rc 0) 00000100:00100000:0.0:1782759945.229573:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233210240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759945.229606:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3611 00000100:00100000:2.0:1782759945.229751:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc358e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233210240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782759945.229770:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759945.229780:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759945.229803:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782759945.229808:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759945.229816:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759945.617298:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759945.617324:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233210368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759945.617410:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759945.620996:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210368 00000100:00100000:2.0:1782759945.621011:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210368 00000100:00100000:2.0:1782759945.621090:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2952 00000100:00100000:2.0:1782759945.621109:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233210368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759945.621143:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759945.621226:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233210368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759945.621232:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2952 00000100:00100000:2.0:1782759945.621283:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233210368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759945.625780:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcb90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233210496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759945.625864:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759945.625942:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210496 00000100:00100000:1.0:1782759945.625950:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210496 00000100:00100000:1.0:1782759945.625996:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2953 00000100:00100000:1.0:1782759945.626003:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233210496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759945.626025:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759945.626070:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233210496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759945.626077:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2953 00000100:00100000:1.0:1782759945.626122:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcb90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233210496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759946.186855:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759946.474479:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759946.474562:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759946.474669:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759946.474912:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218668032 00000100:00100000:3.0:1782759946.474922:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218668032 00000100:00100000:3.0:1782759946.474983:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218668160 00000100:00100000:3.0:1782759946.474986:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218668160 00000100:00100000:3.0:1782759946.475009:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5716 00000100:00100000:3.0:1782759946.475019:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218668032:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759946.475093:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218668032:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 76us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759946.475102:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5716 00000100:00100000:3.0:1782759946.475121:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5717 00000100:00100000:3.0:1782759946.475127:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218668160:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759946.475151:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2404:x1869355218668160:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759946.475157:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5717 00000100:00080000:3.0:1782759946.475178:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759946.475182:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782759946.476492:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218667904 00000100:00100000:1.0:1782759946.476502:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218667904 00000100:00100000:3.0:1782759946.477032:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759946.477044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3612 00000100:00100000:1.0:1782759946.477054:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218667904:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759946.477119:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218668288 00000100:00100000:0.0:1782759946.477124:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218668288 00000100:00100000:0.0:1782759946.477162:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3382 00000100:00100000:0.0:1782759946.477170:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218668288:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759946.477213:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218667904:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 160us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759946.477221:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3612 00000100:00080000:2.0:1782759946.477625:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759946.482962:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2404:x1869355218668288:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 5781us (5921us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759946.482979:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3382 00000100:00100000:0.0:1782759946.634724:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233210624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759946.634807:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759946.634880:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210624 00000100:00100000:0.0:1782759946.634888:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210624 00000100:00100000:0.0:1782759946.634968:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3636 00000100:00100000:0.0:1782759946.634976:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233210624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759946.635011:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759946.635069:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233210624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759946.635076:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3636 00000100:00100000:0.0:1782759946.635127:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233210624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759946.637289:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233210880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759946.637361:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759946.637427:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210880 00000100:00100000:2.0:1782759946.637436:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210880 00000100:00100000:2.0:1782759946.637497:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2954 00000100:00100000:2.0:1782759946.637508:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233210880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759946.637536:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759946.637593:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233210880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759946.637604:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2954 00000100:00100000:2.0:1782759946.637654:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233210880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759946.637816:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233210752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759946.637846:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759946.638315:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233210752 00000100:00100000:2.0:1782759946.638321:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233210752 00000100:00100000:2.0:1782759946.640987:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2955 00000100:00100000:2.0:1782759946.641018:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233210752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759946.641046:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759946.641149:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233210752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759946.641156:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2955 00000100:00100000:2.0:1782759946.645296:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233210752:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1782759947.212941:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759948.230484:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759948.230570:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218668416 00000100:00100000:3.0:1782759948.230609:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218668416 00000100:00100000:3.0:1782759948.230677:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3194 00000100:00100000:3.0:1782759948.230686:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcb90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+5:118323:x1869355218668416:12345-192.168.202.31@tcp:101:create_foreign_.0 00010000:00010000:3.0:1782759948.230708:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759948.230729:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2797a expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.230793:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e76f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1782759948.230951:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759948.231122:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e76f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.231140:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e76f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759948.231209:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759948.231214:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759948.231282:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e76f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.231309:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2797a expref: 7 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.231324:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e76f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2797a expref: 6 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.231332:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759948.231335:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759948.231339:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a6400, rc 0) 00000100:00100000:3.0:1782759948.231400:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcb90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+6:118323:x1869355218668416:12345-192.168.202.31@tcp:101:create_foreign_.0 Request processed in 715us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759948.231407:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3194 00010000:00010000:1.0:1782759948.235149:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759948.238557:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759948.245834:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218668672 00000100:00100000:0.0:1782759948.245852:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218668672 00000100:00100000:1.0:1782759948.246149:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3195 00000100:00100000:1.0:1782759948.246172:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+6:118323:x1869355218668672:12345-192.168.202.31@tcp:101:create_foreign_.0 00010000:00010000:1.0:1782759948.246202:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759948.246228:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e776 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27981 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246308:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246322:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246334:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246348:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246355:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246363:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759948.246476:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1782759948.246609:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246617:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246624:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246630:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246636:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759948.246641:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246648:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246660:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759948.246663:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759948.246667:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246673:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e77d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246684:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246691:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246697:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246702:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759948.246704:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246710:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246715:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff8cddc34f6b00) 00010000:00010000:1.0:1782759948.246717:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759948.246720:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246726:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e784 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246765:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e776 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27981 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246775:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759948.246777:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759948.246781:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e776 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27981 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.246790:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413000, rc 0) 00000100:00100000:1.0:1782759948.246863:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+7:118323:x1869355218668672:12345-192.168.202.31@tcp:101:create_foreign_.0 Request processed in 704us (8317us total) trans 4294968057 rc 301/301 00000100:00100000:1.0:1782759948.246870:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3195 00000100:00100000:1.0:1782759948.252454:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759948.253422:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218668928 00000100:00100000:0.0:1782759948.253433:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218668928 00000100:00100000:0.0:1782759948.253497:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3196 00000100:00100000:0.0:1782759948.253507:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:118323:x1869355218668928:12345-192.168.202.31@tcp:36:create_foreign_.0 00000100:00100000:0.0:1782759948.253647:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:118323:x1869355218668928:12345-192.168.202.31@tcp:36:create_foreign_.0 Request processed in 142us (1202us total) trans 0 rc -1/-1 00000100:00100000:0.0:1782759948.253654:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3196 00000100:00100000:3.0:1782759948.256518:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759948.256603:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218669184 00000100:00100000:1.0:1782759948.256612:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218669184 00000100:00100000:1.0:1782759948.256661:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 475 00000100:00100000:1.0:1782759948.256670:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+7:118323:x1869355218669184:12345-192.168.202.31@tcp:35:create_foreign_.0 00000100:00100000:1.0:1782759948.256911:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+8:118323:x1869355218669184:12345-192.168.202.31@tcp:35:create_foreign_.0 Request processed in 241us (399us total) trans 4294968058 rc 0/0 00000100:00100000:1.0:1782759948.256927:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 475 00000100:00100000:3.0:1782759948.268074:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759948.268174:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218669312 00000100:00100000:1.0:1782759948.268192:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218669312 00000100:00100000:1.0:1782759948.268251:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3197 00000100:00100000:1.0:1782759948.268261:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:117824:x1869355218669312:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1782759948.268288:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759948.268309:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27988 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268376:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268391:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268402:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268416:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268423:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268430:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268516:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e7a7 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268523:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268529:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759948.268571:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1782759948.268620:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759948.268646:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268660:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268667:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268673:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268687:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268694:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759948.268698:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268706:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268720:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759948.268723:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759948.268727:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268734:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268753:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268759:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268764:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268769:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759948.268772:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268778:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268785:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x239bde6e (ffff8cddc34f6b00) 00010000:00010000:1.0:1782759948.268787:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759948.268789:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268794:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e7a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x239bde6e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268821:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27988 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268833:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27988 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759948.268844:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:1.0:1782759948.268846:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759948.268848:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412c00, rc 0) 00000100:00100000:1.0:1782759948.268922:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+9:117824:x1869355218669312:12345-192.168.202.31@tcp:101:bash.0 Request processed in 661us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759948.268929:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3197 00000100:00100000:1.0:1782759948.276734:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759948.276979:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218669440 00000100:00100000:3.0:1782759948.277001:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218669440 00000100:00100000:3.0:1782759948.277065:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3198 00000100:00100000:3.0:1782759948.277077:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+9:117824:x1869355218669440:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:3.0:1782759948.277101:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759948.277124:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7ae lrc: 2/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2798f expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277211:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277226:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277237:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277270:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 3/1,0 mode: --/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277278:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277284:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277337:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277343:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277349:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277355:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277360:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759948.277364:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277371:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277383:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:3.0:1782759948.277387:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759948.277391:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277397:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e7b5 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277409:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277413:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277418:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277423:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759948.277425:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277431:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277436:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xbb4b5341 (ffff8cdee7e02000) 00010000:00010000:3.0:1782759948.277438:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759948.277441:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 2/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277445:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e7bc lrc: 0/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xbb4b5341 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277477:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7ae lrc: 1/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2798f expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277487:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:3.0:1782759948.277489:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759948.277493:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7ae lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2798f expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759948.277502:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7e00, rc 0) 00000100:00100000:3.0:1782759948.277696:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+9:117824:x1869355218669440:12345-192.168.202.31@tcp:101:bash.0 Request processed in 621us (974us total) trans 0 rc 301/301 00000100:00100000:3.0:1782759948.277704:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3198 00000100:00100000:3.0:1782759948.352022:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759948.352349:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218669696 00000100:00100000:2.0:1782759948.352360:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218669696 00000100:00100000:2.0:1782759948.352425:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3199 00000100:00100000:2.0:1782759948.352435:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+9:118324:x1869355218669696:12345-192.168.202.31@tcp:101:create_foreign_.500 00010000:00010000:2.0:1782759948.352454:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759948.352471:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e7c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27996 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759948.352596:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e7ca lrc: 3/1,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759948.352611:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e7ca lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759948.352623:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e7ca lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759948.352634:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1782759948.352746:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e7c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27996 expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759948.352764:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e7ca lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27996 expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759948.352773:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:2.0:1782759948.352776:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782759948.352779:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759948.352836:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+11:118324:x1869355218669696:12345-192.168.202.31@tcp:101:create_foreign_.500 Request processed in 403us (827us total) trans 4294968059 rc 0/0 00000100:00100000:2.0:1782759948.352844:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3199 00000100:00100000:3.0:1782759948.355540:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759948.356371:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218669952 00000100:00100000:2.0:1782759948.356385:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218669952 00000100:00100000:2.0:1782759948.356459:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3200 00000100:00100000:2.0:1782759948.356471:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+11:118324:x1869355218669952:12345-192.168.202.31@tcp:36:create_foreign_.500 00000100:00100000:2.0:1782759948.356613:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+11:118324:x1869355218669952:12345-192.168.202.31@tcp:36:create_foreign_.500 Request processed in 144us (1083us total) trans 0 rc -1/-1 00000100:00100000:2.0:1782759948.356622:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3200 00000100:00100000:1.0:1782759948.377347:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759948.377849:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670080 00000100:00100000:0.0:1782759948.377861:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670080 00000100:00100000:0.0:1782759948.377956:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3201 00000100:00100000:0.0:1782759948.377966:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+11:117824:x1869355218670080:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:0.0:1782759948.377988:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759948.378008:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e7d8 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb2799d expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378076:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 3/1,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378093:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378105:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378120:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378127:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378134:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378199:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378206:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378212:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378219:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378226:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759948.378231:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378240:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378265:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:0.0:1782759948.378269:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759948.378274:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 3/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378280:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803c00/0xd5b45c7f5c60e7df lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378291:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378297:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378302:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378306:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759948.378308:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378314:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378324:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x4e415e1b (ffff8cddc24d2c00) 00010000:00010000:0.0:1782759948.378326:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759948.378329:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378334:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e7e6 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0x4e415e1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378366:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e7d8 lrc: 1/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2799d expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378375:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:0.0:1782759948.378377:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759948.378380:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e7d8 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2799d expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759948.378388:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803600, rc 0) 00000100:00100000:0.0:1782759948.378469:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+11:117824:x1869355218670080:12345-192.168.202.31@tcp:101:bash.0 Request processed in 504us (1131us total) trans 0 rc 301/301 00000100:00100000:0.0:1782759948.378477:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3201 00000100:00100000:2.0:1782759949.194895:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233211008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759949.195009:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759949.195129:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211008 00000100:00100000:1.0:1782759949.195139:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211008 00000100:00100000:1.0:1782759949.195217:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3637 00000100:00100000:1.0:1782759949.195226:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcbb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233211008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1782759949.195258:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445654528 avail 1299415040 00000100:00100000:1.0:1782759949.201639:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcbb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233211008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6404us (6620us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759949.201654:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3637 00000100:00100000:2.0:1782759949.202008:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233211008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759949.260269:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759949.463983:0:166733:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb8354470 20000000:00000080:1.0:1782759949.464000:0:166733:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cdedb71b800 uarg=0000000000000000 00010000:00010000:1.0:1782759949.464212:0:166733:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1782759949.464247:0:166733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759949.464251:0:166733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759949.464262:0:166733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e76f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2797a expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464282:0:166733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:1.0:1782759949.464286:0:166733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759949.464290:0:166733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e7a7 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27988 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464303:0:166733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6300) 00010000:00010000:1.0:1782759949.464306:0:166733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782759949.464309:0:166733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e7ca lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27996 expref: 8 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464326:0:166733:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1782759949.464354:0:166733:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759949.464366:0:166733:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759949.464379:0:166733:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759949.464392:0:166733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464405:0:166733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464413:0:166733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464452:0:166733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759949.464465:0:166733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 23 pid: 6526 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759949.464480:0:166733:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166733:1869355233211136:0@lo:104: 00000100:00100000:1.0:1782759949.464539:0:166733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759949.464616:0:166733:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec33e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782759949.466216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211136 00000100:00100000:0.0:1782759949.466230:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211136 00000100:00100000:0.0:1782759949.466287:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:0.0:1782759949.466301:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:166733:x1869355233211136:12345-0@lo:104: 00010000:00010000:0.0:1782759949.466324:0:6513:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466427:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759949.466434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b8c55c43-51ff-4f74-a800-62b522e56789+3:166733:x1869355233211136:12345-0@lo:104: Request processed in 139us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759949.466441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00010000:00010000:0.0:1782759949.466467:0:9533:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782759949.466473:0:9533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466480:0:9533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648200 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:0.0:1782759949.466484:0:9533:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466492:0:9533:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782759949.466499:0:9533:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759949.466505:0:9533:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1782759949.466540:0:9533:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466546:0:9533:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782759949.466566:0:9533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466573:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf648200/0xd5b45c7f5c60e75a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e761 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466609:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759949.466611:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782759949.466612:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759949.466635:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233211264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782759949.466669:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759949.466712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211264 00000100:00100000:0.0:1782759949.466716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211264 00010000:00010000:0.0:1782759949.466736:0:6517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 24 pid: 6526 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759949.466756:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1782759949.466762:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233211264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759949.466774:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759949.466779:0:6517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 24 pid: 6526 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466789:0:6517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 24 pid: 6526 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466806:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466814:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466827:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466833:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466840:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466852:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466857:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759949.466861:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466868:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466932:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759949.466941:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759949.466969:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233211264:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759949.466976:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:0.0:1782759949.467012:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc1f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233211264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782759949.467498:0:166733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf803000/0xd5b45c7f5c60e761 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e75a expref: 23 pid: 6526 timeout: 4139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759949.467510:0:166733:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:166733:1869355233211136:0@lo:104: 00010000:00010000:3.0:1782759949.467525:0:166733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759949.467532:0:166733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759949.467538:0:166733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759949.467547:0:166733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413200/0xd5b45c7f5c60e7ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 166733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782759949.477099:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968059 is committed 00000100:00100000:3.0:1782759950.219271:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233211776:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.219308:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233211648:0@lo:400:kworker.0 00000100:00100000:3.0:1782759950.219339:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759950.219339:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759950.219402:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233211392:0@lo:400:kworker.0 00000100:00100000:3.0:1782759950.221910:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233212288:0@lo:400:kworker.0 00000100:00100000:3.0:1782759950.221967:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759950.221995:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233212800:0@lo:400:kworker.0 00000100:00100000:3.0:1782759950.222018:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759950.222303:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212288 00000100:00100000:1.0:1782759950.222311:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212288 00000100:00100000:1.0:1782759950.222360:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212800 00000100:00100000:1.0:1782759950.222363:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212800 00000100:00100000:1.0:1782759950.222391:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3383 00000100:00100000:1.0:1782759950.222400:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233212288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.222461:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233212288:12345-0@lo:400:kworker.0 Request processed in 62us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759950.222469:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3383 00000100:00100000:1.0:1782759950.222485:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3384 00000100:00100000:1.0:1782759950.222491:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233212800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.222519:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233212800:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759950.222525:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3384 00000100:00100000:1.0:1782759950.222561:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233212288:0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.222573:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233212800:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.224772:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211776 00000100:00100000:2.0:1782759950.224782:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211776 00000100:00100000:2.0:1782759950.224835:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5718 00000100:00100000:2.0:1782759950.224845:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233211776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.224930:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3664:x1869355233211776:12345-0@lo:400:kworker.0 Request processed in 87us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759950.224937:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5718 00000100:00100000:2.0:1782759950.224979:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3664:1869355233211776:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225007:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233212160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225048:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759950.225068:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212160 00000100:00100000:2.0:1782759950.225071:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212160 00000100:00100000:2.0:1782759950.225099:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5719 00000100:00100000:2.0:1782759950.225106:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233212160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225135:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3663:x1869355233212160:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759950.225141:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5719 00000100:00100000:2.0:1782759950.225188:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3663:1869355233212160:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225195:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233212672:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225215:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759950.225240:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1782759950.225247:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233211520:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225266:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759950.225286:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212672 00000100:00100000:2.0:1782759950.225290:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212672 00000100:00100000:2.0:1782759950.225314:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211520 00000100:00100000:2.0:1782759950.225317:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211520 00000100:00100000:2.0:1782759950.225333:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5720 00000100:00100000:2.0:1782759950.225340:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233212672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225368:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3663:x1869355233212672:12345-0@lo:400:kworker.0 Request processed in 29us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759950.225374:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5720 00000100:00100000:2.0:1782759950.225385:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5721 00000100:00100000:2.0:1782759950.225391:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233211520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225416:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233211520:12345-0@lo:400:kworker.0 Request processed in 26us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759950.225421:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5721 00000100:00100000:2.0:1782759950.225448:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233211520:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225454:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233212032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225799:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759950.225818:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212032 00000100:00100000:2.0:1782759950.225822:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212032 00000100:00100000:2.0:1782759950.225845:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5722 00000100:00100000:2.0:1782759950.225853:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233212032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225892:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233212032:12345-0@lo:400:kworker.0 Request processed in 41us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759950.225898:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5722 00000100:00100000:2.0:1782759950.225924:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233212032:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225930:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233212544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.225953:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759950.225967:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212544 00000100:00100000:2.0:1782759950.225971:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212544 00000100:00100000:2.0:1782759950.225993:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5723 00000100:00100000:2.0:1782759950.225998:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233212544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.226085:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233212544:12345-0@lo:400:kworker.0 Request processed in 86us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759950.226091:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5723 00000100:00100000:2.0:1782759950.226116:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233212544:0@lo:400:kworker.0 00000100:00100000:2.0:1782759950.226127:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3663:1869355233212672:0@lo:400:kworker.0 00000100:00100000:3.0:1782759950.227741:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211648 00000100:00100000:3.0:1782759950.227750:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211648 00000100:00100000:3.0:1782759950.227812:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3638 00000100:00100000:3.0:1782759950.227820:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233211648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759950.227896:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233211648:12345-0@lo:400:kworker.0 Request processed in 76us (8557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759950.227903:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3638 00000100:00100000:3.0:1782759950.227941:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233211648:0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.228107:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759950.228148:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233211904:0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.228233:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211392 00000100:00100000:1.0:1782759950.228247:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211392 00000100:00100000:1.0:1782759950.228283:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3613 00000100:00100000:1.0:1782759950.228289:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233211392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.228324:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:3665:x1869355233211392:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759950.228330:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3613 00000100:00100000:0.0:1782759950.228473:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759950.228497:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233212416:0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.228521:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759950.228546:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233212928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.228568:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782759950.228607:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782759950.228613:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1782759950.228616:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759950.228619:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759950.228630:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212416 00000100:00100000:0.0:1782759950.228633:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212416 00000100:00100000:0.0:1782759950.228664:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233212928 00000100:00100000:0.0:1782759950.228667:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233212928 00000100:00100000:0.0:1782759950.228698:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3385 00000100:00100000:0.0:1782759950.228705:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233212416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.228736:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233212416:12345-0@lo:400:kworker.0 Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759950.228742:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3385 00000100:00100000:0.0:1782759950.228753:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3386 00000100:00100000:0.0:1782759950.228758:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233212928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.228784:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233212928:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759950.228789:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3386 00000100:00080000:0.0:1782759950.229036:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759950.229039:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759950.229065:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233212928:0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.229084:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233211392:0@lo:400:kworker.0 00000100:00100000:0.0:1782759950.229094:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233212416:0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.229312:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233211904 00000100:00100000:1.0:1782759950.229317:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233211904 00000100:00100000:1.0:1782759950.229387:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3639 00000100:00100000:1.0:1782759950.229395:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233211904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759950.229440:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233211904:12345-0@lo:400:kworker.0 Request processed in 46us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759950.229446:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3639 00000100:00100000:0.0:1782759950.229498:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc479ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233211904:0@lo:400:kworker.0 00010000:00010000:1.0:1782759950.285835:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1782759950.666667:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1782759950.666676:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:0.0:1782759950.666681:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1782759950.666741:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759950.666753:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759950.666764:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759950.666789:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233213056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782759950.666857:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759950.666912:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cdec8afae40 going to sleep for 11 seconds 00000100:00100000:3.0:1782759950.667167:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213056 00000100:00100000:3.0:1782759950.667174:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213056 00000100:00100000:3.0:1782759950.667228:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3614 00000100:00100000:3.0:1782759950.667237:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233213056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759950.667251:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759950.667264:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e7f4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759950.667293:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759950.667304:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759950.667314:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7e00, rc 0) 00000100:00100000:3.0:1782759950.667360:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233213056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759950.667367:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3614 00000100:00100000:0.0:1782759950.667540:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233213056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759950.667554:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759950.667562:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759950.667602:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759950.667607:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759950.667615:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759950.730793:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233213184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759950.730876:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759950.731232:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213184 00000100:00100000:1.0:1782759950.731241:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213184 00000100:00100000:1.0:1782759950.731287:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1782759950.731296:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233213184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759950.731327:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759950.731377:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233213184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759950.731384:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2956 00000100:00100000:1.0:1782759950.731431:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233213184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759950.745231:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233213312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759950.745301:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759950.745925:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213312 00000100:00100000:0.0:1782759950.745934:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213312 00000100:00100000:0.0:1782759950.745988:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2957 00000100:00100000:0.0:1782759950.745999:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233213312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759950.746033:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759950.746099:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233213312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759950.746106:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2957 00000100:00100000:3.0:1782759950.746285:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233213312:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759951.307751:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759951.582217:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759951.582259:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759951.582291:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759951.582326:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759951.582407:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670464 00000100:00100000:1.0:1782759951.582416:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670464 00000100:00100000:1.0:1782759951.582481:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670336 00000100:00100000:1.0:1782759951.582485:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670336 00000100:00100000:1.0:1782759951.582507:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5724 00000100:00100000:1.0:1782759951.582515:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218670464:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759951.582615:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218670464:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 100us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759951.582624:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5724 00000100:00100000:1.0:1782759951.582640:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5725 00000100:00100000:1.0:1782759951.582646:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218670336:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759951.582672:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218670336:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759951.582678:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5725 00000100:00100000:3.0:1782759951.582917:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670208 00000100:00100000:3.0:1782759951.582922:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670208 00000100:00100000:3.0:1782759951.582955:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3615 00000100:00100000:3.0:1782759951.582962:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218670208:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759951.583006:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218670208:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759951.583012:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3615 00000100:00100000:3.0:1782759951.583039:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670592 00000100:00100000:3.0:1782759951.583042:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670592 00000100:00100000:3.0:1782759951.583070:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3387 00000100:00100000:3.0:1782759951.583075:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218670592:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759951.583102:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218670592:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759951.583107:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3387 00000100:00080000:2.0:1782759951.583243:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759951.583248:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759951.583251:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1782759951.755299:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233213440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759951.755376:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759951.755458:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213440 00000100:00100000:2.0:1782759951.755465:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213440 00000100:00100000:2.0:1782759951.755519:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2958 00000100:00100000:2.0:1782759951.755529:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233213440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759951.755562:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759951.755631:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233213440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759951.755643:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2958 00000100:00100000:2.0:1782759951.755693:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233213440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759951.755835:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233213568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759951.755876:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759951.756063:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213568 00000100:00100000:0.0:1782759951.756068:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213568 00000100:00100000:0.0:1782759951.756118:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2959 00000100:00100000:0.0:1782759951.756125:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233213568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782759951.756149:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1782759951.756220:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233213568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759951.756243:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2959 00000100:00100000:0.0:1782759951.756263:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcbb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233213696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759951.756312:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759951.756363:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213696 00000100:00100000:0.0:1782759951.756382:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213696 00000100:00100000:0.0:1782759951.756466:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3640 00000100:00100000:0.0:1782759951.756488:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233213696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759951.756539:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759951.756683:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233213696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 183us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759951.756708:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3640 00000100:00100000:0.0:1782759951.756760:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcbb76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233213696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759951.756812:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4435500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233213568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759952.333556:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759953.354721:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759953.755759:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759953.756266:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670848 00000100:00100000:3.0:1782759953.756278:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670848 00000100:00100000:3.0:1782759953.756361:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3202 00000100:00100000:3.0:1782759953.756372:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:118407:x1869355218670848:12345-192.168.202.31@tcp:36:create_foreign_.0 00010000:00010000:3.0:1782759953.756489:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 3/0,1 mode: --/CW res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.756505:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.756518:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.756530:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.756536:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.756543:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782759953.756614:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782759953.758660:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758684:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758701:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759953.758714:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000198f2532 reply state 00000000040ff110 transno 4294968060 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758725:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758732:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x6:0x0].0x0 (ffff8cdee7e02e00) 00010000:00010000:3.0:1782759953.758736:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759953.758739:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759953.758746:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x6:0x0]: returning size 4096 00010000:00010000:3.0:1782759953.758755:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758763:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758769:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758775:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.758781:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759953.758786:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.760915:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 5/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.760954:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cdee7e02000) 00010000:00010000:3.0:1782759953.760957:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759953.760964:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 3/0,0 mode: --/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.760972:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e802 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759953.760996:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000198f2532 reply state 00000000040ff110 transno 4294968060 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.761007:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.761015:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xd8f104ef (ffff8cdee7e02f00) 00010000:00010000:3.0:1782759953.761017:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759953.761021:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782759953.761134:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:118407:x1869355218670848:12345-192.168.202.31@tcp:36:create_foreign_.0 Request processed in 4759us (5380us total) trans 4294968060 rc 0/0 00000100:00100000:3.0:1782759953.761143:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3202 00000100:00100000:2.0:1782759953.807930:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759953.808000:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218670976 00000100:00100000:1.0:1782759953.808011:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218670976 00000100:00100000:1.0:1782759953.808071:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3203 00000100:00100000:1.0:1782759953.808082:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+7:118408:x1869355218670976:12345-192.168.202.31@tcp:101:parse_foreign_d.0 00010000:00010000:1.0:1782759953.808106:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759953.808129:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e817 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279a4 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808189:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 3/1,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808203:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808213:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808224:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808232:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808238:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808313:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e82c lrc: 3/1,0 mode: --/PR res: [0x200000422:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808326:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e82c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808332:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e82c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759953.808372:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x6:0x0]: returning size 4096 00000004:00200000:1.0:1782759953.808377:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 36 MDT count 2 00000004:00010000:1.0:1782759953.808425:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e82c lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808438:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808444:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808450:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808456:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808462:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759953.808466:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808473:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808486:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6c00) 00010000:00010000:1.0:1782759953.808489:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759953.808495:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 3/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808500:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e81e lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808513:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808519:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808524:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808528:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759953.808531:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808536:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808542:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xd8f104ef (ffff8cdee7e02f00) 00010000:00010000:1.0:1782759953.808544:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759953.808547:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808552:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e825 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808599:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e817 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279a4 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808624:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e82c lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279a4 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.808630:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x6:0x0].0x0 (ffff8cdee7e02e00) 00010000:00010000:1.0:1782759953.808633:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759953.808635:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413000, rc 0) 00000100:00100000:1.0:1782759953.808700:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+8:118408:x1869355218670976:12345-192.168.202.31@tcp:101:parse_foreign_d.0 Request processed in 619us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759953.808708:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3203 00000100:00100000:1.0:1782759953.812536:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759953.813088:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218671104 00000100:00100000:0.0:1782759953.813099:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218671104 00000100:00100000:0.0:1782759953.813153:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 476 00000100:00100000:0.0:1782759953.813164:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+8:118408:x1869355218671104:12345-192.168.202.31@tcp:49:parse_foreign_d.0 00000100:00100000:0.0:1782759953.813324:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+8:118408:x1869355218671104:12345-192.168.202.31@tcp:49:parse_foreign_d.0 Request processed in 161us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759953.813332:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 476 00000100:00100000:2.0:1782759953.823974:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759953.828522:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218671232 00000100:00100000:0.0:1782759953.828538:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218671232 00000100:00100000:0.0:1782759953.828902:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 477 00000100:00100000:0.0:1782759953.828916:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3befc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+8:118408:x1869355218671232:12345-192.168.202.31@tcp:49:parse_foreign_d.0 00000100:00100000:0.0:1782759953.829163:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3befc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+8:118408:x1869355218671232:12345-192.168.202.31@tcp:49:parse_foreign_d.0 Request processed in 250us (5197us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759953.829172:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 477 00000100:00100000:0.0:1782759953.875903:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759953.875984:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218671488 00000100:00100000:3.0:1782759953.875994:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218671488 00000100:00100000:3.0:1782759953.876056:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3204 00000100:00100000:3.0:1782759953.876067:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+8:118410:x1869355218671488:12345-192.168.202.31@tcp:36:create_foreign_.500 00010000:00010000:3.0:1782759953.876196:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 3/0,1 mode: --/CW res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876213:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876229:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876241:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,1 mode: --/PW res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876248:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876254:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876768:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876779:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876785:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759953.876797:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5657082 reply state 0000000090f07e81 transno 4294968061 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876808:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876816:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x7:0x0].0x0 (ffff8cdee7e02d00) 00010000:00010000:3.0:1782759953.876819:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759953.876822:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1782759953.876827:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x7:0x0]: returning size 4096 00010000:00010000:3.0:1782759953.876852:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876859:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876864:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876870:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876875:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759953.876878:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876886:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 5/0,0 mode: CW/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876895:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cdee7e02000) 00010000:00010000:3.0:1782759953.876897:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759953.876900:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 3/0,0 mode: --/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876905:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e833 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782759953.876920:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5657082 reply state 0000000090f07e81 transno 4294968061 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876928:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759953.876937:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xeb6b0b51 (ffff8cdee7e02600) 00010000:00010000:3.0:1782759953.876939:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1782759953.876941:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1782759953.877032:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+10:118410:x1869355218671488:12345-192.168.202.31@tcp:36:create_foreign_.500 Request processed in 965us (1135us total) trans 4294968061 rc 0/0 00000100:00100000:3.0:1782759953.877039:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3204 00000100:00100000:2.0:1782759953.911156:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759953.916562:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218671616 00000100:00100000:1.0:1782759953.916598:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218671616 00000100:00100000:1.0:1782759953.916668:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3205 00000100:00100000:1.0:1782759953.916679:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+10:118411:x1869355218671616:12345-192.168.202.31@tcp:101:parse_foreign_d.0 00010000:00010000:1.0:1782759953.916703:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759953.916726:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e848 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279ab expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916793:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 3/1,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916808:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916820:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916846:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916855:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916862:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916939:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e85d lrc: 3/1,0 mode: --/PR res: [0x200000422:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916948:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e85d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.916954:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e85d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759953.917000:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1782759953.917005:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 36 MDT count 2 00000004:00010000:1.0:1782759953.917026:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e85d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917038:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917044:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917049:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917060:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917066:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759953.917070:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917077:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917090:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6c00) 00010000:00010000:1.0:1782759953.917093:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759953.917097:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 3/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917103:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e84f lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917117:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917123:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917128:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917133:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759953.917135:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917145:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917152:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xeb6b0b51 (ffff8cdee7e02600) 00010000:00010000:1.0:1782759953.917154:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759953.917157:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917162:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413400/0xd5b45c7f5c60e856 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917183:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e848 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ab expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917201:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e85d lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x7:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ab expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759953.917208:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x7:0x0].0x0 (ffff8cdee7e02d00) 00010000:00010000:1.0:1782759953.917211:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782759953.917213:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413200, rc 0) 00000100:00100000:1.0:1782759953.917279:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+11:118411:x1869355218671616:12345-192.168.202.31@tcp:101:parse_foreign_d.0 Request processed in 602us (6132us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759953.917287:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3205 00000100:00100000:2.0:1782759953.933460:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759953.939936:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218671744 00000100:00100000:3.0:1782759953.939951:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218671744 00000100:00100000:3.0:1782759953.940010:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 478 00000100:00100000:3.0:1782759953.940020:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+11:118411:x1869355218671744:12345-192.168.202.31@tcp:49:parse_foreign_d.0 00000100:00100000:3.0:1782759953.940182:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+11:118411:x1869355218671744:12345-192.168.202.31@tcp:49:parse_foreign_d.0 Request processed in 162us (6729us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759953.940190:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 478 00000100:00100000:3.0:1782759953.949528:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759953.949564:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218671872 00000100:00100000:3.0:1782759953.949596:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218671872 00000100:00100000:3.0:1782759953.949648:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 479 00000100:00100000:3.0:1782759953.949658:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+11:118411:x1869355218671872:12345-192.168.202.31@tcp:49:parse_foreign_d.0 00000100:00100000:3.0:1782759953.949800:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+11:118411:x1869355218671872:12345-192.168.202.31@tcp:49:parse_foreign_d.0 Request processed in 143us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759953.949808:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 479 00000100:00100000:3.0:1782759954.315080:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233213824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759954.315155:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759954.315231:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213824 00000100:00100000:3.0:1782759954.315240:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213824 00000100:00100000:3.0:1782759954.315304:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3641 00000100:00100000:3.0:1782759954.315313:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233213824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759954.315349:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445646336 avail 1299406848 00000100:00100000:3.0:1782759954.315400:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3663:x1869355233213824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759954.315408:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3641 00000100:00100000:3.0:1782759954.315458:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233213824:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1782759954.381933:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759954.685353:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759954.685430:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672128 00000100:00100000:1.0:1782759954.685441:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672128 00000100:00100000:1.0:1782759954.685508:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3206 00000100:00100000:1.0:1782759954.685519:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+11:118421:x1869355218672128:12345-192.168.202.31@tcp:36:create_foreign_.0 00000100:00100000:1.0:1782759954.685681:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+11:118421:x1869355218672128:12345-192.168.202.31@tcp:36:create_foreign_.0 Request processed in 163us (528us total) trans 0 rc -1/-1 00000100:00100000:1.0:1782759954.685689:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3206 00000100:00100000:3.0:1782759954.690891:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759954.690990:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672256 00000100:00100000:1.0:1782759954.691001:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672256 00000100:00100000:1.0:1782759954.691066:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3207 00000100:00100000:1.0:1782759954.691077:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+11:117824:x1869355218672256:12345-192.168.202.31@tcp:101:bash.0 00010000:00010000:1.0:1782759954.691108:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759954.691132:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e864 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279b2 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691207:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 3/1,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691222:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691233:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691298:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691308:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691315:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691357:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691365:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691371:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691378:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691384:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759954.691388:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691396:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691409:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6c00) 00010000:00010000:1.0:1782759954.691412:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759954.691417:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 3/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691424:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e86b lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691437:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691443:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691448:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691453:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759954.691456:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691461:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691468:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xaa0d5278 (ffff8cddc34f6500) 00010000:00010000:1.0:1782759954.691470:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759954.691473:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691478:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e872 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x3:0x0].0xaa0d5278 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691508:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e864 lrc: 1/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279b2 expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691517:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0x0 (ffff8cddc34f6c00) 00010000:00010000:1.0:1782759954.691520:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759954.691523:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e864 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279b2 expref: 12 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759954.691534:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413c00, rc 0) 00000100:00100000:1.0:1782759954.691625:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+11:117824:x1869355218672256:12345-192.168.202.31@tcp:101:bash.0 Request processed in 549us (744us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759954.691633:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3207 00000100:00100000:3.0:1782759955.339103:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233214208:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339187:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759955.339255:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233214720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339282:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759955.339303:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233215232:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339323:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759955.339345:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1782759955.339350:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233214336:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339370:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759955.339389:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233214848:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339411:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759955.339425:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233215360:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339444:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759955.339475:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214720 00000100:00100000:3.0:1782759955.339482:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214720 00000100:00100000:3.0:1782759955.339536:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215232 00000100:00100000:3.0:1782759955.339539:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215232 00000100:00100000:3.0:1782759955.339572:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214336 00000100:00100000:3.0:1782759955.339630:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214336 00000100:00100000:3.0:1782759955.339655:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5726 00000100:00100000:3.0:1782759955.339664:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233214720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339725:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233214720:12345-0@lo:400:kworker.0 Request processed in 62us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759955.339732:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5726 00000100:00100000:3.0:1782759955.339749:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5727 00000100:00100000:3.0:1782759955.339755:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233215232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339791:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233215232:12345-0@lo:400:kworker.0 Request processed in 36us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759955.339796:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5727 00000100:00100000:3.0:1782759955.339806:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5728 00000100:00100000:3.0:1782759955.339812:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233214336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339851:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233214336:12345-0@lo:400:kworker.0 Request processed in 40us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759955.339857:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5728 00000100:00100000:3.0:1782759955.339896:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233214336:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339907:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233214720:0@lo:400:kworker.0 00000100:00100000:3.0:1782759955.339915:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233215232:0@lo:400:kworker.0 00000100:00100000:1.0:1782759955.340289:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214208 00000100:00100000:1.0:1782759955.340295:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214208 00000100:00100000:1.0:1782759955.340352:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3642 00000100:00100000:1.0:1782759955.340361:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233214208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759955.340411:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233214208:12345-0@lo:400:kworker.0 Request processed in 51us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759955.340417:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3642 00000100:00100000:1.0:1782759955.340455:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233214208:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340543:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233213952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340628:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340654:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233214464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340677:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340693:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233214976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340712:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340727:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233215488:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340746:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340774:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1782759955.340780:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233214080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340801:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340819:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233214592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340853:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340869:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233215104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.340890:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.340914:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214848 00000100:00100000:0.0:1782759955.340918:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214848 00000100:00100000:0.0:1782759955.340950:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215360 00000100:00100000:0.0:1782759955.340954:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215360 00000100:00100000:0.0:1782759955.340966:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214976 00000100:00100000:0.0:1782759955.340968:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214976 00000100:00100000:0.0:1782759955.340982:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215488 00000100:00100000:0.0:1782759955.340984:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215488 00000100:00100000:0.0:1782759955.340997:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1782759955.341003:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233214848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.341038:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233214848:12345-0@lo:400:kworker.0 Request processed in 36us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.341045:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3388 00000100:00100000:0.0:1782759955.341057:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3389 00000100:00100000:0.0:1782759955.341062:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233215360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759955.341358:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233213952 00000100:00100000:1.0:1782759955.341363:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233213952 00000100:00100000:1.0:1782759955.341393:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3616 00000100:00100000:1.0:1782759955.341400:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233213952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759955.341439:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233213952:12345-0@lo:400:kworker.0 Request processed in 40us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759955.341447:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3616 00000100:00100000:1.0:1782759955.341495:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233214848:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.341610:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233215360:12345-0@lo:400:kworker.0 Request processed in 547us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.341617:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3389 00000100:00100000:0.0:1782759955.341629:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3390 00000100:00100000:0.0:1782759955.341635:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233214976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.341664:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233214976:12345-0@lo:400:kworker.0 Request processed in 28us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.341669:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3390 00000100:00100000:0.0:1782759955.341679:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3391 00000100:00100000:0.0:1782759955.341685:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.341711:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233215488:12345-0@lo:400:kworker.0 Request processed in 26us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.341716:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3391 00000100:00100000:0.0:1782759955.341737:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214464 00000100:00100000:0.0:1782759955.341740:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214464 00000100:00100000:0.0:1782759955.341888:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643 00000100:00100000:0.0:1782759955.341896:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233214464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.341929:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233214464:12345-0@lo:400:kworker.0 Request processed in 35us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.341935:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643 00000100:00100000:0.0:1782759955.341964:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214080 00000100:00100000:0.0:1782759955.341968:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214080 00000100:00100000:0.0:1782759955.341984:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233214592 00000100:00100000:0.0:1782759955.341987:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233214592 00000100:00100000:0.0:1782759955.341997:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215104 00000100:00100000:0.0:1782759955.342000:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215104 00000100:00100000:0.0:1782759955.342024:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5729 00000100:00100000:0.0:1782759955.342030:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233214080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342058:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233214080:12345-0@lo:400:kworker.0 Request processed in 28us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.342064:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5729 00000100:00100000:1.0:1782759955.342215:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233215360:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342328:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5730 00000100:00100000:0.0:1782759955.342337:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233214592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342368:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233214592:12345-0@lo:400:kworker.0 Request processed in 33us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.342374:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5730 00000100:00100000:0.0:1782759955.342384:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5731 00000100:00100000:0.0:1782759955.342390:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233215104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342414:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233215104:12345-0@lo:400:kworker.0 Request processed in 25us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.342419:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5731 00000100:00100000:0.0:1782759955.342453:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233214080:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342462:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233214592:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342472:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233215104:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342480:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4bd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233213952:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342490:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233214464:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342500:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233214976:0@lo:400:kworker.0 00000100:00100000:0.0:1782759955.342510:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233215488:0@lo:400:kworker.0 00000100:00080000:2.0:1782759955.342651:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782759955.342658:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759955.342661:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759955.342664:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1782759955.402884:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759955.850847:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782759955.850868:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233215616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759955.850938:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759955.851039:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215616 00000100:00100000:1.0:1782759955.851107:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215616 00000100:00100000:1.0:1782759955.851160:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2960 00000100:00100000:1.0:1782759955.851169:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233215616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759955.851201:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759955.851257:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233215616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759955.851264:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2960 00000100:00100000:3.0:1782759955.852997:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233215616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782759955.853195:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233215744:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759955.853249:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759955.853322:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215744 00000100:00100000:0.0:1782759955.853327:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215744 00000100:00100000:0.0:1782759955.853365:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2961 00000100:00100000:0.0:1782759955.853373:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233215744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1782759955.853394:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:0.0:1782759955.854351:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233215744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 974us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759955.854361:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2961 00000100:00100000:3.0:1782759955.854503:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233215744:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759956.428980:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759956.703405:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759956.703446:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759956.703474:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759956.703517:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759956.703566:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672640 00000100:00100000:0.0:1782759956.703598:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672512 00000100:00100000:0.0:1782759956.703605:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672512 00000100:00100000:2.0:1782759956.703614:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672640 00000100:00100000:1.0:1782759956.703671:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672384 00000100:00100000:0.0:1782759956.703678:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5732 00000100:00100000:1.0:1782759956.703679:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672384 00000100:00100000:0.0:1782759956.703693:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+11:2405:x1869355218672512:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759956.703724:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3617 00000100:00100000:1.0:1782759956.703734:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218672384:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759956.703774:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2405:x1869355218672384:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 38us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759956.703774:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+11:2405:x1869355218672512:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759956.703787:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3617 00000100:00100000:0.0:1782759956.703789:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5732 00000100:00100000:0.0:1782759956.703826:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672768 00000100:00100000:0.0:1782759956.703830:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672768 00000100:00100000:2.0:1782759956.703964:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5733 00000100:00100000:2.0:1782759956.703981:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218672640:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759956.704009:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3392 00000100:00100000:2.0:1782759956.704010:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+5:2405:x1869355218672640:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759956.704016:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5733 00000100:00100000:0.0:1782759956.704016:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218672768:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759956.704044:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2405:x1869355218672768:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759956.704051:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3392 00000100:00080000:3.0:1782759956.704079:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782759956.704084:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759956.704086:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759956.874903:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782759956.874929:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233215872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759956.875004:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759956.876902:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233216000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759956.876967:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759956.877071:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216000 00000100:00100000:3.0:1782759956.877079:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216000 00000100:00100000:3.0:1782759956.877189:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3644 00000100:00100000:3.0:1782759956.877199:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233216000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1782759956.877234:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:3.0:1782759956.877284:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233216000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759956.877292:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3644 00000100:00100000:2.0:1782759956.878339:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233215872 00000100:00100000:2.0:1782759956.878346:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233215872 00000100:00100000:2.0:1782759956.878421:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759956.878432:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233215872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759956.878463:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759956.878530:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233215872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (3526us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759956.878538:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2962 00000100:00100000:2.0:1782759956.878617:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233216128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759956.878652:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759956.878694:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216128 00000100:00100000:2.0:1782759956.878698:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216128 00000100:00100000:2.0:1782759956.878723:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2963 00000100:00100000:2.0:1782759956.878730:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233216128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759956.878741:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759956.878769:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233216128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759956.878775:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2963 00000100:00100000:2.0:1782759956.878828:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233216128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759956.878879:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233216000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759956.880659:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233215872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782759957.464692:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759958.476413:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759959.436398:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233216256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759959.436480:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759959.436556:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216256 00000100:00100000:3.0:1782759959.436562:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216256 00000100:00100000:3.0:1782759959.436645:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3645 00000100:00100000:3.0:1782759959.436654:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233216256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759959.436691:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445646336 avail 1299406848 00000100:00100000:3.0:1782759959.436741:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233216256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759959.436749:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3645 00000100:00100000:3.0:1782759959.436819:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233216256:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1782759959.449863:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968061 is committed 00010000:00010000:0.0:1782759959.449958:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.449972:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.449981:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.449987:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6c00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759959.449994:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450003:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450023:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xd8f104ef (ffff8cdee7e02f00) 00010000:00010000:0.0:1782759959.450026:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759959.450031:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450036:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6c00/0xd5b45c7f5c60e809 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x3:0x0].0xd8f104ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450055:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450061:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450073:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450077:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759959.450080:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450085:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450091:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x6:0x0].0x0 (ffff8cdee7e02e00) 00010000:00010000:0.0:1782759959.450093:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759959.450095:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450100:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60e810 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450113:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450118:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450123:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450127:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759959.450129:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450138:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450145:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x3:0x0].0xeb6b0b51 (ffff8cdee7e02600) 00010000:00010000:0.0:1782759959.450148:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759959.450150:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450156:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60e83a lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x3:0x0].0xeb6b0b51 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450168:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450173:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450179:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450184:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759959.450187:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450192:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450199:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x7:0x0].0x0 (ffff8cdee7e02d00) 00010000:00010000:0.0:1782759959.450201:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759959.450203:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759959.450209:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e841 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759959.498697:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759960.458919:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233216768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.458992:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459039:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233217280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459061:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459074:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233217792:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459091:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459111:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1782759960.459116:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233216384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459138:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459154:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233216896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459172:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459185:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233217408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459200:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459209:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233217920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459225:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459245:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233216512:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459263:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459277:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233217024:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459295:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459307:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233217536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459326:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759960.459339:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216768 00000100:00100000:3.0:1782759960.459340:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759960.459344:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233216640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.459347:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216768 00000100:00100000:3.0:1782759960.459362:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459375:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233217152:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459393:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759960.459393:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216512 00000100:00100000:2.0:1782759960.459396:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216512 00000100:00100000:3.0:1782759960.459404:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233217664:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.459409:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217024 00000100:00100000:2.0:1782759960.459411:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217024 00000100:00100000:3.0:1782759960.459422:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759960.459440:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216896 00000100:00100000:3.0:1782759960.459443:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216896 00000100:00100000:3.0:1782759960.459482:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216640 00000100:00100000:3.0:1782759960.459484:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216640 00000100:00100000:3.0:1782759960.459500:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3646 00000100:00100000:3.0:1782759960.459508:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233216896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.459515:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217536 00000100:00100000:2.0:1782759960.459518:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217536 00000100:00100000:3.0:1782759960.459565:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233216896:12345-0@lo:400:kworker.0 Request processed in 56us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759960.459572:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3646 00000100:00100000:3.0:1782759960.459614:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3647 00000100:00100000:3.0:1782759960.459621:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233216640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459653:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233216640:12345-0@lo:400:kworker.0 Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759960.459659:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3647 00000100:00100000:3.0:1782759960.459677:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217152 00000100:00100000:3.0:1782759960.459680:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217152 00000100:00100000:3.0:1782759960.459695:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217664 00000100:00100000:3.0:1782759960.459697:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217664 00000100:00100000:2.0:1782759960.459698:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5734 00000100:00100000:2.0:1782759960.459704:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233216768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459709:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5735 00000100:00100000:3.0:1782759960.459714:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233216512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.459737:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233216512:12345-0@lo:400:kworker.0 Request processed in 22us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759960.459737:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+8:3662:x1869355233216768:12345-0@lo:400:kworker.0 Request processed in 35us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759960.459743:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5735 00000100:00100000:2.0:1782759960.459755:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5734 00000100:00100000:2.0:1782759960.459766:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5736 00000100:00100000:2.0:1782759960.459773:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233217024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.459814:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233217024:12345-0@lo:400:kworker.0 Request processed in 43us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759960.459819:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5736 00000100:00100000:1.0:1782759960.459819:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233216384 00000100:00100000:1.0:1782759960.459823:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233216384 00000100:00100000:2.0:1782759960.459830:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5737 00000100:00100000:2.0:1782759960.459836:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233217152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759960.459848:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3618 00000100:00100000:1.0:1782759960.459853:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233216384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.459860:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233217152:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759960.459865:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5737 00000100:00100000:2.0:1782759960.459876:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5738 00000100:00100000:1.0:1782759960.459881:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3662:x1869355233216384:12345-0@lo:400:kworker.0 Request processed in 28us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759960.459882:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233217536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759960.459886:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3618 00000100:00100000:2.0:1782759960.459904:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233217536:12345-0@lo:400:kworker.0 Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759960.459910:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5738 00000100:00100000:0.0:1782759960.460043:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217280 00000100:00100000:0.0:1782759960.460051:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217280 00000100:00100000:0.0:1782759960.460076:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217792 00000100:00100000:0.0:1782759960.460079:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217792 00000100:00100000:0.0:1782759960.460088:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217408 00000100:00100000:0.0:1782759960.460089:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217408 00000100:00100000:0.0:1782759960.460098:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233217920 00000100:00100000:0.0:1782759960.460100:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233217920 00000100:00100000:0.0:1782759960.460110:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3393 00000100:00100000:0.0:1782759960.460115:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233217280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759960.460158:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233217280:12345-0@lo:400:kworker.0 Request processed in 40us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759960.460163:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3393 00000100:00100000:0.0:1782759960.460173:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3394 00000100:00100000:0.0:1782759960.460177:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233217792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759960.460198:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233217792:12345-0@lo:400:kworker.0 Request processed in 21us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759960.460203:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3394 00000100:00100000:0.0:1782759960.460210:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3395 00000100:00100000:0.0:1782759960.460214:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233217408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759960.460232:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233217408:12345-0@lo:400:kworker.0 Request processed in 18us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759960.460237:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3395 00000100:00100000:0.0:1782759960.460243:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3396 00000100:00100000:0.0:1782759960.460248:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233217920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759960.460264:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233217920:12345-0@lo:400:kworker.0 Request processed in 16us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759960.460269:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3396 00000100:00100000:1.0:1782759960.463833:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5739 00000100:00100000:1.0:1782759960.463865:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233217664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759960.463960:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233217664:12345-0@lo:400:kworker.0 Request processed in 113us (4536us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759960.463968:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5739 00000100:00080000:2.0:1782759960.467854:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782759960.467865:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782759960.467868:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1782759960.467870:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759960.468124:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233216640:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.468539:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233217152:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.468554:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233217664:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.468565:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233216512:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.468600:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233217024:0@lo:400:kworker.0 00000100:00100000:2.0:1782759960.468617:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233217536:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468651:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b8c55c43-51ff-4f74-a800-62b522e56789:3662:1869355233216384:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468665:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233216896:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468678:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233217408:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468690:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233217920:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468700:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3662:1869355233216768:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468724:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233217280:0@lo:400:kworker.0 00000100:00100000:3.0:1782759960.468735:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233217792:0@lo:400:kworker.0 00010000:00010000:0.0:1782759960.528615:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759960.979516:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233218048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759960.979603:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759960.979657:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759960.979663:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233218176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759960.979684:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759960.979718:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218048 00000100:00100000:1.0:1782759960.979725:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218048 00000100:00100000:1.0:1782759960.979764:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218176 00000100:00100000:1.0:1782759960.979767:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218176 00000100:00100000:1.0:1782759960.979801:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2964 00000100:00100000:1.0:1782759960.979809:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233218048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759960.979840:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759960.979886:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233218048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759960.979893:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2964 00000100:00100000:1.0:1782759960.979909:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1782759960.979914:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233218176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759960.979924:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759960.979948:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233218176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759960.979954:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2965 00000100:00100000:1.0:1782759960.980001:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233218176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759960.980014:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233218048:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1782759961.554310:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759961.820795:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759961.820829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759961.820864:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759961.820906:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759961.820937:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673280 00000100:00100000:3.0:1782759961.820948:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673280 00000100:00100000:3.0:1782759961.821016:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3397 00000100:00100000:3.0:1782759961.821029:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218673280:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759961.821031:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673024 00000100:00100000:1.0:1782759961.821038:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673024 00000100:00100000:1.0:1782759961.821078:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673152 00000100:00100000:1.0:1782759961.821081:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673152 00000100:00100000:3.0:1782759961.821104:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218673280:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 78us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759961.821113:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3397 00000100:00100000:1.0:1782759961.821118:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5740 00000100:00100000:1.0:1782759961.821129:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2403:x1869355218673024:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759961.821136:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218672896 00000100:00100000:3.0:1782759961.821142:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218672896 00000100:00100000:3.0:1782759961.821172:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3619 00000100:00100000:1.0:1782759961.821174:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+7:2403:x1869355218673024:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 44us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759961.821182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218672896:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759961.821185:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5740 00000100:00100000:1.0:1782759961.821204:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5741 00000100:00100000:3.0:1782759961.821218:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218672896:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759961.821218:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218673152:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759961.821231:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3619 00000100:00080000:3.0:1782759961.821256:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759961.821257:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218673152:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 45us (349us total) trans 0 rc 0/0 00000100:00080000:3.0:1782759961.821261:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759961.821266:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759961.821270:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5741 00000020:00000080:3.0:1782759961.895296:0:167220:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff312fd070 20000000:00000080:3.0:1782759961.895312:0:167220:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4ab1000 uarg=0000000000000000 00010000:00010000:3.0:1782759961.897604:0:167220:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782759961.897645:0:167220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x7:0x0].0x0 (ffff8cdee7e02d00) 00010000:00010000:3.0:1782759961.897649:0:167220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759961.897659:0:167220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e85d lrc: 0/0,0 mode: --/PR res: [0x200000422:0x7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ab expref: 6 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759961.897680:0:167220:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x6:0x0].0x0 (ffff8cdee7e02e00) 00010000:00010000:3.0:1782759961.897683:0:167220:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759961.897686:0:167220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e82c lrc: 0/0,0 mode: --/PR res: [0x200000422:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279a4 expref: 5 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759961.897760:0:167220:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1782759961.897799:0:167220:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1782759961.897811:0:167220:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1782759961.897844:0:167220:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1782759961.897857:0:167220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759961.897875:0:167220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759961.897950:0:167220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759961.897987:0:167220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759961.898002:0:167220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 23 pid: 6525 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759961.898016:0:167220:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:167220:1869355233218304:0@lo:104: 00000100:00100000:3.0:1782759961.898076:0:167220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759961.898133:0:167220:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4f37b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782759961.898468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218304 00000100:00100000:0.0:1782759961.898475:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218304 00000100:00100000:0.0:1782759961.898530:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1782759961.898539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:167220:x1869355233218304:12345-0@lo:104: 00010000:00010000:0.0:1782759961.898552:0:6514:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.898646:0:6514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759961.898653:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b8c55c43-51ff-4f74-a800-62b522e56789+3:167220:x1869355233218304:12345-0@lo:104: Request processed in 115us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759961.898660:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1782759961.898875:0:167220:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:167220:1869355233218304:0@lo:104: 00010000:00010000:3.0:1782759961.898962:0:167220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.899065:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759961.899074:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.899083:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf803c00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759961.899087:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.899096:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759961.899103:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759961.899109:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759961.899150:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.899157:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759961.899186:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.899194:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf803c00/0xd5b45c7f5c60e7f4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e7fb expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.899214:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759961.899216:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759961.899218:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759961.899438:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782759961.899453:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233218432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782759961.899497:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759961.899605:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218432 00000100:00100000:0.0:1782759961.899611:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218432 00010000:00010000:0.0:1782759961.899632:0:9534:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 24 pid: 6525 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782759961.899660:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1782759961.899667:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233218432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782759961.899678:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759961.899682:0:9534:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 24 pid: 6525 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899700:0:9534:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 24 pid: 6525 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899714:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e7fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e7f4 expref: 24 pid: 6525 timeout: 4152 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899726:0:9534:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899733:0:9534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899746:0:9534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899753:0:9534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899759:0:9534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899765:0:9534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899778:0:9534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:0.0:1782759961.899782:0:9534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899789:0:9534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899808:0:9534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759961.899820:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759961.899854:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233218432:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759961.899860:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:0.0:1782759961.900011:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc26c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233218432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759961.902485:0:167220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.902505:0:167220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759961.902513:0:167220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7000/0xd5b45c7f5c60e879 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759961.996274:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233218688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759961.996354:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759961.996500:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218688 00000100:00100000:0.0:1782759961.996507:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218688 00000100:00100000:0.0:1782759961.996612:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3648 00000100:00100000:0.0:1782759961.996622:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233218688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759961.996659:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:1.0:1782759961.996689:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233218816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782759961.996704:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc26c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233218688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759961.996711:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3648 00000100:00100000:1.0:1782759961.996732:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759961.996784:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218816 00000100:00100000:1.0:1782759961.996788:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218816 00000100:00100000:1.0:1782759961.996826:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2966 00000100:00100000:1.0:1782759961.996833:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedbc3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233218816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759961.996853:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759961.996857:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233218688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759961.996863:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233218560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1782759961.996884:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759961.996951:0:140701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218560 00000100:00100000:0.0:1782759961.996955:0:140701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218560 00000100:00100000:0.0:1782759961.996987:0:140701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2967 00000100:00100000:0.0:1782759961.996993:0:140701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233218560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1782759961.997004:0:140701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759961.997019:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedbc3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233218816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759961.997026:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2966 00000100:00100000:0.0:1782759961.997030:0:140701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233218560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759961.997035:0:140701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2967 00000100:00100000:2.0:1782759961.997083:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233218560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759962.010755:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233218816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782759962.571300:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782759962.931354:0:167268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8ce426e0 20000000:00000080:1.0:1782759962.931372:0:167268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6e400 uarg=0000000000000000 00010000:00010000:1.0:1782759962.931564:0:167268:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759962.931875:0:167268:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759962.932103:0:167268:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759962.932116:0:167268:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759962.932139:0:167268:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759962.932159:0:167268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932175:0:167268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932186:0:167268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932193:0:167268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932200:0:167268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932208:0:167268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932215:0:167268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412800 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:1.0:1782759962.932219:0:167268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932227:0:167268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932239:0:167268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932246:0:167268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759962.932253:0:167268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412800/0xd5b45c7f5c60e880 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.603068:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782759963.724054:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1782759963.724063:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:2.0:1782759963.724067:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782759963.724112:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.724124:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.724136:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759963.724162:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233218944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782759963.724232:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759963.724282:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc48cee40 going to sleep for 11 seconds 00000100:00100000:1.0:1782759963.725965:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233218944 00000100:00100000:1.0:1782759963.725977:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233218944 00000100:00100000:1.0:1782759963.726034:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3620 00000100:00100000:1.0:1782759963.726044:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233218944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759963.726060:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759963.726077:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e887 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.726102:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.726112:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.726121:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759963.726189:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233218944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759963.726196:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3620 00000100:00100000:1.0:1782759963.726252:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233218944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782759963.726269:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.726279:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782759963.726300:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1782759963.726306:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.726313:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1782759963.896911:0:167316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff477cae30 20000000:00000080:1.0:1782759963.896929:0:167316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c6c000 uarg=0000000000000000 00010000:00010000:1.0:1782759963.897130:0:167316:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759963.897148:0:167316:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759963.897171:0:167316:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1782759963.897182:0:167316:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1782759963.897204:0:167316:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1782759963.897222:0:167316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.897239:0:167316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.897248:0:167316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.897290:0:167316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 23 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.897305:0:167316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 23 pid: 6526 timeout: 4154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759963.897326:0:167316:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:167316:1869355233219072:0@lo:104: 00000100:00100000:1.0:1782759963.897392:0:167316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759963.897450:0:167316:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc3c78240 going to sleep for 11 seconds 00000100:00100000:0.0:1782759963.897573:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219072 00000100:00100000:0.0:1782759963.897605:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219072 00000100:00100000:0.0:1782759963.897658:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:0.0:1782759963.897669:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:167316:x1869355233219072:12345-0@lo:104: 00010000:00010000:0.0:1782759963.897681:0:18645:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759963.897731:0:18645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782759963.897738:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b8c55c43-51ff-4f74-a800-62b522e56789+3:167316:x1869355233219072:12345-0@lo:104: Request processed in 71us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759963.897745:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00010000:00010000:2.0:1782759963.898235:0:6518:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782759963.898243:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898253:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc133cc20) 10000000:00010000:2.0:1782759963.898257:0:6518:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898265:0:6518:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782759963.898273:0:6518:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782759963.898278:0:6518:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1782759963.898316:0:6518:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898322:0:6518:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782759963.898341:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898348:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.131@tcp lock: ffff8cdedf649e00/0xd5b45c7f5c60e887 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b45c7f5c60e88e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898365:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759963.898367:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782759963.898369:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759963.898380:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233219200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782759963.898415:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759963.898458:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219200 00000100:00100000:2.0:1782759963.898462:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219200 00010000:00010000:2.0:1782759963.898488:0:6515:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 24 pid: 6526 timeout: 4154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759963.898511:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:2.0:1782759963.898517:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233219200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782759963.898528:0:6515:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759963.898532:0:6515:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 24 pid: 6526 timeout: 4154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898541:0:6515:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 24 pid: 6526 timeout: 4154 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898556:0:6515:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898564:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898596:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898603:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898611:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898617:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898627:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759963.898631:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898637:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898645:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759963.898654:0:6515:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782759963.898683:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3665:x1869355233219200:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759963.898689:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:2.0:1782759963.898722:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b8c55c43-51ff-4f74-a800-62b522e56789:3665:1869355233219200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782759963.903189:0:167316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413800/0xd5b45c7f5c60e88e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b45c7f5c60e887 expref: 23 pid: 6526 timeout: 4154 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759963.903210:0:167316:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:167316:1869355233219072:0@lo:104: 00010000:00010000:1.0:1782759963.903235:0:167316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.903246:0:167316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.903252:0:167316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759963.903257:0:167316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413600/0xd5b45c7f5c60e895 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759964.555776:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233219328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1782759964.555848:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759964.555934:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219328 00000100:00100000:2.0:1782759964.555942:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219328 00000100:00100000:2.0:1782759964.556015:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3649 00000100:00100000:2.0:1782759964.556025:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233219328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1782759964.556058:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445646336 avail 1299406848 00000100:00100000:2.0:1782759964.556186:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233219328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759964.556194:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3649 00000100:00100000:1.0:1782759964.556260:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3740380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233219328:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759964.618805:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1782759964.659453:0:167365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd75460c10 20000000:00000080:2.0:1782759964.659472:0:167365:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff8cddc4c1b000 uarg=0000000000000000 00010000:00010000:2.0:1782759964.659679:0:167365:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759964.659695:0:167365:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc47fb800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759964.659721:0:167365:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1782759964.659733:0:167365:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1782759964.659767:0:167365:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1782759964.659787:0:167365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659804:0:167365:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659815:0:167365:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659822:0:167365:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659828:0:167365:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659835:0:167365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659842:0:167365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc0d43ce0) 00010000:00010000:2.0:1782759964.659846:0:167365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659853:0:167365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659866:0:167365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659873:0:167365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759964.659881:0:167365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdedf648600/0xd5b45c7f5c60e89c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 167365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759965.578862:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233219584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.578935:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759965.578994:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233220096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579018:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759965.579045:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233220608:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579066:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759965.579089:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1782759965.579095:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233219712:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579117:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759965.579141:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233220224:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579159:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759965.579175:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233220736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579193:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759965.579224:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219584 00000100:00100000:3.0:1782759965.579231:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219584 00000100:00100000:3.0:1782759965.579272:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220096 00000100:00100000:3.0:1782759965.579274:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220096 00000100:00100000:3.0:1782759965.579292:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220608 00000100:00100000:3.0:1782759965.579294:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220608 00000100:00100000:3.0:1782759965.579315:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220224 00000100:00100000:3.0:1782759965.579317:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220224 00000100:00100000:3.0:1782759965.579330:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220736 00000100:00100000:3.0:1782759965.579332:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220736 00000100:00100000:3.0:1782759965.579347:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5742 00000100:00100000:3.0:1782759965.579354:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233219584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579406:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+7:3664:x1869355233219584:12345-0@lo:400:kworker.0 Request processed in 52us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.579412:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5742 00000100:00100000:3.0:1782759965.579429:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5743 00000100:00100000:3.0:1782759965.579435:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233220096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579459:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3664:x1869355233220096:12345-0@lo:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.579465:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5743 00000100:00100000:3.0:1782759965.579476:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5744 00000100:00100000:3.0:1782759965.579482:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233220608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579555:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+6:3664:x1869355233220608:12345-0@lo:400:kworker.0 Request processed in 73us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.579561:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5744 00000100:00100000:3.0:1782759965.579572:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5745 00000100:00100000:3.0:1782759965.579603:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233220224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579629:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3664:x1869355233220224:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.579634:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5745 00000100:00100000:3.0:1782759965.579645:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5746 00000100:00100000:3.0:1782759965.579650:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233220736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579675:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3664:x1869355233220736:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.579680:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5746 00000100:00080000:3.0:1782759965.579710:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759965.579714:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759965.579752:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3664:1869355233220224:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579765:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3664:1869355233220736:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579775:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3664:1869355233219584:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579783:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3664:1869355233220096:0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.579791:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3664:1869355233220608:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580397:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233219456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580438:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580461:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233219968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580480:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580497:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233220480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580516:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580528:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233220992:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580543:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580559:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1782759965.580564:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233219840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580596:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580610:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233220352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580626:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580639:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233220864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580657:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759965.580688:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219840 00000100:00100000:0.0:1782759965.580693:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219840 00000100:00100000:0.0:1782759965.580725:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5747 00000100:00100000:0.0:1782759965.580730:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233219840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.580774:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233219840:12345-0@lo:400:kworker.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759965.580780:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5747 00000100:00100000:0.0:1782759965.580798:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219712 00000100:00100000:0.0:1782759965.580802:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219712 00000100:00100000:3.0:1782759965.581283:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219456 00000100:00100000:3.0:1782759965.581288:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219456 00000100:00100000:3.0:1782759965.581317:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3621 00000100:00100000:3.0:1782759965.581324:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233219456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759965.581361:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+23:3663:x1869355233219456:12345-0@lo:400:kworker.0 Request processed in 38us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.581367:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3621 00000100:00100000:0.0:1782759965.581433:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233219968 00000100:00100000:0.0:1782759965.581437:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233219968 00000100:00100000:0.0:1782759965.581454:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3650 00000100:00100000:0.0:1782759965.581459:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233219712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.581503:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3664:x1869355233219712:12345-0@lo:400:kworker.0 Request processed in 43us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759965.581508:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3650 00000100:00100000:0.0:1782759965.581519:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3651 00000100:00100000:0.0:1782759965.581524:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233219968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.581550:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233219968:12345-0@lo:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759965.581556:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3651 00000100:00100000:0.0:1782759965.581599:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220480 00000100:00100000:0.0:1782759965.581603:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220480 00000100:00100000:0.0:1782759965.581637:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220992 00000100:00100000:0.0:1782759965.581640:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220992 00000100:00100000:0.0:1782759965.581651:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220352 00000100:00100000:0.0:1782759965.581653:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220352 00000100:00100000:0.0:1782759965.581671:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3398 00000100:00100000:0.0:1782759965.581677:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233220480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.581707:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233220480:12345-0@lo:400:kworker.0 Request processed in 30us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759965.581713:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3398 00000100:00100000:0.0:1782759965.581722:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233220864 00000100:00100000:0.0:1782759965.581725:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233220864 00000100:00100000:0.0:1782759965.581751:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3399 00000100:00100000:0.0:1782759965.581757:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233220992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.581785:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233220992:12345-0@lo:400:kworker.0 Request processed in 28us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759965.581790:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3399 00000100:00100000:0.0:1782759965.581801:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3400 00000100:00100000:0.0:1782759965.581806:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233220352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.581830:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233220352:12345-0@lo:400:kworker.0 Request processed in 24us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.583446:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233219712:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583555:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3400 00000100:00100000:0.0:1782759965.583593:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3401 00000100:00100000:0.0:1782759965.583605:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233220864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583683:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233220864:12345-0@lo:400:kworker.0 Request processed in 83us (3024us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759965.583689:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3401 00000100:00080000:0.0:1782759965.583731:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782759965.583745:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759965.583773:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233219840:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583786:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4aca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233220352:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583796:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233220864:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583806:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc542ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233219456:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583817:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233219968:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.583828:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233220480:0@lo:400:kworker.0 00000100:00100000:0.0:1782759965.584818:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4acbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233220992:0@lo:400:kworker.0 00010000:00010000:1.0:1782759965.645097:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782759965.900406:0:6528:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1782759965.900413:0:6528:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8cdee5703380 from 1 10000000:01000000:1.0:1782759965.900419:0:6528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1782759965.900470:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759965.900489:0:6528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759965.900499:0:6528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759965.900526:0:6528:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233221120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782759965.900646:0:6528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759965.900720:0:6528:0:(client.c:2701:ptlrpc_set_wait()) set ffff8cddc4beb240 going to sleep for 11 seconds 00000100:00100000:3.0:1782759965.901190:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221120 00000100:00100000:3.0:1782759965.901199:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221120 00000100:00100000:3.0:1782759965.901263:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3622 00000100:00100000:3.0:1782759965.901273:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+23:6528:x1869355233221120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782759965.901290:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759965.901307:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdecd8a7600/0xd5b45c7f5c60e8aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b45c7f5c60e8a3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759965.901331:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdecd8a7600/0xd5b45c7f5c60e8aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e8a3 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759965.901341:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdecd8a7600/0xd5b45c7f5c60e8aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b45c7f5c60e8a3 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759965.901350:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7600, rc 0) 00000100:00100000:3.0:1782759965.901406:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8c55c43-51ff-4f74-a800-62b522e56789+24:6528:x1869355233221120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759965.901414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3622 00000100:00100000:0.0:1782759965.901512:0:6528:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b8c55c43-51ff-4f74-a800-62b522e56789:6528:1869355233221120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782759965.901528:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e8aa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759965.901537:0:6528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b45c7f5c60e8aa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782759965.901557:0:6528:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.202.131@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1782759965.901562:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e8aa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759965.901567:0:6528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.131@tcp lock: ffff8cddc5413400/0xd5b45c7f5c60e8a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b45c7f5c60e8aa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759966.090797:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233221248:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1782759966.090878:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759966.090953:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221248 00000100:00100000:1.0:1782759966.090960:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221248 00000100:00100000:1.0:1782759966.091000:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2968 00000100:00100000:1.0:1782759966.091008:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233221248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759966.091036:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759966.091079:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233221248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759966.091086:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2968 00000100:00100000:1.0:1782759966.091126:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233221248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759966.093034:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782759966.093308:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233221376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759966.093653:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759966.093888:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221376 00000100:00100000:1.0:1782759966.093897:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221376 00000100:00100000:1.0:1782759966.093989:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2969 00000100:00100000:1.0:1782759966.093999:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233221376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759966.094022:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 276416 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759966.094077:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233221376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759966.094084:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2969 00000100:00100000:0.0:1782759966.094148:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4aca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233221376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782759966.673964:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759966.943313:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759966.943360:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759966.943392:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759966.943419:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759966.943452:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673536 00000100:00100000:1.0:1782759966.943461:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673536 00000100:00100000:1.0:1782759966.943523:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673664 00000100:00100000:1.0:1782759966.943526:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673664 00000100:00100000:1.0:1782759966.943553:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5748 00000100:00100000:1.0:1782759966.943563:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218673536:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759966.943686:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218673536:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 123us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759966.943694:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5748 00000100:00100000:1.0:1782759966.943712:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5749 00000100:00100000:1.0:1782759966.943718:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218673664:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759966.943762:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2403:x1869355218673664:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 43us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759966.943769:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5749 00000100:00100000:1.0:1782759966.943787:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673792 00000100:00100000:1.0:1782759966.943791:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673792 00000100:00100000:1.0:1782759966.943824:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3402 00000100:00100000:1.0:1782759966.943831:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218673792:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759966.943858:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2403:x1869355218673792:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 27us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759966.943864:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3402 00000100:00100000:1.0:1782759966.943882:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673408 00000100:00100000:1.0:1782759966.943884:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673408 00000100:00100000:1.0:1782759966.943909:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3623 00000100:00100000:1.0:1782759966.943917:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218673408:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759966.943943:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218673408:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759966.943949:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3623 00000100:00080000:1.0:1782759966.943978:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782759966.943983:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1782759966.943985:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759967.115124:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782759967.115147:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233221504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782759967.115211:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759967.115362:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221504 00000100:00100000:1.0:1782759967.115371:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221504 00000100:00100000:1.0:1782759967.115433:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2970 00000100:00100000:1.0:1782759967.115442:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233221504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782759967.115469:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759967.115514:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233221504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759967.115521:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2970 00000100:00100000:1.0:1782759967.115559:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233221504:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759967.116067:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759967.116922:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233221632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759967.116973:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759967.117063:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221632 00000100:00100000:1.0:1782759967.117069:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221632 00000100:00100000:1.0:1782759967.117129:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2971 00000100:00100000:1.0:1782759967.117138:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233221632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759967.117157:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1782759967.117199:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233221632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759967.117205:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2971 00000100:00100000:1.0:1782759967.117243:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233221632:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1782759967.117359:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759967.117479:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782759967.117491:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233221760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1782759967.117537:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759967.117718:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221760 00000100:00100000:0.0:1782759967.117732:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221760 00000100:00100000:0.0:1782759967.117795:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3652 00000100:00100000:0.0:1782759967.117803:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233221760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759967.117832:0:39509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759967.117881:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233221760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759967.117887:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3652 00000100:00100000:3.0:1782759967.118020:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233221760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1782759967.697886:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782759968.714795:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782759969.598200:0:167560:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 65: lfs find -printf %La and --attrs support ========================================================== 15:06:08 (1782759968) 00000100:00100000:3.0:1782759969.676952:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233221888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1782759969.677023:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759969.677097:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233221888 00000100:00100000:3.0:1782759969.677106:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233221888 00000100:00100000:3.0:1782759969.677171:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3653 00000100:00100000:3.0:1782759969.677180:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233221888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1782759969.677221:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445646336 avail 1299406848 00000100:00100000:3.0:1782759969.677270:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233221888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759969.677278:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3653 00000100:00100000:3.0:1782759969.677331:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233221888:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759969.739911:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759969.817778:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759969.817813:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759969.817961:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218674176 00000100:00100000:2.0:1782759969.817984:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218674176 00000100:00100000:2.0:1782759969.818052:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218673920 00000100:00100000:2.0:1782759969.818056:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218673920 00000100:00100000:2.0:1782759969.818089:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3208 00000100:00100000:2.0:1782759969.818100:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+6:119106:x1869355218674176:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759969.818155:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759969.818160:0:6533:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie d5b45c7f5c60e76f) 00010000:00010000:2.0:1782759969.818162:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759969.818234:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818261:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818274:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818327:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818334:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818341:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818914:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,1 mode: --/PW res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818925:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818933:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759969.818947:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006297ed4c reply state 0000000076f5aa55 transno 4294968062 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818959:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818966:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:2.0:1782759969.818969:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759969.818972:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759969.818977:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1782759969.818985:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818993:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.818998:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819004:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819010:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759969.819014:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819022:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819032:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759969.819034:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759969.819037:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819043:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60e8b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759969.819055:0:6533:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006297ed4c reply state 0000000076f5aa55 transno 4294968062 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819063:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759969.819068:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff8cddc34ff300) 00010000:00010000:2.0:1782759969.819071:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759969.819073:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782759969.819154:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+8:119106:x1869355218674176:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 1054us (1384us total) trans 4294968062 rc 0/0 00000100:00100000:2.0:1782759969.819163:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3208 00000100:00100000:2.0:1782759969.819195:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3209 00000100:00100000:2.0:1782759969.819206:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2402:x1869355218673920:12345-192.168.202.31@tcp:41:mkdir.0 00000004:00000024:2.0:1782759969.819231:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445642240 avail 1299402752 00000100:00100000:2.0:1782759969.819259:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+7:2402:x1869355218673920:12345-192.168.202.31@tcp:41:mkdir.0 Request processed in 56us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759969.819266:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3209 00000100:00080000:1.0:1782759969.819946:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782759969.882535:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759969.882572:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218674304 00000100:00100000:3.0:1782759969.882611:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218674304 00000100:00100000:3.0:1782759969.882672:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3210 00000100:00100000:3.0:1782759969.882682:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+7:119112:x1869355218674304:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759969.882716:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759969.882737:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e8c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279b9 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.883347:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e8cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.883370:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.883381:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759969.883444:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1782759969.883449:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759969.883470:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e8cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.883496:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e8c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279b9 expref: 9 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.883512:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e8cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279b9 expref: 8 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759969.883521:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759969.883524:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759969.883527:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdecd8a7000, rc 0) 00000100:00100000:3.0:1782759969.883611:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+8:119112:x1869355218674304:12345-192.168.202.31@tcp:101:touch.0 Request processed in 929us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759969.883619:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3210 00000100:00100000:1.0:1782759969.895658:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759969.895725:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218674432 00000100:00100000:1.0:1782759969.895736:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218674432 00000100:00100000:1.0:1782759969.895808:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3211 00000100:00100000:1.0:1782759969.895821:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+8:119112:x1869355218674432:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759969.895843:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759969.895864:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e8d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279c0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.895930:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.895947:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.895959:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.895971:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.895978:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.895986:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896065:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e8e9 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896074:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896082:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759969.896120:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1782759969.896123:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759969.896143:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896157:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896164:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896170:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896176:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896181:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759969.896187:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896195:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896209:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759969.896212:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759969.896217:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896225:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413200/0xd5b45c7f5c60e8db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896238:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896244:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896249:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896255:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759969.896257:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896263:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896270:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff8cddc34ff300) 00010000:00010000:1.0:1782759969.896273:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759969.896276:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896287:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413000/0xd5b45c7f5c60e8e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896312:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413c00/0xd5b45c7f5c60e8d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279c0 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896327:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279c0 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.896334:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:1.0:1782759969.896337:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759969.896339:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5412800, rc 0) 00000100:00100000:1.0:1782759969.896402:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+9:119112:x1869355218674432:12345-192.168.202.31@tcp:101:touch.0 Request processed in 583us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759969.896410:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3211 00000100:00100000:1.0:1782759969.909944:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759969.910523:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218674688 00000100:00100000:1.0:1782759969.910534:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218674688 00000100:00100000:1.0:1782759969.910621:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3212 00000100:00100000:1.0:1782759969.910633:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+9:119112:x1869355218674688:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759969.910655:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759969.910676:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e8f0 lrc: 2/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279c7 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.911109:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 3/0,1 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.911130:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.911141:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.911156:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,1 mode: --/PW res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.911162:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.911168:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782759969.915639:0:8593:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x23:0x0], index 1: 0 00010000:00010000:1.0:1782759969.917560:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e905 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917609:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e905 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917621:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e905 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917666:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917674:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917680:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917689:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917694:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5412a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759969.917709:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917717:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 5/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.917730:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:1.0:1782759969.917733:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759969.917736:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 3/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.919320:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412a00/0xd5b45c7f5c60e8f7 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759969.919347:0:8593:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000636b7c23 reply state 00000000646d1260 transno 4294968063 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.919359:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.919364:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34f6200) 00010000:00010000:1.0:1782759969.919366:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759969.919369:0:8593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782759969.919412:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412c00/0xd5b45c7f5c60e8f0 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279c7 expref: 12 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.919422:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e905 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279c7 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.919427:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34f6a00) 00010000:00010000:1.0:1782759969.919429:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759969.919431:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc5413800, rc 0) 00000100:00100000:1.0:1782759969.919500:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+12:119112:x1869355218674688:12345-192.168.202.31@tcp:101:touch.0 Request processed in 8869us (9566us total) trans 4294968063 rc 0/0 00000100:00100000:1.0:1782759969.919509:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3212 00000100:00100000:0.0:1782759969.930546:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759969.930832:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218674944 00000100:00100000:1.0:1782759969.930844:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218674944 00000100:00100000:1.0:1782759969.930904:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3213 00000100:00100000:1.0:1782759969.930914:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+12:119112:x1869355218674944:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:1.0:1782759969.930991:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759969.931019:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413800/0xd5b45c7f5c60e905 lrc: 0/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279c7 expref: 12 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.931036:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34f6a00) 00010000:00010000:1.0:1782759969.931046:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759969.931095:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,1 mode: --/PW res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.931110:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.931120:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759969.931238:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e7ad552 reply state 0000000079e2a721 transno 4294968064 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.931268:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759969.931275:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:1.0:1782759969.931277:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759969.931280:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759969.931366:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+13:119112:x1869355218674944:12345-192.168.202.31@tcp:36:touch.0 Request processed in 453us (828us total) trans 4294968064 rc 0/0 00000100:00100000:1.0:1782759969.931374:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3213 00000100:00100000:1.0:1782759969.944540:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759969.944768:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218675072 00000100:00100000:0.0:1782759969.944779:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218675072 00000100:00100000:0.0:1782759969.944839:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3214 00000100:00100000:0.0:1782759969.944850:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+13:119112:x1869355218675072:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759969.944877:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759969.944899:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e91a lrc: 2/0,0 mode: --/CR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279ce expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.944965:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e91a lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ce expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.944996:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e91a lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ce expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759969.945017:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:0.0:1782759969.945020:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782759969.945023:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803400, rc 0) 00000100:00100000:0.0:1782759969.945080:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+14:119112:x1869355218675072:12345-192.168.202.31@tcp:101:touch.0 Request processed in 231us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759969.945090:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3214 00000100:00100000:0.0:1782759969.952455:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759969.952709:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218675200 00000100:00100000:2.0:1782759969.952720:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218675200 00000100:00100000:2.0:1782759969.952829:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1130 00000100:00100000:2.0:1782759969.952839:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2401:x1869355218675200:12345-192.168.202.31@tcp:8:touch.0 00010000:00080000:2.0:1782759969.952877:0:82628:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 95b27dde-c150-4adf-930b-37620c52929b@192.168.202.31@tcp t0 exp 0000000000000000 cur 4010 last 0 00000020:00000080:2.0:1782759969.952909:0:82628:0:(genops.c:1406:class_connect()) connect: client 95b27dde-c150-4adf-930b-37620c52929b, cookie 0xd5b45c7f5c60e921 00002000:00100000:2.0:1782759969.952921:0:82628:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95b27dde-c150-4adf-930b-37620c52929b/ffff8cddc5425000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782759969.952940:0:82628:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782759969.953129:0:82628:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782759969.953161:0:82628:0:(import.c:65:import_set_state_nolock()) ffff8cddc5427800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759969.953409:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218675200:12345-192.168.202.31@tcp:8:touch.0 Request processed in 569us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759969.953417:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1130 00000100:00100000:0.0:1782759969.972068:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759969.972147:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218675328 00000100:00100000:3.0:1782759969.972158:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218675328 00000100:00100000:3.0:1782759969.972237:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1131 00000100:00100000:3.0:1782759969.972249:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+6:0:x1869355218675328:12345-192.168.202.31@tcp:2:touch.0 00000100:00080000:1.0:1782759969.972930:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1782759969.974526:0:9523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967444 is committed 00000001:00100000:2.0:1782759969.974540:0:9523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000100:00100000:3.0:1782759969.974712:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+5:0:x1869355218675328:12345-192.168.202.31@tcp:2:touch.0 Request processed in 2452us (2642us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1782759969.974724:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1131 00000100:00100000:1.0:1782759969.977810:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759969.977910:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218675584 00000100:00100000:3.0:1782759969.977921:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218675584 00000100:00100000:3.0:1782759969.977988:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 480 00000100:00100000:3.0:1782759969.977998:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+14:119112:x1869355218675584:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:3.0:1782759969.978328:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+15:119112:x1869355218675584:12345-192.168.202.31@tcp:35:touch.0 Request processed in 329us (525us total) trans 4294968065 rc 0/0 00000100:00100000:3.0:1782759969.978336:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 480 00000100:00100000:0.0:1782759970.001823:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759970.001903:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218675840 00000100:00100000:3.0:1782759970.001912:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218675840 00000100:00100000:3.0:1782759970.001983:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3215 00000100:00100000:3.0:1782759970.001994:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+15:119114:x1869355218675840:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:3.0:1782759970.002018:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782759970.002038:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e928 lrc: 2/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279d5 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.002139:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 3/0,1 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.002162:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.002173:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 3/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.002188:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,1 mode: --/PW res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.002200:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759970.002206:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782759970.002514:0:6532:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24:0x0], index 0: 0 00010000:00010000:2.0:1782759970.003428:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e93d lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003443:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e93d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003453:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e93d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003489:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003497:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 4/0,1 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003503:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 3/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003510:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003515:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759970.003519:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 4/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003524:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 5/0,0 mode: CW/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003534:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:2.0:1782759970.003536:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759970.003539:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 3/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003543:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7e00/0xd5b45c7f5c60e92f lrc: 0/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759970.003554:0:6532:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cfcef62 reply state 00000000d136e8b1 transno 4294968066 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003561:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003565:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cded3a3b400) 00010000:00010000:2.0:1782759970.003567:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759970.003569:0:6532:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782759970.003617:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7800/0xd5b45c7f5c60e928 lrc: 0/0,0 mode: --/CW res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279d5 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003629:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e93d lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279d5 expref: 17 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.003636:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:2.0:1782759970.003638:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759970.003640:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759970.003763:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+18:119114:x1869355218675840:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1770us (1948us total) trans 4294968066 rc 0/0 00000100:00100000:2.0:1782759970.003771:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3215 00000100:00100000:1.0:1782759970.017198:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759970.017297:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218676096 00000100:00100000:0.0:1782759970.017307:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218676096 00000100:00100000:0.0:1782759970.017408:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3216 00000100:00100000:0.0:1782759970.017419:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+18:119114:x1869355218676096:12345-192.168.202.31@tcp:36:touch.0 00010000:00010000:0.0:1782759970.017476:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759970.017504:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e93d lrc: 0/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279d5 expref: 18 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.017524:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ffd00) 00010000:00010000:0.0:1782759970.017536:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782759970.017659:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,1 mode: --/PW res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.017673:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.017684:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782759970.017806:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000d946d30 reply state 0000000021456ee7 transno 4294968067 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.017828:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.017840:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759970.017842:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1782759970.017845:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782759970.017922:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+19:119114:x1869355218676096:12345-192.168.202.31@tcp:36:touch.0 Request processed in 505us (734us total) trans 4294968067 rc 0/0 00000100:00100000:0.0:1782759970.017930:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3216 00000100:00100000:1.0:1782759970.024667:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759970.024961:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218676224 00000100:00100000:2.0:1782759970.025040:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218676224 00000100:00100000:2.0:1782759970.025173:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3217 00000100:00100000:2.0:1782759970.025186:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+19:119114:x1869355218676224:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:2.0:1782759970.025213:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759970.025232:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e952 lrc: 2/0,0 mode: --/CR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279dc expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.025293:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e952 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279dc expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.025310:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e952 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279dc expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.025331:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:2.0:1782759970.025335:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782759970.025339:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649200, rc 0) 00000100:00100000:2.0:1782759970.025407:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+20:119114:x1869355218676224:12345-192.168.202.31@tcp:101:touch.0 Request processed in 223us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.025414:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3217 00000100:00100000:3.0:1782759970.027972:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759970.031953:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218676352 00000100:00100000:0.0:1782759970.031972:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218676352 00000100:00100000:0.0:1782759970.032061:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1132 00000100:00100000:0.0:1782759970.032073:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+6:2402:x1869355218676352:12345-192.168.202.31@tcp:2:touch.0 00000100:00100000:0.0:1782759970.033100:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+7:2402:x1869355218676352:12345-192.168.202.31@tcp:2:touch.0 Request processed in 1023us (5131us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1782759970.033111:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1132 00000100:00080000:1.0:1782759970.033239:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759970.051975:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759970.052145:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218676608 00000100:00100000:1.0:1782759970.052157:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218676608 00000100:00100000:1.0:1782759970.052217:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 481 00000100:00100000:1.0:1782759970.052227:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+20:119114:x1869355218676608:12345-192.168.202.31@tcp:35:touch.0 00000100:00100000:1.0:1782759970.052539:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+21:119114:x1869355218676608:12345-192.168.202.31@tcp:35:touch.0 Request processed in 312us (574us total) trans 4294968068 rc 0/0 00000100:00100000:1.0:1782759970.052548:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 481 00000100:00100000:3.0:1782759970.099477:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759970.099608:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218676736 00000100:00100000:1.0:1782759970.099618:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218676736 00000100:00100000:1.0:1782759970.099684:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3218 00000100:00100000:1.0:1782759970.099695:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+21:119115:x1869355218676736:12345-192.168.202.31@tcp:101:chattr.0 00010000:00010000:1.0:1782759970.099864:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759970.099888:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e959 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279e3 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.099959:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.099975:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.099987:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.099998:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100076:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100084:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100164:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100173:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100180:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759970.100226:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782759970.100231:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759970.100269:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100281:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100291:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100296:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100301:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100307:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100312:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759970.100316:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100322:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100333:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:1.0:1782759970.100337:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759970.100341:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100347:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5200/0xd5b45c7f5c60e960 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100365:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100371:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100376:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100381:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759970.100383:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100388:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100395:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cded3a3b400) 00010000:00010000:1.0:1782759970.100397:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759970.100400:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100406:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5400/0xd5b45c7f5c60e967 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100431:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e959 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279e3 expref: 23 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100446:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279e3 expref: 22 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.100458:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:1.0:1782759970.100459:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782759970.100461:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4200, rc 0) 00000100:00100000:1.0:1782759970.102215:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95b27dde-c150-4adf-930b-37620c52929b+22:119115:x1869355218676736:12345-192.168.202.31@tcp:101:chattr.0 Request processed in 2510us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759970.102227:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3218 00000100:00100000:0.0:1782759970.118285:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759970.118388:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218676864 00000100:00100000:2.0:1782759970.118399:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218676864 00000100:00100000:2.0:1782759970.118495:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1133 00000100:00100000:2.0:1782759970.118508:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+7:2404:x1869355218676864:12345-192.168.202.31@tcp:101:chattr.0 00010000:00010000:2.0:1782759970.118528:0:82628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759970.118551:0:82628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60e975 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279ea expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759970.118640:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x6a42c222, atime: 0x6a42c222, ctime: 0x6a42c222, blocks: 0x0 00010000:00010000:2.0:1782759970.118665:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=4010s v=(0 0) 00010000:00010000:2.0:1782759970.118671:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759970.118682:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60e975 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ea expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.118710:0:82628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60e975 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ea expref: 8 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759970.118725:0:82628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648e00, rc 0) 00000100:00100000:2.0:1782759970.119039:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+8:2404:x1869355218676864:12345-192.168.202.31@tcp:101:chattr.0 Request processed in 532us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.119048:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1133 00000100:00100000:3.0:1782759970.125464:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759970.125551:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218677120 00000100:00100000:0.0:1782759970.125617:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218677120 00000100:00100000:0.0:1782759970.125681:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3219 00000100:00100000:0.0:1782759970.125692:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+22:119115:x1869355218677120:12345-192.168.202.31@tcp:101:chattr.0 00010000:00010000:0.0:1782759970.125724:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759970.125759:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e97c lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb279f1 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.125871:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e983 lrc: 3/1,0 mode: --/CR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.125888:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e983 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.125900:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e983 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759970.125911:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782759970.126328:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e97c lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279f1 expref: 25 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.126348:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e983 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279f1 expref: 24 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759970.126357:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759970.126360:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782759970.126363:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803a00, rc 0) 00000100:00100000:0.0:1782759970.126429:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:95b27dde-c150-4adf-930b-37620c52929b+24:119115:x1869355218677120:12345-192.168.202.31@tcp:101:chattr.0 Request processed in 738us (989us total) trans 4294968069 rc 0/0 00000100:00100000:0.0:1782759970.126535:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3219 00000100:00100000:3.0:1782759970.143055:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759970.143434:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218677248 00000100:00100000:0.0:1782759970.143445:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218677248 00000100:00100000:0.0:1782759970.143510:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 482 00000100:00100000:0.0:1782759970.143520:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+24:119115:x1869355218677248:12345-192.168.202.31@tcp:33:chattr.0 00000100:00100000:0.0:1782759970.143763:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+24:119115:x1869355218677248:12345-192.168.202.31@tcp:33:chattr.0 Request processed in 243us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759970.143772:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 482 00000100:00100000:3.0:1782759970.148635:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759970.148831:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218677504 00000100:00100000:1.0:1782759970.148842:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218677504 00000100:00100000:1.0:1782759970.148906:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3220 00000100:00100000:1.0:1782759970.148916:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+24:119115:x1869355218677504:12345-192.168.202.31@tcp:36:chattr.0 00010000:00010000:1.0:1782759970.148965:0:6531:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782759970.148993:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60e96e lrc: 0/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279e3 expref: 24 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.149013:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:1.0:1782759970.149018:0:6531:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782759970.149039:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,1 mode: --/PW res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.149052:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.149061:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782759970.149213:0:6531:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035351fef reply state 00000000e781cd16 transno 4294968070 ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,1 mode: PW/PW res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.149230:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759970.149236:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:1.0:1782759970.149239:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1782759970.149241:0:6531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782759970.149343:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95b27dde-c150-4adf-930b-37620c52929b+25:119115:x1869355218677504:12345-192.168.202.31@tcp:36:chattr.0 Request processed in 428us (765us total) trans 4294968070 rc 0/0 00000100:00100000:1.0:1782759970.149351:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3220 00000100:00100000:3.0:1782759970.151357:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759970.151731:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218677632 00000100:00100000:0.0:1782759970.151753:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218677632 00000100:00100000:0.0:1782759970.151829:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1134 00000100:00100000:0.0:1782759970.151840:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+8:2403:x1869355218677632:12345-192.168.202.31@tcp:2:chattr.0 00002000:00010000:0.0:1782759970.152014:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1782759970.152018:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb mtime from disk: 1782759970 -> 1782759970 00002000:00010000:0.0:1782759970.152020:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb atime from disk: 1782759970 -> 1782759970 00002000:00010000:0.0:1782759970.152022:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb ctime from disk: 1782759970 -> 1782759970 00002000:00010000:0.0:1782759970.152024:0:8446:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1782759970.152084:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4acb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95b27dde-c150-4adf-930b-37620c52929b+9:2403:x1869355218677632:12345-192.168.202.31@tcp:2:chattr.0 Request processed in 245us (735us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1782759970.152092:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1134 00000100:00100000:3.0:1782759970.699290:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233222144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699367:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699429:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233222656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699452:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699468:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233223168:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699489:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699514:0:3663:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1782759970.699519:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233222016:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699551:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699571:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233222528:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699623:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699639:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233223040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699663:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699679:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233223552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699711:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699739:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233222400:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699767:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699783:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233222912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699815:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699829:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233223424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699848:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699861:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1782759970.699865:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233222272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699880:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699895:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233222784:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699923:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699936:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233223296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.699951:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759970.699975:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222528 00000100:00100000:3.0:1782759970.699982:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222528 00000100:00100000:3.0:1782759970.700040:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222272 00000100:00100000:3.0:1782759970.700044:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222272 00000100:00100000:3.0:1782759970.700061:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3654 00000100:00100000:3.0:1782759970.700070:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233222528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.700123:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233222528:12345-0@lo:400:kworker.0 Request processed in 54us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759970.700130:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3654 00000100:00100000:3.0:1782759970.700147:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3655 00000100:00100000:3.0:1782759970.700152:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233222272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.700179:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3665:x1869355233222272:12345-0@lo:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759970.700192:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3655 00000100:00100000:3.0:1782759970.700229:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233222272:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.700254:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233222528:0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.700448:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223040 00000100:00100000:2.0:1782759970.700452:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223040 00000100:00100000:2.0:1782759970.700508:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223552 00000100:00100000:2.0:1782759970.700510:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223552 00000100:00100000:2.0:1782759970.700523:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222912 00000100:00100000:2.0:1782759970.700525:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222912 00000100:00100000:2.0:1782759970.700536:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223424 00000100:00100000:2.0:1782759970.700538:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223424 00000100:00100000:2.0:1782759970.700552:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3403 00000100:00100000:2.0:1782759970.700558:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233223040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.700628:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233223040:12345-0@lo:400:kworker.0 Request processed in 70us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.700634:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3403 00000100:00100000:2.0:1782759970.700646:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3404 00000100:00100000:2.0:1782759970.700653:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233223552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.700679:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233223552:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.700685:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3404 00000100:00100000:2.0:1782759970.700708:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3405 00000100:00100000:2.0:1782759970.700717:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233222912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.700746:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233222912:12345-0@lo:400:kworker.0 Request processed in 33us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.700752:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3405 00000100:00100000:2.0:1782759970.700764:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3406 00000100:00100000:2.0:1782759970.700771:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233223424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.700797:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233223424:12345-0@lo:400:kworker.0 Request processed in 28us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.700813:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3406 00000100:00100000:2.0:1782759970.700830:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222144 00000100:00100000:2.0:1782759970.700833:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222144 00000100:00100000:2.0:1782759970.700851:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222656 00000100:00100000:2.0:1782759970.700853:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222656 00000100:00100000:2.0:1782759970.700863:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223168 00000100:00100000:2.0:1782759970.700866:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223168 00000100:00100000:2.0:1782759970.700877:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222400 00000100:00100000:2.0:1782759970.700879:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222400 00000100:00100000:2.0:1782759970.700887:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5750 00000100:00100000:2.0:1782759970.700892:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.700931:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3663:x1869355233222144:12345-0@lo:400:kworker.0 Request processed in 39us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.700936:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5750 00000100:00100000:2.0:1782759970.700943:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222784 00000100:00100000:2.0:1782759970.700946:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222784 00000100:00100000:2.0:1782759970.700957:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223296 00000100:00100000:2.0:1782759970.700959:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223296 00000100:00100000:2.0:1782759970.700974:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5751 00000100:00100000:2.0:1782759970.700979:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233222656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.701006:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3663:x1869355233222656:12345-0@lo:400:kworker.0 Request processed in 26us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.701012:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5751 00000100:00100000:2.0:1782759970.701023:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5752 00000100:00100000:2.0:1782759970.701029:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233223168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.701055:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc542ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3663:x1869355233223168:12345-0@lo:400:kworker.0 Request processed in 27us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.701061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5752 00000100:00100000:2.0:1782759970.701070:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5753 00000100:00100000:2.0:1782759970.701077:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233222400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.701102:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3665:x1869355233222400:12345-0@lo:400:kworker.0 Request processed in 27us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.701108:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5753 00000100:00100000:2.0:1782759970.701118:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5754 00000100:00100000:2.0:1782759970.701125:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233222784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.701148:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3665:x1869355233222784:12345-0@lo:400:kworker.0 Request processed in 26us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.701154:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5754 00000100:00100000:2.0:1782759970.701164:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5755 00000100:00100000:2.0:1782759970.701170:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233223296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759970.701195:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3665:x1869355233223296:12345-0@lo:400:kworker.0 Request processed in 27us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759970.701201:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5755 00000100:00100000:1.0:1782759970.702033:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233222016 00000100:00100000:1.0:1782759970.702042:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233222016 00000100:00100000:1.0:1782759970.702092:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3624 00000100:00100000:1.0:1782759970.702099:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233222016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759970.702150:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3663:x1869355233222016:12345-0@lo:400:kworker.0 Request processed in 51us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759970.702169:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3624 00000100:00080000:3.0:1782759970.702915:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759970.702922:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759970.702925:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759970.702928:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759970.702966:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3665:1869355233222784:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.702981:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3665:1869355233223296:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.702993:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3665:1869355233222400:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703003:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233222912:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703014:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233223424:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703057:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b8c55c43-51ff-4f74-a800-62b522e56789:3663:1869355233222016:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703069:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233223040:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703080:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233223552:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703092:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3663:1869355233222144:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703102:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3663:1869355233222656:0@lo:400:kworker.0 00000100:00100000:3.0:1782759970.703117:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3663:1869355233223168:0@lo:400:kworker.0 00010000:00010000:2.0:1782759970.762847:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759971.210971:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc55faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233223680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759971.211070:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759971.212332:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223680 00000100:00100000:1.0:1782759971.212345:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223680 00000100:00100000:1.0:1782759971.212402:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2972 00000100:00100000:1.0:1782759971.212412:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233223680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782759971.212438:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759971.212515:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3663:x1869355233223680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759971.212522:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2972 00000100:00100000:0.0:1782759971.212904:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233223808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759971.212950:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759971.213045:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223808 00000100:00100000:2.0:1782759971.213051:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223808 00000100:00100000:2.0:1782759971.213100:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2973 00000100:00100000:2.0:1782759971.213108:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233223808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1782759971.213121:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:2.0:1782759971.213168:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3664:x1869355233223808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759971.213174:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2973 00000100:00100000:2.0:1782759971.213215:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3664:1869355233223808:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1782759971.213635:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc55faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3663:1869355233223680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1782759971.786756:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759972.061777:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759972.061953:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759972.061993:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759972.062030:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759972.062057:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759972.062083:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218678144 00000100:00100000:0.0:1782759972.062083:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218678272 00000100:00100000:3.0:1782759972.062093:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218678144 00000100:00100000:0.0:1782759972.062093:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218678272 00000100:00100000:2.0:1782759972.062179:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218678016 00000100:00100000:2.0:1782759972.062184:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218678016 00000100:00100000:3.0:1782759972.062255:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3407 00000100:00100000:3.0:1782759972.062266:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+9:2402:x1869355218678144:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:3.0:1782759972.062350:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:95b27dde-c150-4adf-930b-37620c52929b+9:2402:x1869355218678144:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759972.062357:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3407 00000100:00100000:1.0:1782759972.062430:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218677760 00000100:00100000:1.0:1782759972.062436:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218677760 00000100:00100000:1.0:1782759972.062468:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3625 00000100:00100000:1.0:1782759972.062475:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218677760:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759972.062504:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2402:x1869355218677760:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759972.062510:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3625 00000100:00100000:1.0:1782759972.062736:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218677888 00000100:00100000:1.0:1782759972.062741:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218677888 00000100:00100000:0.0:1782759972.062890:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3408 00000100:00100000:0.0:1782759972.062900:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecdb52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218678272:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:0.0:1782759972.062938:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecdb52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218678272:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 40us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759972.062944:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3408 00000100:00100000:2.0:1782759972.066343:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5756 00000100:00100000:2.0:1782759972.066370:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218678016:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:2.0:1782759972.066905:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+5:2402:x1869355218678016:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 546us (4948us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759972.066914:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5756 00000100:00100000:1.0:1782759972.068249:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 5757 00000100:00100000:1.0:1782759972.068265:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+25:2402:x1869355218677888:12345-192.168.202.31@tcp:400:kworker.0 00000100:00100000:1.0:1782759972.068350:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95b27dde-c150-4adf-930b-37620c52929b+25:2402:x1869355218677888:12345-192.168.202.31@tcp:400:kworker.0 Request processed in 90us (6318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759972.068357:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 5757 00000100:00080000:3.0:1782759972.069904:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782759972.069914:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759972.069922:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759972.069925:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759972.235107:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233224064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1782759972.235186:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759972.235356:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233224192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759972.235391:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759972.235470:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224192 00000100:00100000:2.0:1782759972.235478:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224192 00000100:00100000:2.0:1782759972.235542:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2974 00000100:00100000:2.0:1782759972.235553:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233224192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759972.235604:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759972.235650:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1869355233224192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759972.235658:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2974 00000100:00100000:2.0:1782759972.235722:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3662:1869355233224192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782759972.235897:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759972.236007:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233223936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759972.236036:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759972.236368:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233223936 00000100:00100000:2.0:1782759972.236373:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233223936 00000100:00100000:2.0:1782759972.236433:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2975 00000100:00100000:2.0:1782759972.236442:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233223936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1782759972.236455:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759972.236491:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3665:x1869355233223936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759972.236497:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2975 00000100:00080000:3.0:1782759972.236549:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759972.236623:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3665:1869355233223936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1782759972.237509:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224064 00000100:00100000:1.0:1782759972.237519:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224064 00000100:00100000:1.0:1782759972.237674:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3656 00000100:00100000:1.0:1782759972.237695:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233224064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1782759972.237730:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:1.0:1782759972.237804:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233224064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759972.237811:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3656 00000100:00100000:0.0:1782759972.237894:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc4d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233224064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782759972.811151:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759973.066248:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.066344:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218678528 00000100:00100000:1.0:1782759973.066355:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218678528 00000100:00100000:1.0:1782759973.066422:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 483 00000100:00100000:1.0:1782759973.066433:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+25:119143:x1869355218678528:12345-192.168.202.31@tcp:35:umount.0 00000100:00100000:1.0:1782759973.066760:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95b27dde-c150-4adf-930b-37620c52929b+26:119143:x1869355218678528:12345-192.168.202.31@tcp:35:umount.0 Request processed in 328us (525us total) trans 4294968071 rc 0/0 00000100:00100000:1.0:1782759973.066773:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 483 00000100:00100000:2.0:1782759973.071197:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.071331:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218678784 00000100:00100000:1.0:1782759973.071342:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218678784 00000100:00100000:1.0:1782759973.071460:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 484 00000100:00100000:1.0:1782759973.071473:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+5:119143:x1869355218678784:12345-192.168.202.31@tcp:35:umount.0 00000100:00100000:1.0:1782759973.071874:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+6:119143:x1869355218678784:12345-192.168.202.31@tcp:35:umount.0 Request processed in 402us (689us total) trans 4294967805 rc 0/0 00000100:00100000:1.0:1782759973.071883:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 484 00000100:00100000:2.0:1782759973.073949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.074045:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218679040 00000100:00100000:0.0:1782759973.074056:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218679040 00000100:00100000:0.0:1782759973.074124:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 485 00000100:00100000:0.0:1782759973.074136:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+26:119143:x1869355218679040:12345-192.168.202.31@tcp:35:umount.0 00000100:00100000:0.0:1782759973.074401:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95b27dde-c150-4adf-930b-37620c52929b+27:119143:x1869355218679040:12345-192.168.202.31@tcp:35:umount.0 Request processed in 266us (459us total) trans 4294968072 rc 0/0 00000100:00100000:0.0:1782759973.074410:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 485 00000100:00100000:2.0:1782759973.077741:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.078028:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218679296 00000100:00100000:1.0:1782759973.078039:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218679296 00000100:00100000:1.0:1782759973.078104:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 486 00000100:00100000:1.0:1782759973.078115:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+27:119143:x1869355218679296:12345-192.168.202.31@tcp:35:umount.0 00000100:00100000:1.0:1782759973.078370:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:95b27dde-c150-4adf-930b-37620c52929b+28:119143:x1869355218679296:12345-192.168.202.31@tcp:35:umount.0 Request processed in 257us (639us total) trans 4294968073 rc 0/0 00000100:00100000:1.0:1782759973.078378:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 486 00000100:00100000:2.0:1782759973.082066:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.082137:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.082237:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218679424 00000100:00100000:3.0:1782759973.082249:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218679424 00000100:00100000:3.0:1782759973.082314:0:9534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218679552 00000100:00100000:3.0:1782759973.082318:0:9534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218679552 00000100:00100000:3.0:1782759973.082350:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 429 00000100:00100000:3.0:1782759973.082361:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdec56dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+11:2403:x1869355218679424:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759973.082379:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759973.082401:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5413a00/0xd5b45c7f5c60e0d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277dd expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.082418:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759973.082478:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdec56dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+10:2403:x1869355218679424:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 118us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.082486:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 429 00000100:00100000:3.0:1782759973.082540:0:9534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 430 00000100:00100000:3.0:1782759973.082547:0:9534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+9:2403:x1869355218679552:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782759973.082555:0:9534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782759973.082564:0:9534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412600/0xd5b45c7f5c60e0df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb2780e expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.082573:0:9534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782759973.082642:0:9534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:2403:x1869355218679552:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 95us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.082649:0:9534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 430 00000100:00100000:2.0:1782759973.085859:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.086022:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218679680 00000100:00100000:0.0:1782759973.086035:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218679680 00000100:00100000:0.0:1782759973.086106:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 431 00000100:00100000:0.0:1782759973.086118:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+8:2403:x1869355218679680:12345-192.168.202.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782759973.086134:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782759973.086153:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cdecd8a7200/0xd5b45c7f5c60e0e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27815 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.086185:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782759973.086260:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+7:2403:x1869355218679680:12345-192.168.202.31@tcp:103:ldlm_bl.0 Request processed in 144us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.086268:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 431 00000100:00100000:3.0:1782759973.090340:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.090487:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218679808 00000100:00100000:1.0:1782759973.090497:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218679808 00000100:00100000:1.0:1782759973.090560:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1135 00000100:00100000:1.0:1782759973.090571:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+5:2401:x1869355218679808:12345-192.168.202.31@tcp:9:umount.0 00000020:00000080:1.0:1782759973.090640:0:8445:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e921 00000100:00080000:1.0:1782759973.090650:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cddc5427800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759973.090711:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967444 00000100:00100000:1.0:1782759973.090920:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95b27dde-c150-4adf-930b-37620c52929b+2:2401:x1869355218679808:12345-192.168.202.31@tcp:9:umount.0 Request processed in 350us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.090930:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1135 00010000:00010000:2.0:1782759973.091002:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759973.096241:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.096853:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218680192 00000100:00100000:1.0:1782759973.096864:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218680192 00000100:00100000:1.0:1782759973.096931:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1136 00000100:00100000:1.0:1782759973.096941:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+9:2401:x1869355218680192:12345-192.168.202.31@tcp:9:umount.0 00000020:00000080:1.0:1782759973.096978:0:8447:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e205 00000020:00010000:1.0:1782759973.096986:0:8447:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cddc5526800: total 0 00000100:00080000:1.0:1782759973.096992:0:8447:0:(import.c:65:import_set_state_nolock()) ffff8cddc5524800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759973.097052:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967457 00000020:00010000:3.0:1782759973.097507:0:9533:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cddc5526800: total 0 00010000:00010000:3.0:1782759973.097567:0:9533:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc5526800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782759973.097669:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a8654ca/0xd5b45c7f5c60e975 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ea expref: 9 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.097725:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d097fdf/0xd5b45c7f5c60e267 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27877 expref: 8 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.097747:0:9533:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc5526800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1782759973.097762:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.097764:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.097766:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782759973.098110:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95b27dde-c150-4adf-930b-37620c52929b+4:2401:x1869355218680192:12345-192.168.202.31@tcp:9:umount.0 Request processed in 1169us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.098120:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1136 00000100:00100000:0.0:1782759973.106942:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.107034:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218681600 00000100:00100000:1.0:1782759973.107044:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218681600 00000100:00100000:1.0:1782759973.107109:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3221 00000100:00100000:1.0:1782759973.107118:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+28:2401:x1869355218681600:12345-192.168.202.31@tcp:39:umount.0 00000020:00000080:1.0:1782759973.107153:0:12673:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e0ed 00000020:00010000:1.0:1782759973.107324:0:12673:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cddc70bf000: total 0 00000100:00080000:1.0:1782759973.107329:0:12673:0:(import.c:65:import_set_state_nolock()) ffff8cddc70b8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1782759973.107376:0:12673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294968073 00000100:00100000:1.0:1782759973.107533:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:95b27dde-c150-4adf-930b-37620c52929b+27:2401:x1869355218681600:12345-192.168.202.31@tcp:39:umount.0 Request processed in 416us (603us total) trans 4294968074 rc 0/0 00000100:00100000:1.0:1782759973.107541:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3221 00010000:00010000:2.0:1782759973.107621:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107632:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107641:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107647:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.107652:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107660:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107684:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:2.0:1782759973.107687:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.107691:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107702:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60e991 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107720:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107726:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107732:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107737:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.107740:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107745:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107752:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cded3a3b400) 00010000:00010000:2.0:1782759973.107754:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.107757:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107762:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6400/0xd5b45c7f5c60e936 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107777:0:3648:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107790:0:3648:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107797:0:3648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107802:0:3648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc5413600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.107804:0:3648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107810:0:3648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107816:0:3648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34f6200) 00010000:00010000:2.0:1782759973.107818:0:3648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.107820:0:3648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.107826:0:3648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5413600/0xd5b45c7f5c60e8fe lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108164:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108173:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108181:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108185:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf802400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759973.108188:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108194:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108203:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:0.0:1782759973.108205:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759973.108207:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 2/0,0 mode: --/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108212:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf802400/0xd5b45c7f5c60e94b lrc: 0/0,0 mode: --/TXN res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108236:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108242:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108249:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108254:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759973.108257:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108267:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108274:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:0.0:1782759973.108276:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759973.108279:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 2/0,0 mode: --/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108284:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60e913 lrc: 0/0,0 mode: --/TXN res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108294:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108299:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108305:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108310:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759973.108313:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108318:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108324:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff8cddc34ff300) 00010000:00010000:0.0:1782759973.108325:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759973.108328:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108334:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e8b8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108347:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108353:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108359:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108364:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:0.0:1782759973.108367:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108372:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108378:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:0.0:1782759973.108380:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782759973.108382:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 2/0,0 mode: --/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.108388:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e8bf lrc: 0/0,0 mode: --/TXN res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1782759973.109217:0:6518:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cddc70bf000: total 0 00010000:00010000:3.0:1782759973.109301:0:6518:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bf000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1782759973.109330:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34f6d00) 00010000:00010000:3.0:1782759973.109333:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759973.109342:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803400/0xd5b45c7f5c60e91a lrc: 0/0,0 mode: --/CR res: [0x200000422:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279ce expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.109361:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34ff400) 00010000:00010000:3.0:1782759973.109364:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782759973.109368:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc5412800/0xd5b45c7f5c60e8e9 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279c0 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.109383:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:3.0:1782759973.109385:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782759973.109388:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60e8cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279b9 expref: 18 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.109400:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:3.0:1782759973.109402:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782759973.109405:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60e952 lrc: 0/0,0 mode: --/CR res: [0x200000422:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279dc expref: 17 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.109416:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc24d2a00) 00010000:00010000:3.0:1782759973.109419:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782759973.109422:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803a00/0xd5b45c7f5c60e983 lrc: 0/0,0 mode: --/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb279f1 expref: 16 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.109439:0:6518:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bf000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1782759973.109449:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.109451:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.109453:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782759973.123141:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.123379:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218681856 00000100:00100000:2.0:1782759973.123391:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218681856 00000100:00100000:2.0:1782759973.123473:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3222 00000100:00100000:2.0:1782759973.123486:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+6:2401:x1869355218681856:12345-192.168.202.31@tcp:39:umount.0 00000020:00000080:2.0:1782759973.123523:0:6533:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e0f4 00000100:00080000:2.0:1782759973.123536:0:6533:0:(import.c:65:import_set_state_nolock()) ffff8cddc47ff000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782759973.123566:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967805 00000100:00100000:2.0:1782759973.123793:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:95b27dde-c150-4adf-930b-37620c52929b+4:2401:x1869355218681856:12345-192.168.202.31@tcp:39:umount.0 Request processed in 300us (652us total) trans 4294967806 rc 0/0 00000100:00100000:2.0:1782759973.123802:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3222 00010000:00010000:3.0:1782759973.124628:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782759973.148759:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.149034:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682112 00000100:00100000:0.0:1782759973.149058:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682112 00000100:00100000:0.0:1782759973.149202:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3626 00000100:00100000:0.0:1782759973.149215:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+7:2401:x1869355218682112:12345-192.168.202.31@tcp:251:umount.0 00000020:00000080:0.0:1782759973.149403:0:6526:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd5b45c7f5c60e0ca 00000020:00010000:0.0:1782759973.149411:0:6526:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8cddc70bd000: total 0 00000100:00080000:0.0:1782759973.149416:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8cddc70b9000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782759973.149506:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa0a3d0a-2da7-4899-8fa4-e6a802a55616+3:2401:x1869355218682112:12345-192.168.202.31@tcp:251:umount.0 Request processed in 292us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.149514:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3626 00000020:00010000:3.0:1782759973.149607:0:9533:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8cddc70bd000: total 0 00010000:00010000:3.0:1782759973.149612:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.149671:0:9533:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8cddc70bd000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782759973.149725:0:9533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cddc5412200/0xd5b45c7f5c60e0d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb277d6 expref: 2 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759973.149743:0:9533:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8cddc70bd000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1782759973.149755:0:9533:0:(genops.c:906:class_export_put()) final put ffff8cddc70bd000/aa0a3d0a-2da7-4899-8fa4-e6a802a55616 00010000:00010000:3.0:1782759973.149769:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.149771:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782759973.149773:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782759973.149784:0:29139:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc70bd000/aa0a3d0a-2da7-4899-8fa4-e6a802a55616 for MGS 00000020:00000080:3.0:1782759973.149817:0:29139:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc70b9000 for MGS 00000100:00100000:0.0:1782759973.310424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.310502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682240 00000100:00100000:1.0:1782759973.310514:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682240 00000100:00100000:1.0:1782759973.310574:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3627 00000100:00100000:1.0:1782759973.310614:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2401:x1869355218682240:12345-192.168.202.31@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782759973.310646:0:6524:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb@192.168.202.31@tcp t0 exp 0000000000000000 cur 4013 last 0 00000020:00000080:1.0:1782759973.310690:0:6524:0:(genops.c:1406:class_connect()) connect: client 7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb, cookie 0xd5b45c7f5c60e998 00000100:00080000:1.0:1782759973.310741:0:6524:0:(import.c:65:import_set_state_nolock()) ffff8cddc70b8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782759973.310868:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+5:2401:x1869355218682240:12345-192.168.202.31@tcp:250:mount.lustre.0 Request processed in 254us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.310878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3627 00000100:00100000:2.0:1782759973.319997:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.320935:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682368 00000100:00100000:0.0:1782759973.320948:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682368 00000100:00100000:0.0:1782759973.321012:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3628 00000100:00100000:0.0:1782759973.321024:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+5:119156:x1869355218682368:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782759973.321041:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759973.321059:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e99f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a06 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.321090:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a06 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.321102:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf802800/0xd5b45c7f5c60e99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a06 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.321111:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf802800, rc 0) 00000100:00100000:0.0:1782759973.321173:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+6:119156:x1869355218682368:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 152us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.321185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3628 00000100:00100000:2.0:1782759973.323262:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.323572:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682496 00000100:00100000:1.0:1782759973.323750:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682496 00000100:00100000:1.0:1782759973.323974:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3629 00000100:00100000:1.0:1782759973.323986:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+6:119156:x1869355218682496:12345-192.168.202.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759973.324128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+6:119156:x1869355218682496:12345-192.168.202.31@tcp:501:mount.lustre.0 Request processed in 144us (875us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782759973.324136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3629 00000100:00100000:2.0:1782759973.326066:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.326998:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682624 00000100:00100000:1.0:1782759973.327010:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682624 00000100:00100000:1.0:1782759973.327061:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3630 00000100:00100000:1.0:1782759973.327071:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+6:119156:x1869355218682624:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759973.327089:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759973.327106:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60e9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a0d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.327137:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60e9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a0d expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.327149:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5400/0xd5b45c7f5c60e9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a0d expref: 7 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.327296:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5400, rc 0) 00000100:00100000:1.0:1782759973.327349:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+7:119156:x1869355218682624:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 279us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.327356:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3630 00000100:00100000:2.0:1782759973.329923:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.330069:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682752 00000100:00100000:1.0:1782759973.330079:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682752 00000100:00100000:1.0:1782759973.330175:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3631 00000100:00100000:1.0:1782759973.330186:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+7:119156:x1869355218682752:12345-192.168.202.31@tcp:501:mount.lustre.0 00000100:00100000:1.0:1782759973.330361:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119156:x1869355218682752:12345-192.168.202.31@tcp:501:mount.lustre.0 Request processed in 177us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.330369:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3631 00000100:00100000:2.0:1782759973.336493:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.336621:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218682880 00000100:00100000:3.0:1782759973.336632:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218682880 00000100:00100000:3.0:1782759973.336700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3632 00000100:00100000:3.0:1782759973.336709:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119156:x1869355218682880:12345-192.168.202.31@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782759973.336989:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119156:x1869355218682880:12345-192.168.202.31@tcp:503:mount.lustre.0 Request processed in 280us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.337000:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3632 00000100:00100000:2.0:1782759973.341080:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.341188:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683008 00000100:00100000:1.0:1782759973.341199:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683008 00000100:00100000:1.0:1782759973.341255:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3633 00000100:00100000:1.0:1782759973.341264:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119175:x1869355218683008:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782759973.341428:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119175:x1869355218683008:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 165us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.341436:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3633 00000100:00100000:2.0:1782759973.371743:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.371953:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683136 00000100:00100000:0.0:1782759973.371963:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683136 00000100:00100000:0.0:1782759973.372023:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3634 00000100:00100000:0.0:1782759973.372034:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119175:x1869355218683136:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759973.372200:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119175:x1869355218683136:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 167us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.372207:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3634 00000100:00100000:2.0:1782759973.374540:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.374764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683264 00000100:00100000:3.0:1782759973.374775:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683264 00000100:00100000:3.0:1782759973.374830:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3635 00000100:00100000:3.0:1782759973.374839:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119175:x1869355218683264:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782759973.375000:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119175:x1869355218683264:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 162us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.375008:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3635 00000100:00100000:2.0:1782759973.379681:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.379776:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683392 00000100:00100000:1.0:1782759973.379852:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683392 00000100:00100000:1.0:1782759973.379920:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3636 00000100:00100000:1.0:1782759973.379931:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+8:119156:x1869355218683392:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782759973.379951:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759973.379973:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60e9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a3e expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.380003:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60e9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a3e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.380015:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cddc3de5200/0xd5b45c7f5c60e9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a3e expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.380025:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5200, rc 0) 00000100:00100000:1.0:1782759973.380090:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+9:119156:x1869355218683392:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 161us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.380097:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3636 00000100:00100000:2.0:1782759973.384027:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.384143:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683520 00000100:00100000:0.0:1782759973.384240:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683520 00000100:00100000:0.0:1782759973.384293:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3637 00000100:00100000:0.0:1782759973.384302:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+9:119156:x1869355218683520:12345-192.168.202.31@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782759973.384328:0:6526:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782759973.384351:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782759973.384355:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782759973.384358:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782759973.384361:0:6526:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1782759973.384364:0:6526:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1782759973.387057:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdf02070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+9:119156:x1869355218683520:12345-192.168.202.31@tcp:256:mount.lustre.0 Request processed in 2746us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.387070:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3637 00000100:00100000:2.0:1782759973.393331:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.393439:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683648 00000100:00100000:3.0:1782759973.393449:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683648 00000100:00100000:3.0:1782759973.393559:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3638 00000100:00100000:3.0:1782759973.393569:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+9:119156:x1869355218683648:12345-192.168.202.31@tcp:101:mount.lustre.0 00010000:00010000:3.0:1782759973.393755:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.393876:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e9b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a45 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.393906:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e9b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a45 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.393917:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cdedf648200/0xd5b45c7f5c60e9b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a45 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.393927:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648200, rc 0) 00000100:00100000:2.0:1782759973.393991:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdee56c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119156:x1869355218683648:12345-192.168.202.31@tcp:101:mount.lustre.0 Request processed in 423us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.393999:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3638 00000100:00100000:2.0:1782759973.395892:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.396316:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683776 00000100:00100000:0.0:1782759973.396327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683776 00000100:00100000:0.0:1782759973.396417:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3639 00000100:00100000:0.0:1782759973.396426:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119156:x1869355218683776:12345-192.168.202.31@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782759973.396630:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119156:x1869355218683776:12345-192.168.202.31@tcp:501:mount.lustre.0 Request processed in 204us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.396639:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3639 00000100:00100000:0.0:1782759973.398312:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.398358:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218683904 00000100:00100000:2.0:1782759973.398364:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218683904 00000100:00100000:2.0:1782759973.398413:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3640 00000100:00100000:2.0:1782759973.398424:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119156:x1869355218683904:12345-192.168.202.31@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782759973.398636:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119156:x1869355218683904:12345-192.168.202.31@tcp:503:mount.lustre.0 Request processed in 213us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.398644:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3640 00000100:00100000:2.0:1782759973.401762:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.401986:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684032 00000100:00100000:0.0:1782759973.401996:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684032 00000100:00100000:0.0:1782759973.402061:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3641 00000100:00100000:0.0:1782759973.402071:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119179:x1869355218684032:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782759973.402220:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119179:x1869355218684032:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 150us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.402225:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3641 00000100:00100000:2.0:1782759973.406381:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.407036:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684160 00000100:00100000:3.0:1782759973.407048:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684160 00000100:00100000:3.0:1782759973.407497:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3642 00000100:00100000:3.0:1782759973.407507:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119179:x1869355218684160:12345-192.168.202.31@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782759973.408270:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d44c8fc-33e6-4ff3-8d64-3ede3ac1eebb+10:119179:x1869355218684160:12345-192.168.202.31@tcp:502:llog_process_th.0 Request processed in 758us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.408281:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3642 00000100:00100000:3.0:1782759973.415298:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.415450:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.416554:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684288 00000100:00100000:1.0:1782759973.416567:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684288 00000100:00100000:1.0:1782759973.416690:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684544 00000100:00100000:1.0:1782759973.416694:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684544 00000100:00100000:2.0:1782759973.416804:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3223 00000100:00100000:2.0:1782759973.416814:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869355218684288:12345-192.168.202.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782759973.416849:0:6531:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 30c7d140-73a2-4bba-a976-24cedcc81799@192.168.202.31@tcp t0 exp 0000000000000000 cur 4013 last 0 00000020:00000080:2.0:1782759973.416886:0:6531:0:(genops.c:1406:class_connect()) connect: client 30c7d140-73a2-4bba-a976-24cedcc81799, cookie 0xd5b45c7f5c60e9bb 00000004:00100000:2.0:1782759973.416911:0:6531:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782759973.417019:0:6531:0:(import.c:65:import_set_state_nolock()) ffff8cddc5421000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759973.417104:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+6:2401:x1869355218684288:12345-192.168.202.31@tcp:38:mount.lustre.0 Request processed in 289us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.417112:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3223 00000100:00100000:2.0:1782759973.417134:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3224 00000100:00100000:2.0:1782759973.417138:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1869355218684544:12345-192.168.202.31@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782759973.417153:0:6531:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 30c7d140-73a2-4bba-a976-24cedcc81799@192.168.202.31@tcp t0 exp 0000000000000000 cur 4013 last 0 00000020:00000080:2.0:1782759973.417192:0:6531:0:(genops.c:1406:class_connect()) connect: client 30c7d140-73a2-4bba-a976-24cedcc81799, cookie 0xd5b45c7f5c60e9c2 00000004:00100000:2.0:1782759973.417205:0:6531:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782759973.417246:0:6531:0:(import.c:65:import_set_state_nolock()) ffff8cddc5420000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782759973.417271:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+6:2401:x1869355218684544:12345-192.168.202.31@tcp:38:mount.lustre.0 Request processed in 131us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.417277:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3224 00000100:00100000:0.0:1782759973.423519:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.423646:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684672 00000100:00100000:2.0:1782759973.423657:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684672 00000100:00100000:2.0:1782759973.423768:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3225 00000100:00100000:2.0:1782759973.423790:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+6:0:x1869355218684672:12345-192.168.202.31@tcp:41:mount.lustre.0 00000100:00080000:3.0:1782759973.423992:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1782759973.424117:0:42628:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:2.0:1782759973.424204:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+6:0:x1869355218684672:12345-192.168.202.31@tcp:41:mount.lustre.0 Request processed in 424us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.424211:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3225 00000100:00100000:3.0:1782759973.426121:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.426298:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684416 00000100:00100000:2.0:1782759973.426308:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684416 00000100:00100000:2.0:1782759973.426389:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3226 00000100:00100000:2.0:1782759973.426399:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+6:0:x1869355218684416:12345-192.168.202.31@tcp:41:mount.lustre.0 00000004:00000024:2.0:1782759973.426439:0:6531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445642240 avail 1299402752 00000100:00100000:2.0:1782759973.426507:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+6:0:x1869355218684416:12345-192.168.202.31@tcp:41:mount.lustre.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.426515:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3226 00000100:00080000:0.0:1782759973.426749:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782759973.426933:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.427190:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684800 00000100:00100000:1.0:1782759973.427196:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684800 00000100:00100000:1.0:1782759973.427239:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3227 00000100:00100000:1.0:1782759973.427246:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218684800:12345-192.168.202.31@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782759973.427264:0:8593:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445642240 avail 1299402752 00000100:00100000:1.0:1782759973.427308:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218684800:12345-192.168.202.31@tcp:41:mount.lustre.0 Request processed in 63us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.427315:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3227 00000100:00100000:3.0:1782759973.431198:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.431525:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218684928 00000100:00100000:2.0:1782759973.431535:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218684928 00000100:00100000:2.0:1782759973.432019:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3228 00000100:00100000:2.0:1782759973.432033:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218684928:12345-192.168.202.31@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782759973.432135:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218684928:12345-192.168.202.31@tcp:40:mount.lustre.0 Request processed in 106us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.432142:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3228 00000100:00100000:3.0:1782759973.436907:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.437014:0:123455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685312 00000100:00100000:1.0:1782759973.437025:0:123455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685312 00000100:00100000:1.0:1782759973.437088:0:123455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 116 00000100:00100000:1.0:1782759973.437098:0:123455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218685312:12345-192.168.202.31@tcp:900:mount.lustre.0 00000100:00100000:1.0:1782759973.437187:0:123455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218685312:12345-192.168.202.31@tcp:900:mount.lustre.0 Request processed in 91us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.437199:0:123455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 116 00000100:00100000:3.0:1782759973.437422:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.437550:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.437769:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685056 00000100:00100000:1.0:1782759973.437774:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685056 00000100:00100000:1.0:1782759973.437858:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685184 00000100:00100000:1.0:1782759973.437862:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685184 00000100:00100000:1.0:1782759973.437886:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1137 00000100:00100000:1.0:1782759973.437893:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1869355218685056:12345-192.168.202.31@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782759973.437918:0:8445:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 30c7d140-73a2-4bba-a976-24cedcc81799@192.168.202.31@tcp t0 exp 0000000000000000 cur 4013 last 0 00000020:00000080:1.0:1782759973.437948:0:8445:0:(genops.c:1406:class_connect()) connect: client 30c7d140-73a2-4bba-a976-24cedcc81799, cookie 0xd5b45c7f5c60e9c9 00002000:00100000:1.0:1782759973.437960:0:8445:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 30c7d140-73a2-4bba-a976-24cedcc81799/ffff8cddc70ba800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782759973.437972:0:8445:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1782759973.438015:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1138 00000100:00100000:3.0:1782759973.438021:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1869355218685184:12345-192.168.202.31@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782759973.438038:0:8600:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 30c7d140-73a2-4bba-a976-24cedcc81799@192.168.202.31@tcp t0 exp 0000000000000000 cur 4013 last 0 00002000:00080000:1.0:1782759973.438048:0:8445:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:3.0:1782759973.438057:0:8600:0:(genops.c:1406:class_connect()) connect: client 30c7d140-73a2-4bba-a976-24cedcc81799, cookie 0xd5b45c7f5c60e9d0 00002000:00100000:3.0:1782759973.438073:0:8600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 30c7d140-73a2-4bba-a976-24cedcc81799/ffff8cddc47f8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:1.0:1782759973.438075:0:8445:0:(import.c:65:import_set_state_nolock()) ffff8cddc70b9800 : changing import state from RECOVER to FULL 00002000:00100000:3.0:1782759973.438086:0:8600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1782759973.438115:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:30c7d140-73a2-4bba-a976-24cedcc81799+6:2401:x1869355218685056:12345-192.168.202.31@tcp:8:mount.lustre.0 Request processed in 221us (694us total) trans 0 rc 0/0 00002000:00080000:3.0:1782759973.438119:0:8600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1782759973.438122:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1137 00000100:00080000:3.0:1782759973.438132:0:8600:0:(import.c:65:import_set_state_nolock()) ffff8cddc47fe800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782759973.438153:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:30c7d140-73a2-4bba-a976-24cedcc81799+6:2401:x1869355218685184:12345-192.168.202.31@tcp:8:mount.lustre.0 Request processed in 132us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.438160:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1138 00000100:00100000:3.0:1782759973.441718:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.442792:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685440 00000100:00100000:1.0:1782759973.442807:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685440 00000100:00100000:1.0:1782759973.442880:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 487 00000100:00100000:1.0:1782759973.442890:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218685440:12345-192.168.202.31@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782759973.442988:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1782759973.443086:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30c7d140-73a2-4bba-a976-24cedcc81799+6:119156:x1869355218685440:12345-192.168.202.31@tcp:33:mount.lustre.0 Request processed in 197us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.443093:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 487 00000100:00100000:1.0:1782759973.570424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.570521:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685568 00000100:00100000:2.0:1782759973.570534:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685568 00000100:00100000:2.0:1782759973.570964:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3229 00000100:00100000:2.0:1782759973.570978:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+6:119197:x1869355218685568:12345-192.168.202.31@tcp:101:mkdir.0 00010000:00010000:2.0:1782759973.570999:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.571018:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a76 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.571078:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e9de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.571093:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.571104:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.571151:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1782759973.571256:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759973.571282:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e9de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.571308:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a76 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.571328:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e9de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a76 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.571337:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759973.571340:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782759973.571344:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759973.571400:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+7:119197:x1869355218685568:12345-192.168.202.31@tcp:101:mkdir.0 Request processed in 427us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.571411:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3229 00000100:00100000:0.0:1782759973.601105:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.601186:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685696 00000100:00100000:3.0:1782759973.601196:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685696 00000100:00100000:3.0:1782759973.601260:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 40 00000100:00100000:3.0:1782759973.601269:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:30c7d140-73a2-4bba-a976-24cedcc81799+7:119197:x1869355218685696:12345-192.168.202.31@tcp:700:mkdir.0 00000100:00100000:3.0:1782759973.601360:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:30c7d140-73a2-4bba-a976-24cedcc81799+7:119197:x1869355218685696:12345-192.168.202.31@tcp:700:mkdir.0 Request processed in 91us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.601368:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 40 00000100:00100000:3.0:1782759973.603523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.603966:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218685952 00000100:00100000:2.0:1782759973.603977:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218685952 00000100:00100000:2.0:1782759973.604049:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3230 00000100:00100000:2.0:1782759973.604060:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+7:119197:x1869355218685952:12345-192.168.202.31@tcp:36:mkdir.0 00010000:00010000:2.0:1782759973.604115:0:12673:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782759973.604140:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60e9de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a76 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.604158:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759973.604163:0:12673:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782759973.604220:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.604234:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.604244:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.604281:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.604288:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.604294:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606213:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,1 mode: --/PW res: [0x200000423:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606235:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606246:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759973.606258:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bab3f58 reply state 000000008a3b6185 transno 4294968075 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,1 mode: PW/PW res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606269:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606276:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000423:0x1:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:2.0:1782759973.606279:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759973.606282:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782759973.606288:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000423:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1782759973.606296:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606302:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606308:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606315:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606320:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.606325:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606332:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606341:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:2.0:1782759973.606343:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.606346:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606352:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60e9e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782759973.606365:0:12673:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bab3f58 reply state 000000008a3b6185 transno 4294968075 ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606372:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.606378:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4ab1b53 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.606380:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1782759973.606382:0:12673:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1782759973.606484:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+8:119197:x1869355218685952:12345-192.168.202.31@tcp:36:mkdir.0 Request processed in 2422us (2965us total) trans 4294968075 rc 0/0 00000100:00100000:2.0:1782759973.606494:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3230 00000100:00100000:1.0:1782759973.645073:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.646152:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218686080 00000100:00100000:0.0:1782759973.646172:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218686080 00000100:00100000:0.0:1782759973.646244:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3231 00000100:00100000:0.0:1782759973.646255:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+8:119204:x1869355218686080:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:0.0:1782759973.646281:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782759973.646303:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e9fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a7d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.646368:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60ea01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.646395:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60ea01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.646408:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60ea01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782759973.646469:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1782759973.646474:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1782759973.646499:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60ea01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.646525:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803600/0xd5b45c7f5c60e9fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a7d expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.646544:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf803000/0xd5b45c7f5c60ea01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a7d expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782759973.646553:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:0.0:1782759973.646556:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782759973.646560:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf803000, rc 0) 00000100:00100000:0.0:1782759973.649235:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+9:119204:x1869355218686080:12345-192.168.202.31@tcp:101:touch.0 Request processed in 2969us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.649248:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3231 00000100:00100000:3.0:1782759973.652634:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.652771:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218686208 00000100:00100000:1.0:1782759973.652782:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218686208 00000100:00100000:1.0:1782759973.652849:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3232 00000100:00100000:1.0:1782759973.652862:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+9:119204:x1869355218686208:12345-192.168.202.31@tcp:101:touch.0 00010000:00010000:1.0:1782759973.652889:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759973.652911:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a84 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.652978:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.652994:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653005:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653017:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653025:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653031:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653140:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ea1d lrc: 3/1,0 mode: --/PR res: [0x200000423:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653149:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ea1d lrc: 3/1,0 mode: PR/PR res: [0x200000423:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653157:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ea1d lrc: 3/1,0 mode: PR/PR res: [0x200000423:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759973.653209:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000423:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1782759973.653214:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759973.653243:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ea1d lrc: 3/1,0 mode: PR/PR res: [0x200000423:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653261:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653267:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653274:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653281:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653288:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759973.653293:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653301:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653314:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759973.653318:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759973.653321:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653345:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653362:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653369:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653375:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653379:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759973.653382:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653388:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653394:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4ab1b53 (ffff8cddc34ff800) 00010000:00010000:1.0:1782759973.653396:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759973.653399:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653405:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653427:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a84 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653439:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4400/0xd5b45c7f5c60ea1d lrc: 3/0,0 mode: PR/PR res: [0x200000423:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a84 expref: 10 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.653448:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000423:0x1:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:1.0:1782759973.653450:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759973.653453:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4400, rc 0) 00000100:00100000:1.0:1782759973.654392:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+10:119204:x1869355218686208:12345-192.168.202.31@tcp:101:touch.0 Request processed in 1526us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.654402:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3232 00000100:00100000:3.0:1782759973.721120:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.721300:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218686336 00000100:00100000:1.0:1782759973.721309:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218686336 00000100:00100000:1.0:1782759973.721374:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3233 00000100:00100000:1.0:1782759973.721387:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30c7d140-73a2-4bba-a976-24cedcc81799+10:119212:x1869355218686336:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759973.721406:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759973.721424:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a8b expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.721536:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.721547:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.721556:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.721921:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.721930:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.721942:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.722028:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60ea39 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.722037:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60ea39 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.722044:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60ea39 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759973.722544:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1782759973.722550:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759973.723191:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60ea39 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723209:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723217:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723222:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723229:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723235:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759973.723239:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723248:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723263:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759973.723267:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759973.723271:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723277:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60ea2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723294:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723298:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723301:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723304:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759973.723306:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723309:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723314:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xba28ca49 (ffff8cddc34f6a00) 00010000:00010000:1.0:1782759973.723315:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759973.723316:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723323:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4a00/0xd5b45c7f5c60ea32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xba28ca49 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723362:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a8b expref: 12 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723375:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4000/0xd5b45c7f5c60ea39 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a8b expref: 11 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.723381:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759973.723382:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782759973.723384:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4000, rc 0) 00000100:00100000:1.0:1782759973.724067:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218686336:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 2672us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.724078:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3233 00000100:00100000:0.0:1782759973.743369:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759973.743461:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218686464 00000100:00100000:3.0:1782759973.743471:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218686464 00000100:00100000:3.0:1782759973.743528:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 117 00000100:00100000:3.0:1782759973.743538:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218686464:12345-192.168.202.31@tcp:900:lfs.0 00000100:00100000:3.0:1782759973.743920:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218686464:12345-192.168.202.31@tcp:900:lfs.0 Request processed in 382us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759973.743928:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 117 00000100:00100000:3.0:1782759973.758166:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.758251:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218686720 00000100:00100000:2.0:1782759973.758261:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218686720 00000100:00100000:2.0:1782759973.758321:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3234 00000100:00100000:2.0:1782759973.758329:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218686720:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759973.758353:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.758376:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60ea40 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a92 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758459:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758471:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758481:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758490:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758494:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758498:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758636:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758643:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758649:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758656:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758662:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.758677:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758686:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758699:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.758703:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.758708:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758714:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea47 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758729:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758736:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758742:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758748:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.758751:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758757:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758764:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759973.758766:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.758769:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758775:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea4e lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758822:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60ea40 lrc: 1/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a92 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758832:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.758834:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782759973.758838:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60ea40 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a92 expref: 12 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.758849:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648000, rc 0) 00000100:00100000:2.0:1782759973.758928:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218686720:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 598us (775us total) trans 0 rc 301/301 00000100:00100000:2.0:1782759973.758934:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3234 00000100:00100000:0.0:1782759973.771712:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.772067:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218686976 00000100:00100000:2.0:1782759973.772080:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218686976 00000100:00100000:2.0:1782759973.772167:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3235 00000100:00100000:2.0:1782759973.772181:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218686976:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759973.772206:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.772226:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60ea55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27a99 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.772339:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x9:0x0]: returning size 4096 00000001:00080000:0.0:1782759973.781302:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968076 is committed 00000001:00100000:0.0:1782759973.781328:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 30c7d140-73a2-4bba-a976-24cedcc81799 00000001:00100000:0.0:1782759973.781333:0:6509:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000001:00080000:0.0:1782759973.781340:0:6509:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968074 is committed 00000020:00000080:0.0:1782759973.781367:0:6509:0:(genops.c:906:class_export_put()) final put ffff8cddc70bf000/95b27dde-c150-4adf-930b-37620c52929b 00010000:00010000:1.0:1782759973.781541:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60ea55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a99 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.781571:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cdec8ac9900) 00010000:00010000:1.0:1782759973.781616:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759973.781623:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60ea55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27a99 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.781640:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648000, rc 0) 00000100:00100000:1.0:1782759973.781741:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+9:119212:x1869355218686976:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 9562us (10036us total) trans 4294968076 rc 301/301 00000100:00100000:1.0:1782759973.781755:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3235 00000020:00000080:3.0:1782759973.782449:0:62521:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc70bf000/95b27dde-c150-4adf-930b-37620c52929b for lustre-MDT0000 00000020:00000080:3.0:1782759973.782520:0:62521:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc70b8000 for lustre-MDT0000 00010000:00010000:2.0:1782759973.783366:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783382:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783389:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783395:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.783400:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783407:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783424:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4ab1b53 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.783437:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.783441:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783448:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60e9ec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xb4ab1b53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783468:0:3649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783474:0:3649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783479:0:3649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783485:0:3649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.783488:0:3649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783493:0:3649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783501:0:3649:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000423:0x1:0x0].0x0 (ffff8cddc34fff00) 00010000:00010000:2.0:1782759973.783503:0:3649:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.783506:0:3649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 2/0,0 mode: --/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.783512:0:3649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60e9f3 lrc: 0/0,0 mode: --/TXN res: [0x200000423:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759973.801908:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.802050:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218687104 00000100:00100000:2.0:1782759973.802063:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218687104 00000100:00100000:2.0:1782759973.802141:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3236 00000100:00100000:2.0:1782759973.802154:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+8:119212:x1869355218687104:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1782759973.802242:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802262:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802275:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802290:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802296:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802307:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802382:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802390:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802397:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.802444:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xa:0x0]: returning size 0 00000004:00200000:2.0:1782759973.802448:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759973.802463:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802478:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802485:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802492:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802500:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802506:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.802511:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802520:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802533:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.802536:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.802540:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802546:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea63 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802561:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802566:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802572:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802644:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.802648:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802655:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802662:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.802664:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.802678:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802689:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea6a lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802703:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802709:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802715:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802719:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.802722:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802727:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802734:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759973.802736:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.802739:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 2/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.802745:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea71 lrc: 0/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759973.803030:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+8:119212:x1869355218687104:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 876us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.803040:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3236 00000100:00100000:0.0:1782759973.821330:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.826548:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218687360 00000100:00100000:2.0:1782759973.826565:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218687360 00000100:00100000:2.0:1782759973.828540:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3237 00000100:00100000:2.0:1782759973.828555:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+8:119212:x1869355218687360:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759973.828609:0:42628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.828633:0:42628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea78 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27aa0 expref: -99 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.828993:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829010:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829021:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829036:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829043:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829049:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829174:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea8d lrc: 3/1,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829183:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea8d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829195:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea8d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.829206:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xa:0x0]: returning size 0 00010000:00010000:2.0:1782759973.829306:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829314:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829320:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829327:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829333:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.829337:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829345:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829357:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.829361:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.829365:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829372:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60ea7f lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829386:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829394:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829400:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829405:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.829408:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829414:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829421:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759973.829424:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.829427:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829433:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60ea86 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829475:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60ea78 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aa0 expref: 11 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829489:0:42628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649800/0xd5b45c7f5c60ea8d lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aa0 expref: 10 pid: 42628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.829496:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.829498:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759973.829501:0:42628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf649800, rc 0) 00000100:00100000:2.0:1782759973.829573:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+10:119212:x1869355218687360:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1022us (8252us total) trans 4294968077 rc 0/0 00000100:00100000:2.0:1782759973.831754:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3237 00010000:00010000:3.0:1782759973.837349:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759973.847650:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.847766:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218687488 00000100:00100000:1.0:1782759973.847786:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218687488 00000100:00100000:1.0:1782759973.847851:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3238 00000100:00100000:1.0:1782759973.847861:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+10:119212:x1869355218687488:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759973.847888:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759973.847908:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea9b lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27aa7 expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.847943:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea9b lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aa7 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.847958:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5600/0xd5b45c7f5c60ea9b lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aa7 expref: 11 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.847968:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759973.847970:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759973.847974:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de5600, rc 0) 00000100:00100000:1.0:1782759973.848036:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218687488:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 175us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.848042:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3238 00000100:00100000:3.0:1782759973.858101:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.858261:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218687616 00000100:00100000:0.0:1782759973.858273:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218687616 00000100:00100000:0.0:1782759973.858335:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 488 00000100:00100000:0.0:1782759973.858345:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3bef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218687616:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:0.0:1782759973.878029:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3bef850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218687616:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 19671us (19923us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759973.878048:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 488 00000100:00100000:3.0:1782759973.884282:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.885744:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218687744 00000100:00100000:1.0:1782759973.885758:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218687744 00000100:00100000:1.0:1782759973.886079:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1139 00000100:00100000:1.0:1782759973.886090:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30c7d140-73a2-4bba-a976-24cedcc81799+6:2402:x1869355218687744:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759973.886108:0:8447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759973.886130:0:8447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012ce30da/0xd5b45c7f5c60eaa2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27aae expref: -99 pid: 8447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782759973.886157:0:8447:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x6a42c222, atime: 0x6a42c222, ctime: 0x6a42c222, blocks: 0x0 00010000:00010000:1.0:1782759973.886176:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=4014s v=(0 0) 00010000:00010000:1.0:1782759973.886181:0:8447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782759973.886190:0:8447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012ce30da/0xd5b45c7f5c60eaa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aae expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.886208:0:8447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012ce30da/0xd5b45c7f5c60eaa2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aae expref: 7 pid: 8447 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759973.886221:0:8447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4a00, rc 0) 00000100:00100000:1.0:1782759973.886281:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:30c7d140-73a2-4bba-a976-24cedcc81799+7:2402:x1869355218687744:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 194us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759973.886288:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1139 00000100:00080000:0.0:1782759973.886408:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782759973.891725:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759973.892000:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218688000 00000100:00100000:1.0:1782759973.892010:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218688000 00000100:00100000:1.0:1782759973.892072:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 489 00000100:00100000:1.0:1782759973.892081:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:30c7d140-73a2-4bba-a976-24cedcc81799+11:119212:x1869355218688000:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:1.0:1782759973.892314:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:30c7d140-73a2-4bba-a976-24cedcc81799+12:119212:x1869355218688000:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 234us (604us total) trans 4294968078 rc 0/0 00000100:00100000:1.0:1782759973.892323:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 489 00000100:00100000:3.0:1782759973.898398:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:0.0:1782759973.898498:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218688256 00000100:00100000:0.0:1782759973.898510:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218688256 00000100:00100000:0.0:1782759973.898573:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 490 00000100:00100000:0.0:1782759973.898626:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30c7d140-73a2-4bba-a976-24cedcc81799+12:119212:x1869355218688256:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:0.0:1782759973.899208:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:30c7d140-73a2-4bba-a976-24cedcc81799+13:119212:x1869355218688256:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 583us (818us total) trans 4294968079 rc 0/0 00000100:00100000:0.0:1782759973.899217:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 490 00000100:00100000:0.0:1782759973.937706:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.937965:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218688512 00000100:00100000:2.0:1782759973.937975:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218688512 00000100:00100000:2.0:1782759973.938045:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3239 00000100:00100000:2.0:1782759973.938057:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+13:119216:x1869355218688512:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759973.938081:0:12673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.938101:0:12673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60eaa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27ab5 expref: -99 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.938210:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60eab0 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.938224:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60eab0 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.938236:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60eab0 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.938248:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1782759973.938360:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649e00/0xd5b45c7f5c60eaa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ab5 expref: 16 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.938379:0:12673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648600/0xd5b45c7f5c60eab0 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ab5 expref: 15 pid: 12673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.938388:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.938392:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782759973.938395:0:12673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedf648600, rc 0) 00000100:00100000:2.0:1782759973.939683:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+15:119216:x1869355218688512:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1611us (1982us total) trans 4294968080 rc 0/0 00000100:00100000:2.0:1782759973.939708:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3239 00000100:00100000:1.0:1782759973.946958:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.947107:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218688640 00000100:00100000:2.0:1782759973.947118:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218688640 00000100:00100000:2.0:1782759973.947192:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3240 00000100:00100000:2.0:1782759973.947205:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+15:119216:x1869355218688640:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1782759973.947289:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947308:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947320:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947336:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947342:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947348:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947433:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/1,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947440:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947447:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.947491:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xa:0x0]: returning size 0 00000004:00200000:2.0:1782759973.947494:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759973.947506:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947518:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947523:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947529:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947534:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947539:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.947543:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947550:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947560:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.947563:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.947566:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947598:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648e00/0xd5b45c7f5c60eabe lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947614:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947620:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947627:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947632:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf648000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.947635:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947640:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947646:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759973.947648:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.947651:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947656:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf648000/0xd5b45c7f5c60eac5 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947682:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947701:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947708:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947712:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedf649200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.947714:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947720:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947726:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.947729:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.947731:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 2/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.947746:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedf649200/0xd5b45c7f5c60eacc lrc: 0/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759973.948291:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+15:119216:x1869355218688640:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 1086us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.948302:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3240 00000100:00100000:1.0:1782759973.952505:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.952620:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218688896 00000100:00100000:2.0:1782759973.952633:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218688896 00000100:00100000:2.0:1782759973.952719:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3241 00000100:00100000:2.0:1782759973.952941:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+15:119216:x1869355218688896:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759973.952966:0:8593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759973.952987:0:8593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60ead3 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27abc expref: -99 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.953099:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767400/0xd5b45c7f5c60eada lrc: 3/1,0 mode: --/CR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.953114:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767400/0xd5b45c7f5c60eada lrc: 3/1,0 mode: CR/CR res: [0x200000422:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.953126:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767400/0xd5b45c7f5c60eada lrc: 3/1,0 mode: CR/CR res: [0x200000422:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.953138:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xa:0x0]: returning size 0 00010000:00010000:2.0:1782759973.953373:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60ead3 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27abc expref: 18 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.953393:0:8593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767400/0xd5b45c7f5c60eada lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27abc expref: 17 pid: 8593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.953402:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.953406:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782759973.953411:0:8593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767400, rc 0) 00000100:00100000:2.0:1782759973.953954:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+17:119216:x1869355218688896:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 1223us (1456us total) trans 4294968081 rc 0/0 00000100:00100000:2.0:1782759973.953963:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3241 00000100:00100000:1.0:1782759973.980847:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759973.981004:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218689024 00000100:00100000:2.0:1782759973.981016:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218689024 00000100:00100000:2.0:1782759973.981090:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3242 00000100:00100000:2.0:1782759973.981102:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30c7d140-73a2-4bba-a976-24cedcc81799+17:119220:x1869355218689024:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1782759973.981180:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981197:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981209:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981226:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981233:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981240:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981309:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981317:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981325:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759973.981370:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xa:0x0]: returning size 0 00000004:00200000:2.0:1782759973.981374:0:6532:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759973.981388:0:6532:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981403:0:6532:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981413:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981418:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981425:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981431:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.981436:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981442:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981453:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759973.981456:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.981461:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981467:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eae8 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981482:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981487:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981493:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981498:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.981501:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981507:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981513:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759973.981516:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.981518:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981523:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eaef lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981536:0:6532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981542:0:6532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981547:0:6532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981552:0:6532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759973.981555:0:6532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981561:0:6532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981573:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759973.981870:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759973.981876:0:6532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 2/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759973.981883:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eaf6 lrc: 0/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759973.982344:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30c7d140-73a2-4bba-a976-24cedcc81799+17:119220:x1869355218689024:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 1242us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759973.982354:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3242 00000100:00100000:1.0:1782759974.022275:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759974.023154:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218689152 00000100:00100000:2.0:1782759974.023178:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218689152 00000100:00100000:2.0:1782759974.023262:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3243 00000100:00100000:2.0:1782759974.023274:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+17:119226:x1869355218689152:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1782759974.023356:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023375:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023388:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023403:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023411:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023421:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023503:0:42628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/1,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023511:0:42628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.023518:0:42628:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759974.023564:0:42628:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xa:0x0]: returning size 0 00000004:00200000:2.0:1782759974.023568:0:42628:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759974.024355:0:42628:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024376:0:42628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024383:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024390:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024397:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024404:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.024408:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024417:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024431:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759974.024435:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.024440:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024446:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eafd lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024468:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024474:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024480:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024485:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.024488:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024494:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024501:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x8af34a25 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759974.024503:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.024506:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024516:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb04 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x8af34a25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024534:0:42628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024540:0:42628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024547:0:42628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024551:0:42628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.024554:0:42628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024559:0:42628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024566:0:42628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xa:0x0].0x0 (ffff8cddc34ff800) 00010000:00010000:2.0:1782759974.024568:0:42628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.024570:0:42628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 2/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.024755:0:42628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb0b lrc: 0/0,0 mode: --/PR res: [0x200000422:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 42628 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759974.025787:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:30c7d140-73a2-4bba-a976-24cedcc81799+17:119226:x1869355218689152:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 2500us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759974.025801:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3243 00000100:00100000:3.0:1782759974.061563:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759974.062125:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218689408 00000100:00100000:1.0:1782759974.062136:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218689408 00000100:00100000:1.0:1782759974.062199:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3244 00000100:00100000:1.0:1782759974.062209:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+17:119233:x1869355218689408:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:1.0:1782759974.062230:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782759974.062248:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb12 lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27ac3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062320:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062335:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062348:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062362:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062368:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062375:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062459:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062467:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062473:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062480:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062486:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4200 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759974.062491:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062498:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062511:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759974.062514:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.062519:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062526:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4200/0xd5b45c7f5c60eb19 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062540:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062546:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062551:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062556:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759974.062559:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062564:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062571:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cddc34f6d00) 00010000:00010000:1.0:1782759974.062574:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.062632:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062639:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb20 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062681:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb12 lrc: 1/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ac3 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062693:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759974.062695:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782759974.062699:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb12 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ac3 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.062708:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cddc3de4600, rc 0) 00000100:00100000:1.0:1782759974.062979:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+17:119233:x1869355218689408:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 770us (1426us total) trans 0 rc 301/301 00000100:00100000:1.0:1782759974.062987:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3244 00000100:00100000:1.0:1782759974.070709:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759974.070958:0:12673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218689536 00000100:00100000:3.0:1782759974.070968:0:12673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218689536 00000100:00100000:3.0:1782759974.071172:0:12673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3245 00000100:00100000:3.0:1782759974.071186:0:12673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+17:119233:x1869355218689536:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:3.0:1782759974.071258:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071280:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071298:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071313:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071322:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071329:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071408:0:12673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071415:0:12673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071423:0:12673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782759974.071464:0:12673:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782759974.071469:0:12673:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1782759974.071482:0:12673:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071496:0:12673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071502:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071513:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071520:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071527:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759974.071531:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071540:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071553:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:3.0:1782759974.071556:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759974.071562:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071568:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7000/0xd5b45c7f5c60eb27 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071617:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071625:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071631:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071637:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a6800 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759974.071640:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071647:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071655:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cded3a3b100) 00010000:00010000:3.0:1782759974.071657:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759974.071660:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071679:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a6800/0xd5b45c7f5c60eb2e lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071694:0:12673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071699:0:12673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071704:0:12673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071708:0:12673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdecd8a7400 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:3.0:1782759974.071711:0:12673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071716:0:12673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071728:0:12673:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cded3a3b900) 00010000:00010000:3.0:1782759974.071730:0:12673:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782759974.071733:0:12673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 2/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782759974.071738:0:12673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdecd8a7400/0xd5b45c7f5c60eb35 lrc: 0/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12673 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782759974.072106:0:12673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:30c7d140-73a2-4bba-a976-24cedcc81799+17:119233:x1869355218689536:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 921us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759974.072115:0:12673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3245 00000100:00100000:0.0:1782759974.102424:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759974.103730:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218689792 00000100:00100000:2.0:1782759974.103746:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218689792 00000100:00100000:2.0:1782759974.103845:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3246 00000100:00100000:2.0:1782759974.103856:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc55f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+17:119233:x1869355218689792:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759974.103881:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759974.103903:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb3c lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27aca expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.103979:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.103995:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104008:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104025:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104032:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104039:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104175:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60eb51 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104184:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60eb51 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104191:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60eb51 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759974.104202:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782759974.104295:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104303:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104308:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104315:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104320:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766000 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.104325:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104333:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104346:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759974.104348:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.104353:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104360:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb43 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104374:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104380:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104386:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104392:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.104395:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104400:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104406:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cddc34ffa00) 00010000:00010000:2.0:1782759974.104409:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.104411:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104417:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb4a lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104459:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766800/0xd5b45c7f5c60eb3c lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aca expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104472:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767200/0xd5b45c7f5c60eb51 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27aca expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.104480:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:2.0:1782759974.104482:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782759974.104484:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb767200, rc 0) 00000100:00100000:2.0:1782759974.104674:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc55f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+19:119233:x1869355218689792:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 809us (2248us total) trans 4294968082 rc 0/0 00000100:00100000:2.0:1782759974.104683:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3246 00000100:00100000:1.0:1782759974.119462:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759974.119565:0:82628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218689920 00000100:00100000:2.0:1782759974.119621:0:82628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218689920 00000100:00100000:2.0:1782759974.119698:0:82628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 1140 00000100:00080000:0.0:1782759974.119703:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782759974.119717:0:82628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30c7d140-73a2-4bba-a976-24cedcc81799+6:2404:x1869355218689920:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759974.119737:0:82628:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759974.119760:0:82628:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e07a62ec/0xd5b45c7f5c60eb5f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27ad1 expref: -99 pid: 82628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782759974.119787:0:82628:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x6a42c222, atime: 0x6a42c222, ctime: 0x6a42c222, blocks: 0x0 00010000:00010000:2.0:1782759974.119810:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=4014s v=(0 0) 00010000:00010000:2.0:1782759974.119815:0:82628:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782759974.119826:0:82628:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e07a62ec/0xd5b45c7f5c60eb5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ad1 expref: 7 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.119851:0:82628:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e07a62ec/0xd5b45c7f5c60eb5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ad1 expref: 7 pid: 82628 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.119866:0:82628:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766800, rc 0) 00000100:00100000:2.0:1782759974.119941:0:82628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:30c7d140-73a2-4bba-a976-24cedcc81799+7:2404:x1869355218689920:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 233us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759974.119947:0:82628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 1140 00000100:00100000:1.0:1782759974.132211:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:3.0:1782759974.132304:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218690176 00000100:00100000:3.0:1782759974.132314:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218690176 00000100:00100000:3.0:1782759974.132384:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 491 00000100:00100000:3.0:1782759974.132396:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30c7d140-73a2-4bba-a976-24cedcc81799+19:119233:x1869355218690176:12345-192.168.202.31@tcp:35:lfs.0 00000100:00100000:3.0:1782759974.132682:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4bbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:30c7d140-73a2-4bba-a976-24cedcc81799+20:119233:x1869355218690176:12345-192.168.202.31@tcp:35:lfs.0 Request processed in 273us (468us total) trans 4294968083 rc 0/0 00000100:00100000:3.0:1782759974.132693:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 491 00000100:00100000:0.0:1782759974.168012:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759974.168706:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218690304 00000100:00100000:1.0:1782759974.168717:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218690304 00000100:00100000:1.0:1782759974.168907:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3247 00000100:00100000:1.0:1782759974.168919:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+20:119238:x1869355218690304:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:1.0:1782759974.168996:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169014:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169026:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169041:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169049:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169055:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169130:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169138:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169144:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782759974.169184:0:6531:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782759974.169188:0:6531:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1782759974.169200:0:6531:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169213:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169220:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169225:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169232:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169238:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de5a00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759974.169242:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169250:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169261:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:1.0:1782759974.169265:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.169269:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169274:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de5a00/0xd5b45c7f5c60eb66 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169288:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169295:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169301:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169306:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759974.169309:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169315:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169322:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cddc34f6d00) 00010000:00010000:1.0:1782759974.169324:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.169327:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169333:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4e00/0xd5b45c7f5c60eb6d lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169348:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169354:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169360:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169365:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cddc3de4600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:1.0:1782759974.169368:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169377:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169384:0:6531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:1.0:1782759974.169386:0:6531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782759974.169389:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 2/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782759974.169394:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cddc3de4600/0xd5b45c7f5c60eb74 lrc: 0/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782759974.169475:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:30c7d140-73a2-4bba-a976-24cedcc81799+20:119238:x1869355218690304:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 559us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759974.169483:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3247 00000100:00100000:1.0:1782759974.183858:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759974.185256:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218690560 00000100:00100000:2.0:1782759974.185273:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218690560 00000100:00100000:2.0:1782759974.185371:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3248 00000100:00100000:2.0:1782759974.185384:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddcc3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30c7d140-73a2-4bba-a976-24cedcc81799+20:119238:x1869355218690560:12345-192.168.202.31@tcp:101:lfs.0 00010000:00010000:2.0:1782759974.185405:0:6532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782759974.185427:0:6532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb7b lrc: 2/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5ed847743eb27ad8 expref: -99 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.185536:0:6532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb82 lrc: 3/1,0 mode: --/CR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.185551:0:6532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb82 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.185574:0:6532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb82 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6532 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759974.185636:0:6532:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00010000:00010000:2.0:1782759974.185776:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb7b lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ad8 expref: 23 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.185975:0:6532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766000/0xd5b45c7f5c60eb82 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0xb:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.31@tcp remote: 0x5ed847743eb27ad8 expref: 22 pid: 6532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.185987:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:2.0:1782759974.185990:0:6532:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1782759974.185994:0:6532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cdedb766000, rc 0) 00000100:00100000:2.0:1782759974.186065:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddcc3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:30c7d140-73a2-4bba-a976-24cedcc81799+22:119238:x1869355218690560:12345-192.168.202.31@tcp:101:lfs.0 Request processed in 684us (2216us total) trans 4294968084 rc 0/0 00000100:00100000:2.0:1782759974.186073:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3248 00000100:00100000:3.0:1782759974.193547:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:1.0:1782759974.193742:0:66654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218690688 00000100:00100000:1.0:1782759974.193754:0:66654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218690688 00000100:00100000:1.0:1782759974.193817:0:66654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 492 00000100:00100000:1.0:1782759974.193827:0:66654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:30c7d140-73a2-4bba-a976-24cedcc81799+22:119238:x1869355218690688:12345-192.168.202.31@tcp:37:lfs.0 00000100:00100000:1.0:1782759974.200401:0:66654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:30c7d140-73a2-4bba-a976-24cedcc81799+22:119238:x1869355218690688:12345-192.168.202.31@tcp:37:lfs.0 Request processed in 6563us (6852us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759974.200420:0:66654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 492 00000100:00100000:3.0:1782759974.233012:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759974.233243:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218690816 00000100:00100000:2.0:1782759974.233253:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218690816 00000100:00100000:2.0:1782759974.233327:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3249 00000100:00100000:2.0:1782759974.233339:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+22:119245:x1869355218690816:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1782759974.233409:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233429:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233439:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233455:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233462:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233469:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233541:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233548:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233554:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759974.233922:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782759974.233927:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759974.233941:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233955:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233965:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233970:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233977:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233982:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.233987:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.233994:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234007:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759974.234010:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.234015:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234022:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60eb90 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234038:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234044:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234051:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234056:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.234059:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234065:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234071:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cddc34ff400) 00010000:00010000:2.0:1782759974.234074:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.234076:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234081:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60eb97 lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234096:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234102:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234106:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234111:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.234114:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234120:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234132:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:2.0:1782759974.234134:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.234137:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 2/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.234143:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eb9e lrc: 0/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759974.234283:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:30c7d140-73a2-4bba-a976-24cedcc81799+22:119245:x1869355218690816:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 944us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759974.234293:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3249 00000100:00100000:3.0:1782759974.284544:0:3655:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.31@tcp (source: 12345-192.168.202.31@tcp) 00000100:00100000:2.0:1782759974.284734:0:8593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355218690944 00000100:00100000:2.0:1782759974.284744:0:8593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355218690944 00000100:00100000:2.0:1782759974.284870:0:8593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.31@tcp, seq: 3250 00000100:00100000:2.0:1782759974.284883:0:8593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+22:119253:x1869355218690944:12345-192.168.202.31@tcp:34:lfs.0 00010000:00010000:2.0:1782759974.284964:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 3/1,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.284983:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.284997:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 3/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285012:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 3/1,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285018:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285028:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285105:0:8593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/1,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285114:0:8593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285121:0:8593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782759974.285159:0:8593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000422:0xb:0x0]: returning size 0 00000004:00200000:2.0:1782759974.285163:0:8593:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1782759974.285175:0:8593:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285188:0:8593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285194:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 4/1,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285200:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 3/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285205:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285211:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767e00 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.285214:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 4/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285222:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 5/0,0 mode: CR/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285234:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x0 (ffff8cddc34f6700) 00010000:00010000:2.0:1782759974.285237:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.285241:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 3/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285247:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767e00/0xd5b45c7f5c60eba5 lrc: 0/0,0 mode: --/CR res: [0x200000422:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285261:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 3/1,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285266:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 2/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285271:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285275:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb766600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.285277:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 3/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285282:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 4/0,0 mode: PR/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285288:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0x9:0x0].0x21bc58c4 (ffff8cddc34ff400) 00010000:00010000:2.0:1782759974.285290:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.285292:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 2/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285300:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb766600/0xd5b45c7f5c60ebac lrc: 0/0,0 mode: --/PR res: [0x200000422:0x9:0x0].0x21bc58c4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285312:0:8593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/1,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285317:0:8593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 2/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285323:0:8593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285327:0:8593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cdedb767600 already unused, calling callback (ffffffffc194d4f0) 00010000:00010000:2.0:1782759974.285329:0:8593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 3/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285334:0:8593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 4/0,0 mode: PR/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285339:0:8593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000422:0xb:0x0].0x0 (ffff8cddc34ff200) 00010000:00010000:2.0:1782759974.285341:0:8593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782759974.285343:0:8593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 2/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782759974.285348:0:8593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cdedb767600/0xd5b45c7f5c60ebb3 lrc: 0/0,0 mode: --/PR res: [0x200000422:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782759974.285431:0:8593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:30c7d140-73a2-4bba-a976-24cedcc81799+22:119253:x1869355218690944:12345-192.168.202.31@tcp:34:lfs.0 Request processed in 542us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759974.285438:0:8593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.31@tcp, seq: 3250 00000100:00100000:2.0:1782759974.795114:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782759974.795138:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233224320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1782759974.795218:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759974.795374:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224320 00000100:00100000:0.0:1782759974.795384:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224320 00000100:00100000:0.0:1782759974.795463:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3657 00000100:00100000:0.0:1782759974.795473:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233224320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1782759974.795508:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445638144 avail 1299398656 00000100:00100000:0.0:1782759974.795562:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233224320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759974.795568:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3657 00000100:00100000:2.0:1782759974.797080:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233224320:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1782759974.858876:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759975.827567:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233224576:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.827570:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233224704:0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.827693:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233224448:0@lo:400:kworker.0 00000001:00100000:3.0:1782759975.834502:0:8440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 30c7d140-73a2-4bba-a976-24cedcc81799 00000001:00100000:3.0:1782759975.834518:0:8440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95b27dde-c150-4adf-930b-37620c52929b 00000001:00080000:3.0:1782759975.834529:0:8440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967457 is committed 00000020:00000080:3.0:1782759975.834541:0:8440:0:(genops.c:906:class_export_put()) final put ffff8cddc5526800/95b27dde-c150-4adf-930b-37620c52929b 00000100:00100000:0.0:1782759975.835715:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759975.835810:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233225088:0@lo:400:kworker.0 00000100:00100000:0.0:1782759975.835857:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759975.835891:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233225600:0@lo:400:kworker.0 00000100:00100000:0.0:1782759975.835915:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759975.838961:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224576 00000100:00100000:2.0:1782759975.838978:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224576 00000100:00100000:2.0:1782759975.839054:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225088 00000100:00100000:2.0:1782759975.839058:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225088 00000100:00100000:2.0:1782759975.839093:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225600 00000100:00100000:2.0:1782759975.839096:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225600 00000100:00100000:2.0:1782759975.839126:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5758 00000100:00100000:2.0:1782759975.839138:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233224576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839245:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+7:3665:x1869355233224576:12345-0@lo:400:kworker.0 Request processed in 109us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759975.839253:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5758 00000100:00100000:2.0:1782759975.839271:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5759 00000100:00100000:2.0:1782759975.839279:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233225088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839388:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+6:3665:x1869355233225088:12345-0@lo:400:kworker.0 Request processed in 110us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759975.839394:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5759 00000100:00100000:2.0:1782759975.839407:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5760 00000100:00100000:2.0:1782759975.839415:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233225600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839444:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+6:3665:x1869355233225600:12345-0@lo:400:kworker.0 Request processed in 31us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759975.839449:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5760 00000100:00080000:2.0:1782759975.839472:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782759975.839522:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3665:1869355233224576:0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839536:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3665:1869355233225088:0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839546:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7264e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3665:1869355233225600:0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839630:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759975.839670:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224448 00000100:00100000:2.0:1782759975.839674:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224448 00000100:00100000:2.0:1782759975.839705:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3643 00000100:00100000:2.0:1782759975.839714:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233224448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839745:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cded3a32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8c55c43-51ff-4f74-a800-62b522e56789+24:3664:x1869355233224448:12345-0@lo:400:kworker.0 Request processed in 33us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759975.839752:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3643 00000100:00100000:2.0:1782759975.839796:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b8c55c43-51ff-4f74-a800-62b522e56789:3664:1869355233224448:0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.839808:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233224960:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.839933:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1782759975.839977:0:29139:0:(genops.c:865:class_export_destroy()) destroying export ffff8cddc5526800/95b27dde-c150-4adf-930b-37620c52929b for lustre-OST0000 00000020:00000080:1.0:1782759975.840024:0:29139:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8cddc5524800 for lustre-OST0000 00000100:00100000:1.0:1782759975.840041:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233224832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.840075:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759975.840099:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233225344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.840125:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759975.840145:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233225856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.840167:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759975.840200:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225344 00000100:00100000:1.0:1782759975.840204:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225344 00000100:00100000:1.0:1782759975.840237:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225856 00000100:00100000:1.0:1782759975.840240:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225856 00000100:00100000:1.0:1782759975.840260:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3409 00000100:00100000:1.0:1782759975.840266:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233225344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759975.840393:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224704 00000100:00100000:0.0:1782759975.840399:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224704 00000100:00100000:0.0:1782759975.840442:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3658 00000100:00100000:0.0:1782759975.840450:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233224704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.840505:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224832 00000100:00100000:2.0:1782759975.840508:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224832 00000100:00100000:2.0:1782759975.840536:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5761 00000100:00100000:2.0:1782759975.840543:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc7264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233224832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759975.844124:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3410 00000100:00100000:3.0:1782759975.844151:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233225856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782759975.851373:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+8:3663:x1869355233224832:12345-0@lo:400:kworker.0 Request processed in 10818us (11285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759975.851390:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5761 00000100:00100000:0.0:1782759975.852239:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3662:x1869355233224704:12345-0@lo:400:kworker.0 Request processed in 11786us (12301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759975.852250:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3658 00000100:00100000:1.0:1782759975.853994:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc7264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233225344:12345-0@lo:400:kworker.0 Request processed in 13719us (13859us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759975.854010:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3409 00000100:00100000:1.0:1782759975.854083:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3663:1869355233224832:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.854096:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233225344:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.854567:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233224704:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.854731:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233225216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.854791:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759975.856700:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225216 00000100:00100000:1.0:1782759975.856716:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225216 00000100:00100000:1.0:1782759975.856795:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5762 00000100:00100000:3.0:1782759975.857919:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233225856:12345-0@lo:400:kworker.0 Request processed in 13777us (17744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759975.857937:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3410 00000100:00080000:3.0:1782759975.857970:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1782759975.857976:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782759975.857979:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782759975.858035:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759975.858068:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddcc3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233225472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759975.858099:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759975.858124:0:8600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225472 00000100:00100000:3.0:1782759975.858131:0:8600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225472 00000100:00100000:3.0:1782759975.858177:0:8600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3411 00000100:00100000:3.0:1782759975.858186:0:8600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233225472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782759975.858240:0:8600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233225472:12345-0@lo:400:kworker.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759975.858246:0:8600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3411 00000100:00080000:3.0:1782759975.858264:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759975.858998:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233225216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.859058:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1869355233225216:12345-0@lo:400:kworker.0 Request processed in 2253us (4267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759975.859069:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5762 00000100:00100000:1.0:1782759975.859103:0:39509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233224960 00000100:00100000:1.0:1782759975.859109:0:39509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233224960 00000100:00100000:0.0:1782759975.859435:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233225856:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.860440:0:39509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3659 00000100:00100000:1.0:1782759975.860454:0:39509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233224960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.860536:0:39509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc4eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233224960:12345-0@lo:400:kworker.0 Request processed in 87us (2500us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759975.860543:0:39509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3659 00000100:00100000:1.0:1782759975.860625:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3662:1869355233225216:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.860638:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233225728:0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.860685:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759975.860915:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233225472:0@lo:400:kworker.0 00000100:00100000:3.0:1782759975.860924:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc7266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233225984:0@lo:400:kworker.0 00000100:00100000:3.0:1782759975.860956:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759975.861002:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddcc3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233224960:0@lo:400:kworker.0 00000100:00100000:0.0:1782759975.861076:0:42628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225728 00000100:00100000:0.0:1782759975.861083:0:42628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225728 00000100:00100000:0.0:1782759975.861140:0:42628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5763 00000100:00100000:0.0:1782759975.861148:0:42628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233225728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782759975.861189:0:42628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd97bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1869355233225728:12345-0@lo:400:kworker.0 Request processed in 43us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759975.861196:0:42628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5763 00000100:00080000:3.0:1782759975.861474:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1782759975.862070:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233225984 00000100:00100000:1.0:1782759975.862078:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233225984 00000100:00100000:1.0:1782759975.862144:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3412 00000100:00100000:1.0:1782759975.862152:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233225984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782759975.862211:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233225984:12345-0@lo:400:kworker.0 Request processed in 60us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759975.862218:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3412 00000100:00100000:1.0:1782759975.862264:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3662:1869355233225728:0@lo:400:kworker.0 00000100:00080000:3.0:1782759975.863553:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782759975.863796:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc7266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233225984:0@lo:400:kworker.0 00010000:00010000:3.0:1782759975.905264:0:9533:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782759975.923078:0:167609:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_65: @@@@@@ FAIL: /mnt/lustre/d65.sanity-sec/f65.sanity-sec.1 should be Encrypted, showed 00000100:00100000:1.0:1782759976.330951:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782759976.330977:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233226112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782759976.331077:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782759976.334561:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233226240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1782759976.334666:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782759976.348811:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233226112 00000100:00100000:3.0:1782759976.348828:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233226112 00000100:00100000:3.0:1782759976.348902:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233226240 00000100:00100000:3.0:1782759976.348906:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233226240 00000100:00100000:3.0:1782759976.348931:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2976 00000100:00100000:3.0:1782759976.348943:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233226112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782759976.348979:0:8449:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759976.350529:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2977 00000100:00100000:1.0:1782759976.350556:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233226240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1782759976.350608:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3922771968 avail 3691249664 00000100:00100000:1.0:1782759976.350696:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1869355233226240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (16029us total) trans 0 rc 0/0 00000100:00100000:1.0:1782759976.350703:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2977 00000100:00100000:3.0:1782759976.353359:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdecd979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233226112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4410us (22273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759976.353374:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2976 00000100:00100000:1.0:1782759976.353682:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233226112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782759976.353835:0:3662:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3662:1869355233226240:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1782759976.907885:0:6518:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782759977.361484:0:3663:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233226368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1782759977.361565:0:3663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782759977.361729:0:10361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233226368 00000100:00100000:1.0:1782759977.361737:0:10361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233226368 00000100:00100000:1.0:1782759977.361807:0:10361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2978 00000100:00100000:1.0:1782759977.361818:0:10361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233226368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1782759977.361854:0:10361:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1782759977.361904:0:3665:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782759977.361907:0:10361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3663:x1869355233226368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1782759977.361918:0:3665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233226496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1782759977.361918:0:10361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2978 00000100:00080000:0.0:1782759977.361996:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782759977.362127:0:3663:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdecd979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3663:1869355233226368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1782759977.362221:0:3665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759977.362522:0:3664:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782759977.362533:0:3664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233226624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782759977.362571:0:3664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782759977.362627:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233226624 00000100:00100000:2.0:1782759977.362632:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233226624 00000100:00100000:2.0:1782759977.362686:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2979 00000100:00100000:2.0:1782759977.362694:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233226624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782759977.362709:0:8448:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8714176 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1782759977.362743:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cddc3fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3664:x1869355233226624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782759977.362749:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2979 00000100:00100000:2.0:1782759977.362783:0:3664:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cddc3fa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3664:1869355233226624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782759977.362798:0:6527:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782759977.363373:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869355233226496 00000100:00100000:0.0:1782759977.363380:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869355233226496 00000100:00100000:0.0:1782759977.363440:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3660 00000100:00100000:0.0:1782759977.363448:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233226496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1782759977.363476:0:6537:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1436672000 avail 1290432512 00000100:00100000:0.0:1782759977.363528:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8cdedf9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3665:x1869355233226496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1782759977.363536:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3660 00000100:00100000:0.0:1782759977.363572:0:3665:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8cdedf9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3665:1869355233226496:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1782759977.932870:0:6519:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 75240 lines, 75240 kept, 0 dropped, 0 bad.